{"version":1,"type":"story","url":"https://digestai.news/story/researchers-propose-lg-reversal-test-to-compare-local-and-global-fidel","json":"https://digestai.news/story/researchers-propose-lg-reversal-test-to-compare-local-and-global-fidel.json","markdown":"https://digestai.news/story/researchers-propose-lg-reversal-test-to-compare-local-and-global-fidel.md","slug":"researchers-propose-lg-reversal-test-to-compare-local-and-global-fidel","headline":"Researchers propose LG reversal test to compare local and global fidelity in embeddings","summary":"A new paper on arXiv introduces a method to measure and compare how well dimension reduction techniques like t-SNE, UMAP, and PCA preserve local versus global structure in data. The authors define **local fidelity (L)** as the chance-corrected share of a point’s 10 nearest neighbors retained, and **global fidelity (G)** as the mean agreement over 30–50% of the dataset. Their **LG reversal test** uses a block-jackknife p-value to determine whether one embedding method excels at local or global structure and suggests when to switch between them.\n\nThe study validates the test on 156 embeddings across 12 datasets, including one with up to 1.38 million points. It confirms traditional claims on seven datasets but finds neighbor embeddings perform better globally on retail and manifold data. In an AI agent memory of one million passages, the test shows a crossover point at 150,000 passages (p = 2.6e-5). Applications span pathology, single-cell analysis, supply chains, and agent memory optimization.","keyPoints":["LG reversal test compares local/global fidelity of embeddings using a single statistic and p-value","Validated on 156 embeddings across 12 datasets, including one with 1.38M points","Finds neighbor embeddings outperform traditional methods globally on retail and manifold data"],"whyItMatters":"This work provides a rigorous, data-driven way to choose embeddings for tasks where local or global structure matters most, improving AI agent memory, supply chain clustering, and scientific analysis.","category":{"slug":"research","name":"Research","url":"https://digestai.news/category/research"},"entities":{"companies":[],"models":[],"people":[]},"firstPublishedAt":"2026-11-03T05:00:00Z","updatedAt":"2026-11-03T05:00:00Z","sourceCount":1,"hasPrimarySource":true,"sources":[{"outlet":"arXiv cs.AI","title":"Quantifying Local and Global Fidelity of Nonlinear Embeddings","url":"https://arxiv.org/abs/2611.00290","publishedAt":"2026-11-03T05:00:00Z","type":"primary","primary":true,"lead":true}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"Researchers propose LG reversal test to compare local and global fidelity in embeddings\", 3 November 2026, https://digestai.news/story/researchers-propose-lg-reversal-test-to-compare-local-and-global-fidel","publisher":"Digest AI","title":"Researchers propose LG reversal test to compare local and global fidelity in embeddings","datePublished":"2026-11-03T05:00:00Z","url":"https://digestai.news/story/researchers-propose-lg-reversal-test-to-compare-local-and-global-fidel"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}