{"version":1,"type":"story","url":"https://digestai.news/story/stanford-study-llms-claims-expire-quickly","json":"https://digestai.news/story/stanford-study-llms-claims-expire-quickly.json","markdown":"https://digestai.news/story/stanford-study-llms-claims-expire-quickly.md","slug":"stanford-study-llms-claims-expire-quickly","headline":"Stanford study: LLMs' claims expire quickly","summary":"A new Stanford study finds that many claims about large language models (LLMs) are already outdated within a year of release, with some even disappearing entirely. The researchers tested 50 widely cited claims against 20 different LLMs and found that only 16% still hold true after one year. This rapid obsolescence is particularly pronounced for the capabilities LLMs can't do, which expire faster than other types of claims.","keyPoints":["44% of widely cited LLM claims have expired within a year","50% of reasoning-related claims are already outdated","Claude Sonnet 5.5 still fabricates 69% of references in scientific citations tests"],"whyItMatters":"This study highlights the need for more transparent and empirical research on LLMs to avoid perpetuating outdated or incorrect claims.","category":{"slug":"research","name":"Research","url":"https://digestai.news/category/research"},"entities":{"companies":["Stanford","OpenAI"],"models":["GPT-6.1 Sol","Qwen3.7-Flash"],"people":[]},"firstPublishedAt":"2026-11-03T19:41:43Z","updatedAt":"2026-11-03T19:41:43Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"The Decoder","title":"Rapid LLM development is outrunning the research meant to explain it, study finds","url":"https://the-decoder.com/rapid-llm-development-is-outrunning-the-research-meant-to-explain-it-study-finds","publishedAt":"2026-11-03T19:41:43Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"Stanford study: LLMs' claims expire quickly\", 3 November 2026, https://digestai.news/story/stanford-study-llms-claims-expire-quickly","publisher":"Digest AI","title":"Stanford study: LLMs' claims expire quickly","datePublished":"2026-11-03T19:41:43Z","url":"https://digestai.news/story/stanford-study-llms-claims-expire-quickly"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}