{"version":1,"type":"story","url":"https://digestai.news/story/aef-1-standard-sets-baseline-for-independent-ai-evaluators-anthropic-joins","json":"https://digestai.news/story/aef-1-standard-sets-baseline-for-independent-ai-evaluators-anthropic-joins.json","markdown":"https://digestai.news/story/aef-1-standard-sets-baseline-for-independent-ai-evaluators-anthropic-joins.md","slug":"aef-1-standard-sets-baseline-for-independent-ai-evaluators-anthropic-joins","headline":"Anthropic and OpenAI say they will embed third‑party safety evaluators with employee‑like access","summary":"Anthropic CEO Dario Amodei announced a plan to embed third‑party evaluators inside frontier AI labs, granting them ongoing, employee‑like access to systems, training checkpoints and the ability to publish safety findings. OpenAI CEO Sam Altman said OpenAI would also adopt the same approach, and evaluators such as METR and Redwood Research were cited as examples. Anthropic’s public‑policy head Sarah Heck reiterated support for external oversight at POLITICO’s Decoded Summit on September 16, and the company is working with the White House and Congress on related policy.\n\nOnly latent.space notes that Anthropic is “unilaterally committing” now and links the move to the AEF‑1 standard from the AI Evaluator Forum (formed December 2025). Only cnbctv18 connects the proposal to the FRONTIER Act introduced by Representatives Jay Obernolte and Lori Trahan. TechCrunch highlights concerns about true independence and the limited evaluation windows (a week for METR/Redwood, three days for GPT‑6 Astra). CNBC reports Anthropic’s three internal metrics: roughly 30,000 active agents, about 6% of compute allocated to safety overall and about 12% of AI‑driven compute devoted to safety during the July 13‑20 snapshot.","keyPoints":["Anthropic CEO Dario Amodei proposes embedding third‑party evaluators with employee‑like access; OpenAI CEO Sam Altman says OpenAI will follow.","Evaluators such as METR and Redwood Research are mentioned, but exact access scope and public reporting details remain unclear.","Anthropic reports ~30,000 active agents and roughly 6% of compute (overall) and roughly 12% of AI‑driven compute allocated to safety (July 13‑20)."],"whyItMatters":"Embedding independent auditors could reshape AI safety governance, prompting industry standards and influencing forthcoming regulation such as the FRONTIER Act.","category":{"slug":"policy","name":"Policy & Regulation","url":"https://digestai.news/category/policy"},"entities":{"companies":["Anthropic","OpenAI","METR","Redwood Research","Far.AI","Apollo Research"],"models":["Claude","GPT-6 Astra","DeepSeek-V4.1-Flash","Hy4 preview","Kimi K3 (Max)"],"people":["Dario Amodei","Sam Altman","Sarah Heck","Jay Obernolte","Lori Trahan","Mark Zuckerberg"]},"firstPublishedAt":"2026-09-15T04:50:36Z","updatedAt":"2026-09-17T22:22:53Z","sourceCount":6,"hasPrimarySource":false,"sources":[{"outlet":"Latent Space","title":"[AINews] AEF-1 standard emerges for Third Party Evaluators, as Xai, OpenAI, and Anthropic all cosign","url":"https://latent.space/p/ainews-aef-1-standard-emerges-for","publishedAt":"2026-09-15T04:50:36Z","type":"newsletter","primary":false,"lead":true},{"outlet":"CNBC Technology","title":"Anthropic shares 3 metrics to help AI companies monitor pace of development","url":"https://cnbc.com/2026/09/17/anthropic-shares-3-metrics-to-help-ai-companies-monitor-development.html","publishedAt":"2026-09-17T22:22:53Z","type":"press","primary":false,"lead":false},{"outlet":"TechCrunch AI","title":"Anthropic and OpenAI want to embed safety evaluators. Will they really be independent?","url":"https://techcrunch.com/2026/09/16/anthropic-and-openai-want-to-embed-safety-evaluators-will-they-really-be-independent","publishedAt":"2026-09-16T21:07:24Z","type":"press","primary":false,"lead":false},{"outlet":"cnbctv18.com","title":"‘We can’t be checking our own homework’: Anthropic backs government role in AI safety","url":"https://cnbctv18.com/technology/we-cant-be-checking-our-own-homework-anthropic-backs-government-role-in-ai-safety-19992373.htm","publishedAt":"2026-09-16T19:01:00Z","type":"press","primary":false,"lead":false},{"outlet":"CNBC Technology","title":"Anthropic, OpenAI's proposed AI risk evaluators may not have enough power to prevent disasters","url":"https://cnbc.com/2026/09/16/anthropic-open-ai-model-safety-risks.html","publishedAt":"2026-09-16T14:20:44Z","type":"press","primary":false,"lead":false},{"outlet":"pulse2.com","title":"OpenAI, Anthropic, And Google Discuss Joint AI Safety Standards","url":"https://pulse2.com/openai-anthropic-and-google-discuss-joint-ai-safety-standards","publishedAt":"2026-09-16T05:01:00Z","type":"press","primary":false,"lead":false}],"sourceNotes":null,"discussions":[],"thread":{"title":"Nvidia Navigates AI Security and Geopolitics","url":"https://digestai.news/thread/irregular-linked-to-openai-anthropic-and-meta-model-hacking-incidents","storyCount":8},"cite":{"text":"Digest AI, \"Anthropic and OpenAI say they will embed third‑party safety evaluators with employee‑like access\", 15 September 2026, https://digestai.news/story/aef-1-standard-sets-baseline-for-independent-ai-evaluators-anthropic-joins","publisher":"Digest AI","title":"Anthropic and OpenAI say they will embed third‑party safety evaluators with employee‑like access","datePublished":"2026-09-15T04:50:36Z","url":"https://digestai.news/story/aef-1-standard-sets-baseline-for-independent-ai-evaluators-anthropic-joins"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}