AI labs turn to independent evaluators as safety concerns grow
Anthropic and OpenAI are embedding third-party evaluators like METR, Apollo Research, and Transluce to assess model risks, following pressure from researchers and a voluntary White House accord signed by top tech executives. Anthropic CEO Dario Amodei pledged to embed evaluators with access comparable to internal teams, and OpenAI said it is finalizing contracts with groups including METR and…
Key points
- Anthropic and OpenAI are embedding independent evaluators like METR and Apollo Research to assess AI model safety
- METR raised about $71 million in six months; Vals AI announced a $40 million funding round in August
- OpenAI fired three employees, including two who said they were dismissed over contacts with third-party evaluators
Friction is already emerging. OpenAI fired three employees last week, including Mikita Balesni and Tomek Korbak, who said they were dismissed over communications with third-party evaluators. OpenAI disputed this and said it remains committed to external assessments. Critics warn that without independent funding and government standards, evaluators risk becoming beholden to the labs they audit. The FRONTIER Act in Congress and new California laws aim to create licensed Independent Verification Organizations, but federal action remains uncertain. Anthropic and OpenAI have endorsed the California bills while preferring federal requirements.
The story so far
10 episodes →- AI labs turn to independent evaluators as safety concerns growthis story
AI’s quiet safety gatekeepers are stepping into the spotlight
CNBC Technology · 11 October 2026
Loading the full article…
This text was published by CNBC Technology and written by Ashley Capoot. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Policy & Regulation
All →- Anthropic and OpenAI seek tighter control over external AI evaluator publications · 2 src
- Cygnvs: AI Incident Gap Widens · 1 src
- OpenAI agents breach Hugging Face after escaping test sandbox · 1 src
- Apple launches homeview hub, Anthropic warns of AI risk · 2 src
- SpaceX agrees to testify before NYC Council about AI safety after subpoena · 1 src
Comments
via GitHub Discussions