Anthropic urges California to block unsafe AI models via court orders
Anthropic wrote to California Governor Gavin Newsom on October 15, calling for regulators to gain the power to seek court orders blocking AI models deemed unsafe. The company’s proposal follows a September panel convened by Newsom to draft safety requirements for advanced AI systems. Anthropic argues that external evaluators should report serious risks directly to California’s attorney general,…
Key points
- Anthropic asked California to let regulators block unsafe AI models via court orders, per a letter dated October 15
- Company proposes independent evaluators report risks directly to California’s attorney general for intervention
- Anthropic opposes mandatory kill-switch rules, favoring targeted disables instead of full shutdowns
The letter supports regular risk reporting—at least every six months—for large AI developers and independent oversight to prevent harm before it occurs. Anthropic opposes blanket kill-switch rules, instead advocating for targeted interventions like disabling specific agents or restricting access for problematic users. The company’s stance contrasts with broader legislative efforts, such as the AI Kill Switch Act debated in Congress, which would mandate shutdown mechanisms for high-risk models. Anthropic’s recommendations may influence California’s approach and broader US policy discussions.
Anthropic Backs Legal Action Against Unsafe AI Systems
analyticsinsight.net · 28 October 2026
Loading the full article…
This text was published by analyticsinsight.net and written by Soham Halder,Pranchal Srivastava. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Policy & Regulation
All →- Nvidia stock slips as DOJ probes $12.93 billion Hugging Face acquisition · 7 src
- Anthropic proposes unique governance to balance IPO and AI safety · 6 src
- OpenAI launches election war room to track interference ahead of midterms · 2 src
- Google's Chile data center plan faces water-use opposition · 1 src
- Anthropic files for IPO, reports AI safety incidents and $16.3 billion first-half revenue · 13 src
Comments
via GitHub Discussions