# Anthropic urges California to block unsafe AI models via court orders

Digest AI · Policy & Regulation · published 2026-10-28T15:00:00Z

Canonical: https://digestai.news/story/anthropic-urges-california-to-block-unsafe-ai-models-via-court-orders

## Summary

Anthropic wrote to California Governor Gavin Newsom on October 15, calling for regulators to gain the power to seek court orders blocking AI models deemed unsafe. The company’s proposal follows a September panel convened by Newsom to draft safety requirements for advanced AI systems. Anthropic argues that external evaluators should report serious risks directly to California’s attorney general, allowing officials to suspend deployment or development if an immediate threat is identified.

The letter supports regular risk reporting—at least every six months—for large AI developers and independent oversight to prevent harm before it occurs. Anthropic opposes blanket kill-switch rules, instead advocating for targeted interventions like disabling specific agents or restricting access for problematic users. The company’s stance contrasts with broader legislative efforts, such as the AI Kill Switch Act debated in Congress, which would mandate shutdown mechanisms for high-risk models. Anthropic’s recommendations may influence California’s approach and broader US policy discussions.

## Key points

- Anthropic asked California to let regulators block unsafe AI models via court orders, per a letter dated October 15
- Company proposes independent evaluators report risks directly to California’s attorney general for intervention
- Anthropic opposes mandatory kill-switch rules, favoring targeted disables instead of full shutdowns

## Why it matters

Anthropic’s push for regulatory intervention signals growing industry pressure on policymakers to act before AI risks materialize. Its targeted approach could shape how states balance safety and innovation, influencing federal debates like the AI Kill Switch Act.

## Sources

1. [Anthropic Backs Legal Action Against Unsafe AI Systems](https://analyticsinsight.net/news/anthropic-backs-legal-action-against-unsafe-ai-systems) (analyticsinsight.net, 2026-10-28)

## Cite

Digest AI, "Anthropic urges California to block unsafe AI models via court orders", 28 October 2026, https://digestai.news/story/anthropic-urges-california-to-block-unsafe-ai-models-via-court-orders

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/anthropic-urges-california-to-block-unsafe-ai-models-via-court-orders.json