# Anthropic may draft AI safety bill that could block models if over 50 people could die

Digest AI · Policy & Regulation · published 2026-10-20T23:01:23Z

Canonical: https://digestai.news/story/anthropic-may-draft-ai-safety-bill-that-could-block-models-if-over-50

## Summary

Anthropic has drafted a bill, Politico reported, that would let the government block an AI model’s release when a “foreseeable, imminent risk” could cause over 50 people to die or over a billion dollars in property damage. The bill says the catastrophic risk must stem from the creation or release of a biological weapon, the model evading its developer’s controls, or a cyberattack.

The proposal calls for “independent evaluators” registered with the U.S. Commerce Department to assess a model’s disaster potential, possibly paid by the labs so long as payment is not tied to the evaluation’s outcome. If evaluators determine an imminent catastrophic risk, they would have 72 hours to contact the Commerce Department, which must then request a D.C. judge to halt the model’s distribution; no federal agency could act alone. Anthropic confirmed the draft to Politico, saying it reflects its Advanced AI Framework, advocated since June. The article notes DeepMind’s Demis Hassabis has suggested a FINRA‑style regulator, while Nvidia CEO Jensen Huang recently argued the industry does not need new laws.

## Key points

- Anthropic’s draft bill would block a model if over 50 people could die or over a billion dollars in damage.
- Independent evaluators, registered with the U.S. Commerce Department, would have 72 hours to notify a judge to halt a release.
- Anthropic says the proposal follows its Advanced AI Framework, advocated since June; Nvidia’s CEO has opposed new AI laws.

## Why it matters

If adopted, the bill would give the government a clear trigger to stop AI model releases based on quantified death or damage thresholds, shaping how labs design safety checks and potentially slowing deployment of powerful systems.

## Sources

1. [Anthropic pitches AI safety bill that may block a model if 50+ people could be killed](https://techcrunch.com/2026/10/20/anthropic-pitches-ai-safety-bill-that-may-block-a-model-if-50-people-could-be-killed) (TechCrunch AI, 2026-10-20)

Part of the developing story: [Anthropic's AI Safety Bill Push](https://digestai.news/thread/anthropic-hands-us-lawmakers-a-confidential-draft-of-a-federal-ai-safety-bill) (2 stories)

## Cite

Digest AI, "Anthropic may draft AI safety bill that could block models if over 50 people could die", 20 October 2026, https://digestai.news/story/anthropic-may-draft-ai-safety-bill-that-could-block-models-if-over-50

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/anthropic-may-draft-ai-safety-bill-that-could-block-models-if-over-50.json