# Anthropic proposes bill to block AI models that could cause $1 billion damage or 50 deaths

Digest AI · Policy & Regulation · published 2026-10-19T20:54:13Z

Canonical: https://digestai.news/story/anthropic-proposes-bill-to-block-ai-models-that-could-cause-1-billion

## Summary

Anthropic is pitching a confidential draft AI safety bill to U.S. lawmakers, according to Politico. The proposal would let the government block the release of a new AI model only if the model could cause at least $1 billion in damage or kill or seriously injure 50 or more people. The bill limits the trigger to risks arising from the creation or release of a biological weapon, the model evading its developer’s controls, or a cyber‑attack.

Independent evaluators, registered with the Commerce Department, would periodically assess Anthropic’s frontier models and could be paid by the lab provided their independence is not compromised. If an evaluator finds the alarming‑sounding risks, they must report to Commerce within 72 hours, after which a federal judge in the District of Columbia would decide whether to halt the model’s release. The draft mirrors California’s SB 5 AI law and states that no other U.S. agency may suspend the model’s development, deployment, or internal use. The move follows broader calls for AI safety, including proposals from Bernie Sanders and a Trump‑backed “Joint Commitment on Frontier Responsibilities.”

## Key points

- Bill would let government block AI models only if they could cause $1 billion damage or 50+ deaths/injuries.
- Blocking applies when risk stems from biological weapons, control evasion, or cyber‑attack, and requires a judge’s order.
- Independent evaluators registered with Commerce must report findings within 72 hours; labs may pay them if independence stays intact.

## Why it matters

Sets a high‑threshold, judge‑driven gate for dangerous AI, shaping future U.S. regulatory approach and industry risk assessments.

## Sources

1. [Anthropic wants AI models blocked only if they threaten over $1 billion in damage or more than 50 deaths or serious injuries](https://techspot.com/news/114252-anthropic-wants-ai-models-blocked-only-if-they.html) (techspot.com, 2026-10-19)

Part of the developing story: [Anthropic's AI Safety Bill Push](https://digestai.news/thread/anthropic-hands-us-lawmakers-a-confidential-draft-of-a-federal-ai-safety-bill) (2 stories)

## Cite

Digest AI, "Anthropic proposes bill to block AI models that could cause $1 billion damage or 50 deaths", 19 October 2026, https://digestai.news/story/anthropic-proposes-bill-to-block-ai-models-that-could-cause-1-billion

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/anthropic-proposes-bill-to-block-ai-models-that-could-cause-1-billion.json