# Anthropic blocks scientists evading AI guardrails on gain-of-function research

Digest AI · Policy & Regulation · published 2026-09-30T19:00:00Z

Canonical: https://digestai.news/story/anthropic-blocks-scientists-evading-ai-guardrails-on-gain-of-function

## Summary

Anthropic’s misuse report revealed five cases where foreign scientists attempted to bypass Claude’s safeguards to ask about **gain-of-function** research—genetic tweaks that could make pathogens more deadly or transmissible. The company denied their requests and terminated their accounts, noting motives may not have been malicious. The report highlights the dual-use dilemma: while such research can aid vaccine development, it also risks catastrophic accidental or deliberate release.

Anthropic’s move follows broader concerns about AI’s role in lowering barriers to bioweapons. Authorities warn that **3,600 BSL-4 labs worldwide**—far outnumbering potential terrorist groups—pose higher accidental risk than deliberate attacks. Experts like Annie Jacobsen, whose book *Biological War: A Scenario* explores these threats, argue that public awareness and policy gaps exacerbate vulnerabilities. The U.S. and allies accuse Russia, North Korea, China, and Iran of covert bioweapons programs, though deliberate attacks remain statistically unlikely.

## Key points

- Anthropic blocked five foreign scientists querying Claude about gain-of-function research, citing misuse of guardrails
- Gain-of-function tweaks could create airborne pathogens with 100% fatality rates, like pneumonic plague
- 3,600 BSL-4 labs worldwide pose higher accidental risk than deliberate bioweapon attacks, per experts

## Why it matters

AI’s ability to assist with biosecurity research raises ethical and safety questions. While tools like Claude can aid pandemic preparedness, their misuse risks accelerating dangerous genetic experiments. Governments and labs must balance transparency with safeguards to prevent both accidental leaks and deliberate misuse.

## Sources

1. [There Are Plenty of Reasons to Be Concerned About Bioweapons Development—Even Without AI](https://wired.com/story/you-dont-need-ai-to-be-concerned-about-bioweapons-development-but-it-helps) (Wired AI, 2026-09-30)

## Cite

Digest AI, "Anthropic blocks scientists evading AI guardrails on gain-of-function research", 30 September 2026, https://digestai.news/story/anthropic-blocks-scientists-evading-ai-guardrails-on-gain-of-function

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/anthropic-blocks-scientists-evading-ai-guardrails-on-gain-of-function.json