Anthropic blocks bioweapon research attempts in third AI misuse report
Anthropic has released its third report on AI misuse, detailing how its systems blocked malicious actors from using Claude for cyberattacks, surveillance, and biological weapons research. The report highlights a specific instance where the AI refused a request to draft a grant proposal for enhancing the chikungunya virus, a dual-use query that could lead to more dangerous pathogens. While older…
Key points
- Anthropic blocked requests to enhance chikungunya virus mutations, citing dual-use biological risks.
- Researcher Jacob Coxon resigned over concerns regarding the race to self-improving superintelligence.
- UK politicians urged a ban on ASI, but the government rejected it in favor of safety regulations.
The disclosure coincides with internal tensions at the company, as researcher Jacob Coxon resigned, citing concerns that Anthropic and OpenAI are racing toward self-improving superintelligence without adequate safety measures. This resignation aligns with broader political pressure in the UK, where over 70 MPs and peers urged Prime Minister Andy Burnham to ban the creation of artificial superintelligence. The UK government responded by rejecting a ban, emphasizing a science-led approach and the need for robust cyber defenses rather than restricting model access.
Anthropic stated that the reported cases represent novel and notable threats rather than typical misuse, including industrial-scale model distillation and state-sponsored propaganda operations. The company urged governments and competitors to adopt similar defensive measures, arguing that as AI capabilities grow, the responsibility to prevent misuse must be shared across the industry and public sector.
The story so far
4 episodes →- Anthropic blocks bioweapon research attempts in third AI misuse reportthis story
Claude owner blocked AI misuse that could have supported biological weapons
yahoo.com · 11 September 2026
Loading the full article…
This text was published by yahoo.com and written by ITV News. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
3sources- Anthropic Has Resumed External Cybersecurity Testing. Is That Enough?Press · nationalinterest.org ·
- Anthropic Says It Blocked Claude Users From Researching Biological Weapons. They Sought To Evade Restrictions.Press · ibtimes.com ·
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Policy & Regulation
All →- Microsoft president urges UK to lead AI regulation amid US pushback · 4 src
- OpenAI and Anthropic urge UK to adopt binding AI rules · 3 src
- Apple launches homeview hub, Anthropic warns of AI risk · 1 src
- Geoffrey Hinton calls Trump a corrupt felon and warns of AI risks · 1 src
- Albanese adviser allegedly edited bipartisan AI letter before PM receipt · 1 src
Comments
via GitHub Discussions