Anthropic bans 'cruel' behavior toward its AI in policy update
Anthropic has updated its usage policy to prohibit users from engaging in "sustained and needless" abusive behavior toward its AI systems. The company stated that its tools can now end interactions where users are "cruel," a measure it previously applied only in rare instances. This new rule joins a list of forbidden conduct that includes bullying, promoting self-harm, and creating…
Key points
- Anthropic updated its policy to ban sustained, needless abusive behavior toward its AI tools.
- The rule applies only to extreme cases, excluding common frustration or model testing.
- The update sparked debate over anthropomorphizing AI and the necessity of polite prompts.
Anthropic clarified that the policy applies only to extreme cases of repeated abuse and does not cover common user frustration, dark creative themes, or model testing. However, the specific definition of "abusive or cruel behavior" remains unclear, sparking debate on social media. Some users praised the move as advancing "model welfare," while others criticized it as harmful anthropomorphization. Dr Barry Scannell, a technology partner at William Fry, argued that treating AI as capable of feeling cruelty is misleading.
The policy update, first reported by The Verge, follows an annual review and also addresses election integrity by banning deceptive campaigns. The change has reignited discussions about etiquette in AI interactions, with some experts arguing that politeness wastes tokens, while others suggest it may improve response quality or prevent rude habits from spilling over into human interactions.
Anthropic bans users from being 'cruel' to its AI systems
BBC Technology · 9 October 2026
Loading the full article…
This text was published by BBC Technology and written by https://www.facebook.com/bbcnews. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Policy & Regulation
All →- Apple launches homeview hub, Anthropic warns of AI risk · 1 src
- Geoffrey Hinton calls Trump a corrupt felon and warns of AI risks · 1 src
- Albanese adviser allegedly edited bipartisan AI letter before PM receipt · 1 src
- Labour peer warns AI risks pose existential threat without urgent regulation · 1 src
- UK minister says AI cyber-attack similar to OpenAI breach is likely · 1 src
Comments
via GitHub Discussions