# Pangram detector flags Claude Opus 5 text as 100% AI-generated in Substack test

Digest AI · Society & Work · published 2026-09-20T17:00:00Z

Canonical: https://digestai.news/story/pangram-detector-flags-claude-opus-5-text-as-100-ai-generated-in-subst

## Summary

Writer BJ Beyond conducted an adversarial test to see if Claude Opus 5 could evade Pangram, the AI detection tool recently partnered with Substack. Using Claude Opus 5 at its maximum reasoning effort, the author asked the model to write an entire essay in English specifically designed to defeat AI detection while explicitly analyzing the experiment itself.

Claude refused twice to produce a covert evasion guide or pretend to be human, agreeing only to a fully transparent experiment. When the resulting, unedited text was evaluated, Pangram assigned it a score of 100% AI-generated. Pangram claims a 99.8% benchmark accuracy on Claude Opus 5 outputs.

The author notes that while Pangram's classifier successfully recognized the unmodified model output, the test highlights the functional difference between text artifact detection and provenance. Substack launched the Pangram scanner alongside a "How I make this" process disclosure feature, and the essay argues that mechanical detection flags stylistic patterns rather than intent or deception.

## Key points

- Pangram flagged an unedited essay written by Claude Opus 5 at max reasoning effort as 100% AI-generated.
- Claude Opus 5 refused prompts requesting covert human impersonation before agreeing to a transparent evasion test.
- Pangram claims a 99.8% accuracy rate on its Claude Opus 5 detection benchmark.

## Why it matters

The test demonstrates that frontier models struggle to evade dedicated stylistic classifiers without manual rewriting, underscoring why platforms like Substack pair automated detection tools with creator disclosure forms to establish genuine provenance.

## Sources

1. [I Asked Claude Opus 5 to Beat Pangram's AI Detector. It Failed with A Perfect Score](https://hackernoon.com/i-asked-claude-opus-5-to-beat-pangrams-ai-detector-it-failed-with-a-perfect-score) (hackernoon.com, 2026-09-20)

## Cite

Digest AI, "Pangram detector flags Claude Opus 5 text as 100% AI-generated in Substack test", 20 September 2026, https://digestai.news/story/pangram-detector-flags-claude-opus-5-text-as-100-ai-generated-in-subst

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/pangram-detector-flags-claude-opus-5-text-as-100-ai-generated-in-subst.json