# arXiv study finds AI humanizers alter 35–65% of fact units in documents

Digest AI · Research · published 2026-11-03T05:00:00Z

Canonical: https://digestai.news/story/arxiv-study-finds-ai-humanizers-alter-3565-of-fact-units-in-documents

## Summary

A new paper on arXiv examines how AI ‘humanizers’ rewrite machine-generated text to evade detection, but finds they often drop or change factual details. Researchers tested 11 commercial tools in the October 2026 leaderboard cycle and found all altered at least one of four fact units—numbers, dates, names, or quoted spans—in 35–65% of documents containing them. Most errors occurred in quoted spans, while numbers and names were preserved in only 20% or more of cases for 10 of the 11 tools. An open-source 12B humanizer retained 97% of numbers and names but reworded 67–78% of quoted spans despite prompts to avoid changes.

In contrast, perplexity-based detectors failed to distinguish AI-styled rewrites from human text when line breaks were removed. The authors released a rule-based checker and per-item results to validate their findings.

## Key points

- 11 commercial AI humanizers altered 35–65% of fact units (numbers, dates, names, quotes) in October 2026 tests
- An open 12B humanizer kept 97% of numbers and names but changed 67–78% of quoted spans

## Why it matters

The findings expose a critical flaw in AI humanizers: while they may evade detection, they often distort factual content, undermining trust in AI-generated text.

## Sources

1. [Humanized but Still True? Auditing Facts and Detection in AI-Text Humanizers](https://arxiv.org/abs/2611.00359) (arXiv cs.CL, 2026-11-03, primary source)

## Cite

Digest AI, "arXiv study finds AI humanizers alter 35–65% of fact units in documents", 3 November 2026, https://digestai.news/story/arxiv-study-finds-ai-humanizers-alter-3565-of-fact-units-in-documents

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/arxiv-study-finds-ai-humanizers-alter-3565-of-fact-units-in-documents.json