AI hallucinations hit 2,022 legal cases as Google launches Gemini Enterprise for Legal
A public database maintained by legal researcher Damien Charlotin reveals that artificial intelligence has generated fake court citations in over 2,000 legal decisions globally since April 2023. The dataset, which includes more than 1,300 U.S. cases, indicates that while the initial surge in AI hallucinations has plateaued, the issue remains significant. ChatGPT is the most frequently cited tool…
Key points
- Over 2,022 global legal cases since 2023 involved AI-generated fake citations, with 1,300 in the U.S.
- ChatGPT appears in over 100 cases, while Google's Gemini and Bard are cited in only 10 instances.
- Google launched Gemini Enterprise for Legal in August, integrating agents like Deloitte Legal Assist for governance.
Amidst these findings, Google is aggressively promoting its new Gemini Enterprise for Legal, a specialized platform launched in August 2025. Halimah DeLaine Prado, Google’s general counsel, described the tool as a complement to human judgment rather than a replacement, emphasizing its utility in contract redlining and e-discovery. The platform integrates specialized AI agents, such as Deloitte Legal Assist, to handle complex legal tasks with centralized governance. Charlotin notes that free, non-search-enabled large language models tend to hallucinate more frequently, a risk particularly prevalent among self-represented litigants who rely on such tools.
The data suggests that improved tooling and heightened awareness have stabilized the rate of AI errors in legal filings. However, the persistence of thousands of hallucinated citations underscores the need for robust verification systems. As major tech firms deploy enterprise-grade legal AI, the industry faces a critical balance between leveraging automation for efficiency and mitigating the reputational and legal risks associated with model inaccuracies.
The story so far
2 episodes →- AI hallucinations hit 2,022 legal cases as Google launches Gemini Enterprise for Legalthis story
AI Faked Citations In More Than 2,000 Cases As Google Pitches Legal Model
aol.com · 8 September 2026
Loading the full article…
This text was published by aol.com and written by AOL. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Enterprise & Industry
All →- Shopify lets AI agents buy products via Shop Pay · 1 src
- AI interviews dehumanize job seekers: educator's experience · 1 src
- Scuba raises $34M to build a shared context engine for AI teams · 1 src
- Meta, Microsoft and Walmart scale back AI adoption after errors and cost concerns · 1 src
- Winters: I can’t have Lucas turned off when I die · 1 src
Comments
via GitHub Discussions