Meta's outreach team uses AI and reviewers to flag potential school shooter threats
Meta has built a small internal team that combines artificial‑intelligence tools with human reviewers to spot online activity that could signal a school shooting. The effort surfaced when a tip arrived on February 18, 2025 from FBI supervisory special agent Brian Ennesser, who alerted Spring Branch district officials about two teenage girls planning violence. Meta’s system flagged the girls’…
Key points
- Meta’s internal team used AI to flag a threat at Spring Branch district after a tip on February 18, 2025.
- The Institute for Strategic Dialogue says T.C.C. activity has been linked to at least nine attacks and sixteen disrupted plots in the past two years.
- Meta flagged content “around eight hundred times worldwide” last year, including a Cardozo High School Instagram post that led to a gun seizure within two hours.
The team’s work draws on research into the so‑called True Crime Community (T.C.C.), an online fandom that glorifies mass‑shooters. The Institute for Strategic Dialogue reports that in the past two years the T.C.C. has been linked to at least nine attacks and sixteen disrupted plots. Meta says its automated review flagged content “around eight hundred times worldwide” last year, passing information to law‑enforcement in cases such as a Cardozo High School Instagram post that resulted in a gun seizure within two hours. The article also notes similar challenges at OpenAI, where a flagged account led to a tragic shooting after the company chose not to alert authorities.
Experts caution that while AI can help identify “leakage” of violent intent, platforms must balance privacy, liability and the risk of over‑reporting, especially as extremist language becomes more coded and harder for moderation tools to catch.
Inside Meta's law enforcement outreach team, which uses AI and human reviewers to analyze social media posts, aiming to prevent threats like school shootings
newyorker.com · 24 October 2026.jpg)
Loading the full article…
This text was published by newyorker.com and written by Rachel Monroe. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Policy & Regulation
All →- Updated Google privacy policy says your Gmail might be used for advertising · 4 src
- UK government commits £100M to AI Biosecurity Lab with OpenAI, Anthropic, and DeepMind · 6 src
- DeepSeek and MiniMax clear China's AI export registration · 2 src
- UK investigates Beijing-backed AI hacking spree · 1 src
- Texas Attorney General Ken Paxton sues OpenAI and Sam Altman over ChatGPT safety claims · 3 src
Comments
via GitHub Discussions