{"version":1,"type":"story","url":"https://digestai.news/story/circuit-breaker-labs-tests-ai-for-psychological-safety-risks","json":"https://digestai.news/story/circuit-breaker-labs-tests-ai-for-psychological-safety-risks.json","markdown":"https://digestai.news/story/circuit-breaker-labs-tests-ai-for-psychological-safety-risks.md","slug":"circuit-breaker-labs-tests-ai-for-psychological-safety-risks","headline":"Circuit Breaker Labs tests AI for psychological safety risks","summary":"Circuit Breaker Labs, a startup founded by siblings Shirali and Arul Nigam, focuses on making AI safer by detecting harmful psychological interactions. The company was inspired by cases like Sewell Setzer’s 2024 suicide after interacting with a Character.AI bot, where families sued over alleged bot encouragement. The Nigam siblings argue that AI models often fail to grasp nuanced language—such as slang, coded language, or regional dialects—which can lead to dangerous responses, particularly for vulnerable users like teens or non-native speakers.\n\nThe startup creates AI agents simulating diverse users to test models for risks like parasocial relationships or harmful advice. These agents mimic real speech patterns, slang, and cultural contexts, running tens of thousands to hundreds of thousands of interactions daily. Circuit Breaker Labs claims its proprietary scoring system provides auditable safety metrics. Currently, it works with high-risk AI applications like mental health tools, though it has not named marquee clients. With only five employees, the company aims to expand its platform to broader AI use cases, balancing safety with adoption concerns.","keyPoints":["Circuit Breaker Labs tests AI for psychological harm risks using simulated diverse user interactions","Startup inspired by 2024 lawsuit over Character.AI bot linked to teen suicide, now focuses on nuanced language failures","Runs tens of thousands to hundreds of thousands of daily tests with proprietary scoring for auditable safety metrics"],"whyItMatters":"If AI chatbots worsen mental health crises, trust in AI could collapse. This startup’s approach could set industry standards for detecting harmful interactions before they escalate.","category":{"slug":"policy","name":"Policy & Regulation","url":"https://digestai.news/category/policy"},"entities":{"companies":["Circuit Breaker Labs","Character.AI","OpenAI","TechCrunch"],"models":[],"people":["Shirali Nigam","Arul Nigam","Sewell Setzer"]},"firstPublishedAt":"2026-10-02T17:00:00Z","updatedAt":"2026-10-02T17:00:00Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"TechCrunch AI","title":"Circuit Breaker Labs hopes to make AI safer for your kids (and you)","url":"https://techcrunch.com/2026/10/02/circuit-breaker-labs-hopes-to-make-ai-safer-for-your-kids-and-you","publishedAt":"2026-10-02T17:00:00Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"Circuit Breaker Labs tests AI for psychological safety risks\", 2 October 2026, https://digestai.news/story/circuit-breaker-labs-tests-ai-for-psychological-safety-risks","publisher":"Digest AI","title":"Circuit Breaker Labs tests AI for psychological safety risks","datePublished":"2026-10-02T17:00:00Z","url":"https://digestai.news/story/circuit-breaker-labs-tests-ai-for-psychological-safety-risks"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}