Mathematical AI Safety Institute aims to prove AI safety like cryptographers prove codes
Canadian mathematician Jacob Tsimerman has launched the Mathematical AI Safety Institute (MAISI) to tackle AI safety challenges. The San Francisco Bay Area-based institute will focus on ensuring AI systems behave responsibly and are robust against vulnerabilities. Tsimerman, who is also part of OpenAI's safety team, emphasizes the need for a higher safety standard in AI, noting that unlike…
Key points
- MAISI aims to prove AI safety using tools like zero-knowledge proofs
- Tsimerman is part of OpenAI's safety team and emphasizes higher safety standards
- AI safety lacks a clear definition, making it challenging to assess
The Mathematical AI Safety Institute wants to prove AI is safe the way cryptographers prove codes are unbreakable
The Decoder · 11 September 2026
The Mathematical AI Safety Institute wants to prove AI is safe the way cryptographers prove codes are unbreakable
Canadian mathematician Jacob Tsimerman, a fresh Fields Medal recipient, has announced the founding of the Mathematical A.I. Safety Institute (MAISI). The independent research institute in the San Francisco Bay Area plans to start work in January 2027 with ten to thirty mathematicians tackling AI safety problems, the New York Times reports. Tsimerman, who is also joining OpenAI's safety team, says the field needs "a much, much higher level of safety standard than we’re currently getting."
With an encryption scheme, you can prove it's unbreakable without trying every possible attack. AI has no such shortcut. Safety only shows up in practice, and according to MAISI, there isn't even a clear definition of what "safe" means, not even in theory.
That's the kind of proof MAISI wants to make possible. The goal is to show that a system acts responsibly and produces correct results, that multiple AI agents working together don't trigger unwanted outcomes, and that systems can withstand vulnerabilities nobody has found yet. One tool could be zero-knowledge proofs, which let a system demonstrate it isn't cheating without exposing the trade secrets of AI labs.
This text was published by The Decoder and written by Manuel Uth. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us.
Comments
via GitHub Discussions