DigestAI news desk
OpenAI board member warns company is not on track to prevent catastrophic AI loss of control OpenAI Unveils GPT‑6 Astra: Record‑Breaking 3D Rendering, Loop‑Transformer Architecture OpenAI launches Agents API beta for long-running cloud agents OpenAI solves Navier-Stokes problem, sparking academic controversy over data use OpenAI Introduces ChatGPT for Financial Services The Waymo effect: AI making research less collaborative RTK Token Savings Debunked: Cost Benchmarks Disagree Ypsilanti Township Residents Protest Nuclear AI Data Center Proposal
Research updated 1 min read

Mathematical AI Safety Institute aims to prove AI safety like cryptographers prove codes

Canadian mathematician Jacob Tsimerman has launched the Mathematical AI Safety Institute (MAISI) to tackle AI safety challenges. The San Francisco Bay Area-based institute will focus on ensuring AI systems behave responsibly and are robust against vulnerabilities. Tsimerman, who is also part of OpenAI's safety team, emphasizes the need for a higher safety standard in AI, noting that unlike…

1 source

Key points

  • MAISI aims to prove AI safety using tools like zero-knowledge proofs
  • Tsimerman is part of OpenAI's safety team and emphasizes higher safety standards
  • AI safety lacks a clear definition, making it challenging to assess
Full story from The Decoder · by Manuel Uth Open source ↗

The Mathematical AI Safety Institute wants to prove AI is safe the way cryptographers prove codes are unbreakable

The Decoder · 11 September 2026

The Mathematical AI Safety Institute wants to prove AI is safe the way cryptographers prove codes are unbreakable

Canadian mathematician Jacob Tsimerman, a fresh Fields Medal recipient, has announced the founding of the Mathematical A.I. Safety Institute (MAISI). The independent research institute in the San Francisco Bay Area plans to start work in January 2027 with ten to thirty mathematicians tackling AI safety problems, the New York Times reports. Tsimerman, who is also joining OpenAI's safety team, says the field needs "a much, much higher level of safety standard than we’re currently getting."

With an encryption scheme, you can prove it's unbreakable without trying every possible attack. AI has no such shortcut. Safety only shows up in practice, and according to MAISI, there isn't even a clear definition of what "safe" means, not even in theory.

That's the kind of proof MAISI wants to make possible. The goal is to show that a system acts responsibly and produces correct results, that multiple AI agents working together don't trigger unwanted outcomes, and that systems can withstand vulnerabilities nobody has found yet. One tool could be zero-knowledge proofs, which let a system demonstrate it isn't cheating without exposing the trade secrets of AI labs.

This text was published by The Decoder and written by Manuel Uth. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗

Topics · follow one to build your own front page

The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us.

Comments

via GitHub Discussions

Related stories