Microsoft says Diagnostic Orchestrator diagnoses four times more accurately than doctors
Microsoft announced its Diagnostic Orchestrator, an AI system that uses multiple agents and is powered by OpenAI's GPT‑5. The company says the system can diagnose conditions four times more accurately than human doctors. The findings were published Thursday in Science and are based on a benchmark Microsoft built, called SDBench, which will be open‑sourced.
Key points
- Diagnostic Orchestrator reached 83 % accuracy on NEJM case reports, versus 36 % for generalist physicians using references.
- On emergency‑department cases, the AI scored 80 % accuracy compared with an average 47 % for doctors.
- The system, powered by OpenAI’s GPT‑5, uses multiple AI agents and will be released via the open‑source SDBench benchmark.
On case reports taken from the New England Journal of Medicine, the system reached about 83 % diagnostic accuracy, while generalist physicians using references scored roughly 36 % and those without references about 22 %. In a separate set of emergency‑department admissions from Beth Israel Deaconess Medical Center, the AI achieved 80 % accuracy versus an average of 47 % for physicians, and it estimated lower costs per diagnosis.
Researchers note the tests used historical cases, not live patients, and that clinical validation is still required. Microsoft plans to begin real‑world testing at Beth Israel Deaconess in the next few months, but has not set a timeline for commercial rollout. The company frames the work as a step toward its broader “medical superintelligence” vision.
Microsoft says its AI tool is better than doctors at diagnosing conditions
The Verge AI · 22 October 2026
Loading the full article…
This text was published by The Verge AI and written by Robert Hart. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- AAIF adds four new agent projects from Anthropic, OpenAI, Alibaba · 3 src
- OpenAI patches monitoring gaps after red team finds agent oversight holes · 2 src
- Amazon Polly adds 14 generative voices and Hindi, Finnish support · 1 src
- Google CEO says Gemini agents will be integrated into Search through an agentic layer · 3 src
- Amazon Quick is HIPAA‑eligible for AI workloads in healthcare · 1 src
Comments
via GitHub Discussions