Artificial Analysis releases Intelligence Index v5 with private datasets
Artificial Analysis has launched version 5 of its Intelligence Index, a composite measure of AI model capabilities. This update marks the first time the majority of the index relies on private datasets, with 60% of evaluations now using private test sets or held-out answers to prevent contamination. The new index introduces two benchmarks: FrontierCode 2.0, a private coding test from Cognition,…
Key points
- Intelligence Index v5 uses 60% private datasets to prevent benchmark contamination.
- Claude Opus 5.5 leads with a score of 58, ahead of GPT-6 Astra at 57.
- Open-weight models trail the leader by 12 points, a gap that widened from 3 points.
Claude Opus 5.5 (max) leads the new index with a score of 58, narrowly ahead of GPT-6 Astra (max) at 57 and GPT-6.1 Sol (max) at 55. Anthropic and OpenAI models occupy the top five positions. The gap between closed and open-weight models has widened significantly; the best open-weight model, Kimi K3.1 Pro, scores 46, trailing the leader by 12 points compared to a 3-point gap in the previous version. Among released open weights, DeepSeek V4.1 Flash 1017 and GLM-5.3 lead at 32.
The update highlights substantial cost variations, with GPT-6.1 Terra being the cheapest at $0.96 per task and Claude Fable 5.1 the most expensive at $13.04. Artificial Analysis also introduced the Progress Index v1, which tracks model capability over time on a continuous scale for models released since November 2022.
Model pages: Claude Opus 5.5 → · GPT-6 Astra → · GPT-6.1 Sol →
The story so far
5 episodes →- Artificial Analysis releases Intelligence Index v5 with private datasetsthis story
Artificial Analysis Intelligence Index v5
artificialanalysis.ai · 28 October 2026
Loading the full article…
This text was published by artificialanalysis.ai and written by Artificial Analysis. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Hacker News discussion · 42 pointsnews.ycombinator.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Research
All →- Analysts followed AI agents' leans 86% of the time in study · 1 src
- DeepSeek’s R1 model with guideline knowledge base improves junior doctors’ arthroplasty decisions · 1 src
- Anthropic says unreleased model built working exploits for Chrome, Safari, Windows, Linux · 1 src
- Google DeepMind releases Genie 4 world model with native audio and Gemini 3.8 Flash guidance · 12 src
- Researchers propose synthetic document finetuning to detect alignment-faking LLMs · 3 src
Comments
via GitHub Discussions