Artificial Analysis releases smartphone inference ranking showing model scores drop under one-minute cutoff
Artificial Analysis published its 'Smartphone Inference Ranking' on August 24, 2026, evaluating small AI models on iPhone 17 Pro and Galaxy S26 Ultra devices. The ranking, developed with Liquid AI, measures intelligence via multiple benchmarks and speed/memory using llama.cpp and GGUF-format models. On iPhone 17 Pro, Nanbeige4.2-3B and LFM2.5-2.6B tied for first at 63 points, but under a…
Key points
- Nanbeige4.2-3B and LFM2.5-2.6B tied at 63 points on iPhone 17 Pro under standard conditions
- Under one-minute cutoff, Nanbeige4.2-3B fell to 18 points, LFM2.5-8B-A1B led with 47 points
- Speed metrics measure 256-token output, not full inference which can exceed 16K tokens
An AI with a score of 63 drops to 18 in one minute—Reading Artificial Analysis's 'Smartphone Inference Ranking' from primary sources|アイドリ | AI-Driven Lab
note.com · 28 September 2026
Loading the full article…
This text was published by note.com and written by アイドリ | AI-Driven Lab. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Research
All →- Anthropic's Claude begins 'dreaming' to reorganize memory in tests · 1 src
- John Langford quits Microsoft, declares AI Frontiers over · 1 src
- Anthropic releases study on Claude usage in scientific research · 3 src
- MIT and BASF release CheMeleon for low-data molecular prediction · 2 src
- Anthropic tests Claude agents in EVE Online trading and sabotage detection · 1 src
Comments
via GitHub Discussions