Artificial Analysis releases smartphone inference ranking showing model scores drop under one-minute cutoff
Artificial Analysis published its 'Smartphone Inference Ranking' on August 24, 2026, evaluating small AI models on iPhone 17 Pro and Galaxy S26 Ultra devices. The ranking, developed with Liquid AI, measures intelligence via multiple benchmarks and speed/memory using llama.cpp and GGUF-format models. On iPhone 17 Pro, Nanbeige4.2-3B and LFM2.5-2.6B tied for first at 63 points, but under a…
Key points
- Nanbeige4.2-3B and LFM2.5-2.6B tied at 63 points on iPhone 17 Pro under standard conditions
- Under one-minute cutoff, Nanbeige4.2-3B fell to 18 points, LFM2.5-8B-A1B led with 47 points
- Speed metrics measure 256-token output, not full inference which can exceed 16K tokens
An AI with a score of 63 drops to 18 in one minute—Reading Artificial Analysis's 'Smartphone Inference Ranking' from primary sources|アイドリ | AI-Driven Lab
note.com · 28 September 2026
Loading the full article…
This text was published by note.com and written by アイドリ | AI-Driven Lab. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Research
All →- Researchers explain why AI models struggle with reversed facts · 1 src
- NASA and IBM release open-source Lunar Foundation Model for moon science · 1 src
- Aleph Alpha study shows Chinese AI models repeat state doctrine · 1 src
- Opinion: AI may aid but not replace human imagination in pure math · 1 src
- Deepmind researchers propose Artificial Symbiotic Intelligence as alternative to singularity · 1 src
Comments
via GitHub Discussions