Google may be testing Gemini 4 Pro checkpoints, rumor says
Rumors are circulating that a set of checkpoints labeled “gemini-3.8-flash” has appeared on the LMSYS Arena platform, and some testers claim the model can output up to 256K tokens, generate precise SVG code and even build a 3‑D voxel scene. The same leaked data is said to have achieved a 2,064 Elo score on the GDPval‑AA v2 benchmark, apparently surpassing OpenAI’s upcoming GPT‑6 Astra and…
Key points
- Leaked checkpoints labeled “gemini-3.8-flash” appeared on the Arena platform, showing 256K token outputs and 2,064 Elo on GDPval‑AA v2
- Benchmark tables claim the model outperforms GPT‑6 Astra and Claude Fable, but figures are inconsistent and unverified by Google or Arena
- Analysts say the leak is probably an early test; an official Gemini 4 Pro announcement is expected between October and year‑end
The analysis points out three reasons to treat the numbers cautiously: the demos shown on X are cherry‑picked examples, the circulating benchmark tables contain inconsistent reference values and do not match any official Arena leaderboard, and Google DeepMind has not confirmed the results. The article also highlights Google’s ongoing work on Recursive Self‑Improvement (RSI) pipelines, which could enable autonomous data generation and longer‑context reasoning.
Overall, the author concludes the checkpoints are likely early internal tests, but an official Gemini 4 Pro announcement or API preview is expected sometime between October and year‑end. Readers are advised to wait for a formal paper and verified scores before drawing firm conclusions.
Model pages: Gemini 3.8 Flash → · GPT-6 Astra →
[Urgent Analysis] Has Gemini 4 Pro Descended onto the Arena? The Truth Behind the "gemini-3.8-flash" Fake Leak and the Credibility of Surpassing GPT-6 Astra
note.com · 26 September 2026
Loading the full article…
This text was published by note.com and written by pisuke. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Generative AI & Models
All →- Apiiro finds 1,122 public GitHub files with secrets saved by Claude Code · 1 src
- Thinking Machines releases Inkling 2 Small, a 594B MoE model with 17B active parameters · 8 src
- OpenAI releases GPT-6 Cyber, a Critical-rated model that outperforms predecessors in vulnerability detection and alignment · 25 src
- Google releases Gemini Omni 1.2 Flash with 15-second video generation and 30% price cut to $0.07 per second · 10 src
- US accuses Chinese executive of allegedly sharing Nvidia chip info with Beijing · 11 src
Comments
via GitHub Discussions