AgentionAI releases Qwen3.8-Flash-Next-Gyro-Coder for 24 GB GPUs
AgentionAI has published Qwen3.8-Flash-Next-Gyro-Coder, a quantized version of the Qwen3.8-Flash-Next model designed to run on a single consumer GPU with 24 GB of memory, such as an RTX 3090, 4090, or 7900 XTX. The model utilizes a mixture-of-experts architecture, retaining only the 256 experts out of 512 that are relevant for programming tasks. This selective pruning, combined with a custom…
Key points
- Runs on 24 GB GPUs like RTX 3090 using 19.9 GiB of memory.
- Retains 256 of 512 experts selected via evolutionary search for coding.
- Passes 13 of 16 coding tests; 93% top-1 agreement on Python.
The model achieves 93% top-1 agreement with the full model on held-out Python data and passed 13 of 16 coding tests in the author's evaluation. A larger variant, Gyro-Coder-L, is available for 32 GB cards, using 27.5 GiB of memory and passing 15 of 16 tests. The release includes instructions for running the model via a custom llama.cpp Docker build, supporting both NVIDIA and AMD/Intel GPUs. The file size is 70.6 GiB on disk due to an n-gram table stored on NVMe storage.
AgentionAI notes that the model is best suited for clear, well-specified coding instructions like implementing or refactoring code, rather than open-ended general knowledge queries. The project is currently experimental, with potential changes to file formats and kernels expected in future updates.
The story so far
6 episodes →- AgentionAI releases Qwen3.8-Flash-Next-Gyro-Coder for 24 GB GPUsthis story
agentionai/Qwen3.8-Flash-Next-Gyro-Coder-GGUF · Hugging Face
huggingface.co · 23 October 2026
Loading the full article…
This text was published by huggingface.co. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Generative AI & Models
All →- Apiiro finds 1,122 public GitHub files with secrets saved by Claude Code · 1 src
- Thinking Machines releases Inkling 2 Small, a 594B MoE model with 17B active parameters · 8 src
- OpenAI releases GPT-6 Cyber, a Critical-rated model that outperforms predecessors in vulnerability detection and alignment · 25 src
- Google releases Gemini Omni 1.2 Flash with 15-second video generation and 30% price cut to $0.07 per second · 10 src
- US accuses Chinese executive of allegedly sharing Nvidia chip info with Beijing · 11 src
Comments
via GitHub Discussions