llama.cpp news
The latest llama.cpp news, : Bartowski releases Xing4.0-29B-A4B quantized models for llama.cpp.
13 stories mentioning llama.cpp since 23 September 2026, newest first, each with its sources and discussion. Follow to see new ones on your front page.
-
Bartowski releases Xing4.0-29B-A4B quantized models for llama.cpp
A user named bartowski has shared quantized versions of the Xing4.0-29B-A4B model on Hugging Face, optimized for llama.cpp with speculative decoding and imatrix calibration. The original model has 31 billion parameters…
1 source primary sourcehuggingface.co -
Llama.cpp adds support for xing4_0 model
A pull request merged into the llama.cpp repository on November 3, 2026, added support for the xing40 model. The change was co-authored by Sigbjørn Skjæret of Hugging Face and reviewed internally by maintainers. The…
1 source primary sourcegithub.com -
Mistral releases Mistral Large 4 (Le Chonk) 1-trillion-parameter multimodal model on Hugging Face
Mistral AI released the weights of Mistral Large 4, nicknamed Le Chonk, a 1-trillion-parameter multimodal mixture-of-experts model, on Hugging Face on October 29, 2026. The model accepts text and image inputs,…
12 sources primary source HN 115note.comLatent SpaceThe DecoderUnite.AI +7 more -
Ggml-org adds Clover model support to llama.cpp
The open-source project llama.cpp now supports the Clover model, announced via a pull request merged on October 28, 2026. The update includes GGUF conversion, model loading, and causal hybrid attention, reusing…
1 source primary sourcegithub.com -
Llama.cpp PR adds DeepSeek-V4.1-Flash support with review fixes
A pull request for the llama.cpp repository introduces support for the DeepSeek-V4.1-Flash model architecture, including its specific KV-cache extensions, vision components, and DSpark draft mechanisms. The…
1 source primary sourcegithub.com -
XHToken releases Spark-X2.6-4B, a 4B on-device language model
XHToken posted Spark-X2.6-4B on Hugging Face, a compact 4B‑parameter model designed for on‑device deployment. It builds on the Spark‑X2.5-4B architecture and gains capability through improved post‑training. The release…
1 source primary sourcehuggingface.co -
Hugging Face launches Llama Windows for local AI on Windows 11
Hugging Face released Llama Windows, a free, open-source desktop app for Windows 11 that simplifies running local AI models without technical setup. The tool integrates with the llama.cpp library, letting users…
1 sourcethurrott.com -
AWS shows how to deploy decision models with llama.cpp on SageMaker AI
AWS published a tutorial on deploying decision models using llama.cpp on Amazon SageMaker AI. The post demonstrates two deployment paths from the same GGUF model: a standard text-generation path serving…
1 source primary sourceAWS Machine Learning Blog -
Llama.cpp adds MTP decoding for Qwen4Exp and GLM-5.3-Flash hybrid model
llama.cpp version 0.6.0 introduces MTP (Mixture of Token Predictors) speculative decoding for the Qwen4Exp model, claiming a ~1.5x speedup on DGX Spark hardware. The update also adds support for the GLM-5.3-Flash…
2 sources primary sourcegithub.com -
Llama.cpp adds decision models for routing and scoring tasks
Llama.cpp now supports decision models that assign probabilities to predefined options in a single forward pass, unlike chat models that generate text. These models can route customer messages, moderate content, or…
1 source primary sourcehuggingface.co -
Llama.cpp adds GLM-5.3-Flash support in commit 649dcb1
The open-source project llama.cpp integrated support for the GLM-5.3-Flash model, also called GLM5-Next, in commit 649dcb1. The update includes optimizations for long-context decoding, memory pooling, and fixes for…
1 source primary sourcegithub.com -
[For 780M] Vulkan inference 12.9% faster: MMVQ tuning for AMD 780M/Strix in llama.cpp, Q4_0 ROCmFP4 models arriving one after another
By setting load‑mode to auto, the build now skips memory‑mapped I/O on iGPUs, preventing the model from being loaded twice and halving usable memory. New ROCmFP4 quantized models for Strix/Halo are appearing on…
1 sourcenote.com -
Open-source panel lets users run llama.cpp, stable-diffusion.cpp and audio.cpp locally
A community‑maintained control panel provides a single‑page web UI for running local AI inference on a personal GPU box. It supports llama.cpp for text and vision chat, stable-diffusion.cpp for image generation, and…
1 source primary sourcegithub.com
Questions about llama.cpp
What is the latest llama.cpp news?
As of 6 November 2026: Bartowski releases Xing4.0-29B-A4B quantized models for llama.cpp. A user named bartowski has shared quantized versions of the Xing4.0-29B-A4B model on Hugging Face, optimized for llama.cpp with speculative decoding and imatrix calibration.