# The Kaitchup releases statistically-lossless Qwen3.8-27B GGUF models

Digest AI · Generative AI & Models · published 2026-10-27T18:52:27Z

Canonical: https://digestai.news/story/the-kaitchup-releases-statistically-lossless-qwen3-8-27b-gguf-models

## Summary

The Kaitchup published three quantized versions of the Qwen3.8‑27B large language model using a customized Statistically‑Lossless Quantization (SLQ) method and packaged them as GGUF files. The three releases target Expected Acceptance Rates (EAR) of 98 %, 98.5 % and 99 % measured on the BF16 reference’s top‑10 tokens, and differ in precision choices such as Q4\K/Q8\0 for EAR 98 and Q6\K/BF16 for EAR 99. Each file keeps 351,008,768 bytes of quantized MTP tensors from the UD‑Q5\K\XL donor, excludes vision tensors, and is licensed under Apache 2.0.

Validation was performed with a llama.cpp build on an NVIDIA GH200 GPU (commit 45451c366d4256f94fbc8845645e31a6b9155054), confirming native text scoring and GGUF parity, though image/video inference and speculative decoding were not covered. The releases have not been benchmarked for downstream task performance, and statistical equivalence remains unproven. The models can be downloaded via the Hugging Face CLI, and a simple OpenAI‑compatible server command is provided. The files saw 239 downloads in the last month, and the author invites users to support the work.

## Key points

- The Kaitchup released three Qwen3.8‑27B GGUF models quantized with SLQ, targeting EAR 98 %, 98.5 % and 99 %.
- Models use Q4/K, Q5/K, Q6/K precision combos and retain 351,008,768 bytes of quantized MTP tensors; no vision tensors included.
- Validation on an NVIDIA GH200 with llama.cpp confirmed text parity; downstream task equivalence not yet established; 239 downloads last month.

## Why it matters

High‑fidelity, low‑size quantized models let developers run a 27B LLM on modest hardware, expanding open‑source AI accessibility.

## Sources

1. [Statistically Lossless Qwen3.8 27B GGUFs](https://huggingface.co/kaitchup/Qwen3.8-27B-SLQ-GGUF) (huggingface.co, 2026-10-27, primary source)

Part of the developing story: [AtomicChat's Quantized Model Rollout Saga](https://digestai.news/thread/atomicchat-releases-quantized-ling-3-1-flash-models-with-8688-token-accuracy) (3 stories)

## Cite

Digest AI, "The Kaitchup releases statistically-lossless Qwen3.8-27B GGUF models", 27 October 2026, https://digestai.news/story/the-kaitchup-releases-statistically-lossless-qwen3-8-27b-gguf-models

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/the-kaitchup-releases-statistically-lossless-qwen3-8-27b-gguf-models.json