# AtomicChat releases quantized GGUF files for Nanbeige4.3-33B

Digest AI · Generative AI & Models · published 2026-10-25T21:33:29Z

Canonical: https://digestai.news/story/atomicchat-releases-quantized-gguf-files-for-nanbeige4-3-33b

## Summary

AtomicChat has released quantized GGUF versions of Nanbeige's 33B dense agent and reasoning model, Nanbeige4.3-33B. Built on release day, 25 October, these files are derived from the original BF16 weights and are available under the Apache-2.0 license. The model features a Llama architecture with a 512K context window and has thinking enabled by default.

The release includes both standard llama.cpp presets (Q80, Q6K, Q5KM, Q4KM) and custom "Atomic Dynamic" (AD) files that use a specific importance matrix to preserve quality. According to AtomicChat's measurements, Nanbeige4.3-33B is unusually sensitive to quantization; standard Q6K files only match the original model's next-token predictions 95.5% of the time, whereas the AD-Q6K-Q5K file reduces KL divergence by 39% compared to the standard Q6K.

Users can run these models via llama-server or Atomic Chat. The article notes that files below 4 bits (such as AD-IQ3XXS) suffer significant performance drops, with top-1 accuracy falling below 85%. For optimal results, AtomicChat recommends specific sampling parameters: temperature 0.6 and top-p 0.95 for reasoning and chat, or temperature 1.0 and top-p 0.95 for agentic tasks.

## Key points

- AtomicChat released quantized GGUF files for Nanbeige4.3-33B on 25 October.
- Custom AD files show significantly lower KL divergence than standard llama.cpp presets.
- The model is sensitive to quantization, with standard Q6K achieving only 95.5% top-1 accuracy.

## Why it matters

These quantized files allow developers to run a high-performance 33B reasoning model on local hardware with limited VRAM, offering a practical alternative to cloud-based inference for agentic applications.

## Sources

1. [Nanbeige4.3-33B Quantised GGUF](https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF) (huggingface.co, 2026-10-25, primary source)

Part of the developing story: [AtomicChat's Quantized Model Rollout Saga](https://digestai.news/thread/atomicchat-releases-quantized-ling-3-1-flash-models-with-8688-token-accuracy) (2 stories)

## Cite

Digest AI, "AtomicChat releases quantized GGUF files for Nanbeige4.3-33B", 25 October 2026, https://digestai.news/story/atomicchat-releases-quantized-gguf-files-for-nanbeige4-3-33b

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/atomicchat-releases-quantized-gguf-files-for-nanbeige4-3-33b.json