# Model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp

Digest AI · Generative AI & Models · published 2026-10-17T11:07:59Z

Canonical: https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g

## Summary

The model has 78B parameters with 3.46B active per token, featuring 50 layers and 384 routed experts plus one shared expert. Its architecture includes attention mechanisms with sliding windows and a 513-token context, alongside GQA with 48 query heads and 4 KV heads. The converter uses existing AfmoeModel layouts and handles FP8 checkpoints without special code adjustments.

The request references DeepSeek Harness (DeepSeek V4.1 Flash) as an assist but notes the suggestion is invalid due to no code changes. The pull request is part of the ggml-org/llama.cpp repository and includes technical details like tensor naming and pre-tokenizer registration.

## Key points

- Pull request proposes Kolibri-1 support for llama.cpp, a German/English MoE model with 78B parameters
- Model uses 3.46B active parameters per token, 50 layers, and 384 routed experts with sliding attention
- Converter reuses AfmoeModel and handles FP8 checkpoints without special code, but suggestion lacks code changes

## Why it matters

Adding Kolibri-1 support could expand llama.cpp’s multilingual MoE model capabilities, benefiting developers working with German/English reasoning tasks.

## Sources

1. [model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp/pull/30673) (github.com, 2026-10-17, primary source)

## Cite

Digest AI, "Model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp", 17 October 2026, https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g.json