{"version":1,"type":"story","url":"https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g","json":"https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g.json","markdown":"https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g.md","slug":"model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g","headline":"Model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp","summary":"The model has 78B parameters with 3.46B active per token, featuring 50 layers and 384 routed experts plus one shared expert. Its architecture includes attention mechanisms with sliding windows and a 513-token context, alongside GQA with 48 query heads and 4 KV heads. The converter uses existing AfmoeModel layouts and handles FP8 checkpoints without special code adjustments.\n\nThe request references DeepSeek Harness (DeepSeek V4.1 Flash) as an assist but notes the suggestion is invalid due to no code changes. The pull request is part of the ggml-org/llama.cpp repository and includes technical details like tensor naming and pre-tokenizer registration.","keyPoints":["Pull request proposes Kolibri-1 support for llama.cpp, a German/English MoE model with 78B parameters","Model uses 3.46B active parameters per token, 50 layers, and 384 routed experts with sliding attention","Converter reuses AfmoeModel and handles FP8 checkpoints without special code, but suggestion lacks code changes"],"whyItMatters":"Adding Kolibri-1 support could expand llama.cpp’s multilingual MoE model capabilities, benefiting developers working with German/English reasoning tasks.","category":{"slug":"models","name":"Generative AI & Models","url":"https://digestai.news/category/models"},"entities":{"companies":[],"models":["Kolibri-1","DeepSeek V4.1 Flash"],"people":[]},"firstPublishedAt":"2026-10-17T11:07:59Z","updatedAt":"2026-10-17T11:07:59Z","sourceCount":1,"hasPrimarySource":true,"sources":[{"outlet":"github.com","title":"model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp","url":"https://github.com/ggml-org/llama.cpp/pull/30673","publishedAt":"2026-10-17T11:07:59Z","type":"primary","primary":true,"lead":true}],"sourceNotes":null,"discussions":[{"site":"Reddit","url":"https://www.reddit.com/r/LocalLLaMA/comments/1x87kgj/model_add_kolibri1_alephalpha_support_by_riteme/","points":null}],"thread":null,"cite":{"text":"Digest AI, \"Model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp\", 17 October 2026, https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g","publisher":"Digest AI","title":"Model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp","datePublished":"2026-10-17T11:07:59Z","url":"https://digestai.news/story/model-add-kolibri-1-aleph-alpha-support-by-riteme-pull-request-30673-g"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}