{"version":1,"type":"story","url":"https://digestai.news/story/aleph-alpha-releases-kolibri-a-78b-open-weight-llm-for-german-and-engl","json":"https://digestai.news/story/aleph-alpha-releases-kolibri-a-78b-open-weight-llm-for-german-and-engl.json","markdown":"https://digestai.news/story/aleph-alpha-releases-kolibri-a-78b-open-weight-llm-for-german-and-engl.md","slug":"aleph-alpha-releases-kolibri-a-78b-open-weight-llm-for-german-and-engl","headline":"Aleph Alpha releases Kolibri-1 with 1M-token context and tool calling","summary":"Aleph Alpha introduced **Kolibri-1**, a mixture-of-experts model optimized for German and English, on October 3, 2026. The model supports explicit reasoning modes, tool calling, and long-context processing up to **1,048,576 tokens** (1M) in principle, though Aleph Alpha recommends contexts of **262,144 tokens** for efficiency. It uses a tokenizer tailored to German morphology and a sliding-window positional encoding to handle extended contexts without scaling issues.\n\nKolibri-1 was trained in three phases: pre-training on **16,384-token sequences**, mid-training on **65,536-token sequences**, and a final long-context phase on **262,144 tokens**. The model’s training consumed an estimated **9.5×10² MWh** (950 MWh) across all phases, excluding fine-tuning and RL stages. It is designed for integration into conversational assistants, agentic workflows, and document-processing systems where human review is required. Aleph Alpha emphasizes its use for advisory roles, not autonomous decision-making, and includes safeguards against harmful outputs aligned with the **EU AI Act**. The model weights are released under the **Apache 2.0 license**, though Aleph Alpha retains rights to architecture, training methods, and intellectual property.","keyPoints":["Kolibri-1 supports **1M-token context** in principle, with recommended use at **262,144 tokens** for efficiency","Model trained on **20T tokens** pre-training, **3.44T tokens** mid-training, and **201B tokens** long-context adaptation","Optimized for German/English with **UniBPE tokenizer**, tool calling, and explicit reasoning modes for agentic workflows"],"whyItMatters":"Kolibri-1’s long-context capability and tool-calling features target German/English enterprise use cases like document processing and agentic workflows, filling a niche for non-English AI systems with regulatory compliance safeguards.","category":{"slug":"models","name":"Generative AI & Models","url":"https://digestai.news/category/models"},"entities":{"companies":["Aleph Alpha","Aleph Alpha GmbH"],"models":["Kolibri-1","Kolibri Base","Kolibri Origin Base","Gemma-4-26B-A4B","Mistral-NeMo-12B","Qwen3-32B"],"people":[]},"firstPublishedAt":"2026-10-03T10:43:51Z","updatedAt":"2026-10-03T11:44:42Z","sourceCount":2,"hasPrimarySource":true,"sources":[{"outlet":"huggingface.co","title":"Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context","url":"https://huggingface.co/Aleph-Alpha/Kolibri-1","publishedAt":"2026-10-03T11:44:42Z","type":"primary","primary":true,"lead":true},{"outlet":"tej.as","title":"Show HN: Germany's new sovereign AI model Kolibri","url":"https://tej.as/blog/aleph-alpha-kolibri","publishedAt":"2026-10-03T10:43:51Z","type":"press","primary":false,"lead":false}],"sourceNotes":null,"discussions":[{"site":"Hacker News","url":"https://news.ycombinator.com/item?id=49943034","points":122},{"site":"Reddit","url":"https://www.reddit.com/r/LocalLLaMA/comments/1wwl7y6/alephalphakolibri1_hugging_face_78b_parameters/","points":null}],"thread":{"title":"Open-Source LLM Tools Accelerate Real-World AI","url":"https://digestai.news/thread/openarch-launches-pytorch-repo-for-readable-llm-architecture-implementations","storyCount":5},"cite":{"text":"Digest AI, \"Aleph Alpha releases Kolibri-1 with 1M-token context and tool calling\", 3 October 2026, https://digestai.news/story/aleph-alpha-releases-kolibri-a-78b-open-weight-llm-for-german-and-engl","publisher":"Digest AI","title":"Aleph Alpha releases Kolibri-1 with 1M-token context and tool calling","datePublished":"2026-10-03T10:43:51Z","url":"https://digestai.news/story/aleph-alpha-releases-kolibri-a-78b-open-weight-llm-for-german-and-engl"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}