Aleph Alpha releases Kolibri-1 with 1M-token context and tool calling
Aleph Alpha introduced Kolibri-1, a mixture-of-experts model optimized for German and English, on October 3, 2026. The model supports explicit reasoning modes, tool calling, and long-context processing up to 1,048,576 tokens (1M) in principle, though Aleph Alpha recommends contexts of 262,144 tokens for efficiency. It uses a tokenizer tailored to German morphology and a sliding-window positional…
Key points
- Kolibri-1 supports **1M-token context** in principle, with recommended use at **262,144 tokens** for efficiency
- Model trained on **20T tokens** pre-training, **3.44T tokens** mid-training, and **201B tokens** long-context adaptation
- Optimized for German/English with **UniBPE tokenizer**, tool calling, and explicit reasoning modes for agentic workflows
Kolibri-1 was trained in three phases: pre-training on 16,384-token sequences, mid-training on 65,536-token sequences, and a final long-context phase on 262,144 tokens. The model’s training consumed an estimated 9.5×10² MWh (950 MWh) across all phases, excluding fine-tuning and RL stages. It is designed for integration into conversational assistants, agentic workflows, and document-processing systems where human review is required. Aleph Alpha emphasizes its use for advisory roles, not autonomous decision-making, and includes safeguards against harmful outputs aligned with the EU AI Act. The model weights are released under the Apache 2.0 license, though Aleph Alpha retains rights to architecture, training methods, and intellectual property.
Model pages: Kolibri-1 → · Gemma 4 26B A4B →
The story so far
5 episodes →- Aleph Alpha releases Kolibri-1 with 1M-token context and tool callingthis story
Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context
huggingface.co · 3 October 2026
Loading the full article…
This text was published by huggingface.co. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
2sources- Hacker News discussion · 122 pointsnews.ycombinator.com
- Reddit discussionreddit.com
- Show HN: Germany's new sovereign AI model KolibriPress · tej.as ·
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Generative AI & Models
All →- Google launches Gemini 4 Argon with 1M token output, claims lead on DeepSWE and cybersecurity benchmarks · 24 src
- Hugging Face releases 207 WebGPU kernels to speed local AI in browsers · 1 src
- OpenAI releases GPT-6 Sol and Luna as two models, fires three employees · 1 src
- Anthropic releases Opus 5.5; OpenAI launches Sol and Luna · 3 src
- Guide explains how to choose and use GPT‑6 models · 1 src
Comments
via GitHub Discussions