DigestAI news desk

Cut through the AI noise.

Generative AI & Modelsupdated 21 min read

Aleph Alpha releases Kolibri-1 with 1M-token context and tool calling

Aleph Alpha introduced Kolibri-1, a mixture-of-experts model optimized for German and English, on October 3, 2026. The model supports explicit reasoning modes, tool calling, and long-context processing up to 1,048,576 tokens (1M) in principle, though Aleph Alpha recommends contexts of 262,144 tokens for efficiency. It uses a tokenizer tailored to German morphology and a sliding-window positional…

2 sources primary source HN 122

Key points

  • Kolibri-1 supports **1M-token context** in principle, with recommended use at **262,144 tokens** for efficiency
  • Model trained on **20T tokens** pre-training, **3.44T tokens** mid-training, and **201B tokens** long-context adaptation
  • Optimized for German/English with **UniBPE tokenizer**, tool calling, and explicit reasoning modes for agentic workflows

Kolibri-1 was trained in three phases: pre-training on 16,384-token sequences, mid-training on 65,536-token sequences, and a final long-context phase on 262,144 tokens. The model’s training consumed an estimated 9.5×10² MWh (950 MWh) across all phases, excluding fine-tuning and RL stages. It is designed for integration into conversational assistants, agentic workflows, and document-processing systems where human review is required. Aleph Alpha emphasizes its use for advisory roles, not autonomous decision-making, and includes safeguards against harmful outputs aligned with the EU AI Act. The model weights are released under the Apache 2.0 license, though Aleph Alpha retains rights to architecture, training methods, and intellectual property.

Model pages: Kolibri-1 → · Gemma 4 26B A4B →

The story so far

5 episodes →
  1. Aleph Alpha releases Kolibri-1 with 1M-token context and tool callingthis story
Full story from huggingface.co · via Reddit AI communities primary sourceOpen source ↗

Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context

huggingface.co · 3 October 2026

Loading the full article…

This text was published by huggingface.co. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗

Coverage and discussion

2sources
Topics · follow one to build your own front page
Aleph AlphaAleph Alpha GmbHKolibri-1Kolibri BaseKolibri Origin BaseGemma-4-26B-A4BMistral-NeMo-12BQwen3-32B

The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.

Comments

via GitHub Discussions

More in Generative AI & Models

All →

Related stories