# Baidu releases ERNIE 5.5 Flash Base for training with 280B parameters

Digest AI · Research · published 2026-11-05T10:25:04Z

Canonical: https://digestai.news/story/baidu-releases-ernie-5-5-flash-base-for-training-with-280b-parameters

## Summary

Baidu’s ERNIE team released ERNIE 5.5 Flash Base on November 5, 2026, offering downloadable weights for a text-only mixture-of-experts model. The model has 280 billion total parameters and 14 billion activated per token, ending pre-training to serve as a starting point for domain adaptation, instruction tuning, and reinforcement-learning research. It supports 1 million tokens of context and includes a 43-layer architecture with sparse attention mechanisms to reduce computational costs as context grows.

The release also provides a fixed baseline for comparing training methods. Baidu claims speed gains of up to 175% in forward passes and 74% in backward passes over FlashAttention-4 on NVIDIA’s SM100 hardware. Benchmarks against models like DeepSeek-V4-Flash-Base show mixed results, with ERNIE leading in MMLU and HumanEval+ but trailing in FullStackBench and InfiniteBench. The model is licensed under territorial and commercial restrictions, excluding the EU, UK, and South Korea, and requiring prior authorization for commercial use beyond $50 million in annual revenue.

## Key points

- ERNIE 5.5 Flash Base is a 280B-parameter text-only MoE model with 1M-token context support
- Baidu claims 175% speed gains in forward passes on NVIDIA’s SM100 hardware
- License excludes EU, UK, South Korea and restricts commercial use beyond $50M revenue

## Why it matters

This release offers researchers a standardized checkpoint for long-context, efficient training, but its hardware demands and licensing limits practical adoption outside Baidu’s supported regions and revenue thresholds.

## Sources

1. [Baidu Releases ERNIE 5.5 Flash Base for Further Training](https://unite.ai/baidu-releases-ernie-5-5-flash-base-for-further-training) (Unite.AI, 2026-11-05)

## Cite

Digest AI, "Baidu releases ERNIE 5.5 Flash Base for training with 280B parameters", 5 November 2026, https://digestai.news/story/baidu-releases-ernie-5-5-flash-base-for-training-with-280b-parameters

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/baidu-releases-ernie-5-5-flash-base-for-training-with-280b-parameters.json