ModernBERT news
The latest ModernBERT news, : Researchers release LAMB, a Latin language model trained on 74B tokens.
2 stories mentioning ModernBERT since 19 September 2026, newest first, each with its sources and discussion. Follow to see new ones on your front page.
-
Researchers release LAMB, a Latin language model trained on 74B tokens
It uses the ModernBERT architecture and was pretrained in two phases on over 74 billion Latin tokens, with a novel masking method informed by morphology. The model was developed alongside two new Latin datasets:…
1 source primary sourcearXiv cs.CL -
Linkup Research releases sparseup 149M-parameter sparse embedding model
Linkup Research announced SPARSEUP, an open‑source sparse embedding model built on a 149 million‑parameter ModernBERT backbone. The model is released under the Apache 2.0 license on Hugging Face and can be loaded via…
1 sourceMarkTechPost
Questions about ModernBERT
What is the latest ModernBERT news?
As of 26 October 2026: Researchers release LAMB, a Latin language model trained on 74B tokens. It uses the ModernBERT architecture and was pretrained in two phases on over 74 billion Latin tokens, with a novel masking method informed by morphology.