IFM releases K2-Horizon-7B-Uno diffusion-augmented LLM, claims 5200 tps speedup
The Institute of Foundation Models (IFM) has posted a new 7‑billion‑parameter language model, K2‑Horizon‑7B‑Uno, on Hugging Face. The model adds a diffusion pathway to the existing K2‑Horizon‑7B architecture via LoRA‑based adapters, promising the same generation quality while running at roughly 5,200 tokens per second on benchmark tests. The repository contains only the adapters; the base‑model…
Key points
- K2‑Horizon‑7B‑Uno adds LoRA diffusion adapters to a 7B LLM, claiming 5,200 tps with unchanged quality.
- Model and adapters are hosted on Hugging Face; base weights are separate under IFM/K2‑Horizon‑7B.
- 46,557 downloads in the last month indicate strong early community interest.
Developers can load the model with PEFT by wrapping the base model in a PeftModel object, and the project provides example notebooks for Google Colab and Kaggle. Selected evaluation scripts are available, with a full benchmark suite slated for release later. The model has already attracted attention, recording 46,547 downloads in the past month. The authors ask users to cite the accompanying paper and project page when using the model.
If the performance claims hold, K2‑Horizon‑7B‑Uno could offer a practical route to faster inference for applications that need high‑throughput text generation without sacrificing quality, especially for developers already using PEFT‑based fine‑tuning pipelines.
The story so far
2 episodes →- IFM releases K2-Horizon-7B-Uno diffusion-augmented LLM, claims 5200 tps speedupthis story
IFM/K2-Horizon-7B-Uno · Hugging Face - 5200tps with no quality loss
huggingface.co · 11 September 2026
K2 Horizon
Collection
K2 Horizon models, datasets, and supporting resources • 22 items • Updated • 129
- Libraries
- PEFT How to use IFM/K2-Horizon-7B-Uno with PEFT: ``` from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("IFM/K2-Horizon-7B") model = PeftModel.from_pretrained(base_model, "IFM/K2-Horizon-7B-Uno")
- Notebooks
- Google Colab
- Kaggle
**Paper:** Unlocking Lossless Speedups in LLMs via Discrete Diffusion**Project Page:** https://s-sahoo.github.io/uno/**Code:** https://github.com/ifm-ai/uno
We present `K2-Horizon-7B-Uno`, a diffusion-augmented LLM with two pathways in a unified architecture:
- The AR pathway uses the AR weights of the K2-Horizon-7B model.
- The diffusion pathway augments these weights with LoRA-based diffusion adapters.
This repository contains the adapter only. The base-model weights are hosted separately in **IFM/K2-Horizon-7B**.
Selected evaluation scripts are available in **scripts/k2_horizon**. The full evaluation suite will be released soon.
The main number is the benchmark score and the subscript is TPF. Bold marks the
best score in each row. `--` and `N/A` denote unavailable results.
If you find this model useful, please cite:
@misc{k2_horizon_7b_uno, title = {K2-Horizon-7B-Uno}, author = {Institute of Foundation Models}, year = {2026}, howpublished = {\url{https://huggingface.co/IFM/K2-Horizon-7B-Uno}}, }
- Downloads last month
- 46,547
This text was published by huggingface.co. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us.
More in Generative AI & Models
All →- PrismML hopes its tiny LLM will change how we all use AI · 1 src
- OpenAI launches Astra for Law, a GPT-6 Astra variant with legal search and Trusted Access · 2 src
- OpenAI’s GPT‑6 Astra 99.9% ARC‑AGI‑3 score may reflect benchmark harness, not AGI · 1 src
- Anthropic's Invisible Text Watermarking in Claude AI · 4 src
- OpenAI's GPT-6 Astra: Revolutionizing Work and Research · 22 src
Comments
via GitHub Discussions