Hugging Face releases TorchNeuron beta for easier Hugging Face models on AWS Trainium
Hugging Face announced that TorchNeuron, a PyTorch plugin adding a native Neuron backend, will enter public beta on Oct. 20, 2026. The plugin can be installed with pip install torch‑neuronx and brings eager execution, torch.compile and native distributed APIs such as FSDP and tensor‑parallelism to AWS Trainium and Inferentia chips. TorchNeuron makes Trainium appear as a regular PyTorch device,…
Key points
- TorchNeuron public beta starts Oct. 20 2026, installable via pip install torch‑neuronx.
- Supports 89% of top 100 text‑generation model architectures, up from 46% with Optimum Neuron v0.4.5.
- Training on 8 Trainium2 chips (32 NeuronCores) completes with standard Transformers checkpoint and works with FLUX.1‑dev, FLUX.2, Qwen‑Image‑2.1, H3.
The release claims 89% coverage of the top 100 most‑used text‑generation model architectures out of the box, compared with 46% for Optimum Neuron v0.4.5. Training scripts run on eight Trainium2 chips (32 NeuronCores) with a 4 × 8 TP/FSDP grid, completing a fine‑tuning job and producing a standard Transformers checkpoint. Several Diffusers pipelines, including FLUX.1‑dev, FLUX.2, Qwen‑Image, Qwen‑Image‑2.1 and H3, are also compatible, and custom Neuron kernels can deliver up to a x2.4 speedup on Trainium.
Model page: Qwen Image 2.1 →
The story so far
4 episodes →- Hugging Face releases TorchNeuron beta for easier Hugging Face models on AWS Trainiumthis story
TorchNeuron: running HF models on AWS Trainium is easier than ever
Hugging Face · 19 October 2026
Loading the full article…
This text was published by Hugging Face and written by Régis Pierrard. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- Amazon releases TorchNeuron to run PyTorch on Trainium chips · 3 src
- Zillow adds Claude connector for listings, tours and financing · 1 src
- Anomaly Innovations says breach affected about 1.4% of OpenCode Console users · 4 src
- Eugenia Kuyda launches wabi 2.0 multiplayer ai assistant for all users · 2 src
- Websites block AI agents from booking, shopping, and banking · 2 src
Comments
via GitHub Discussions