# TorchNeuron Space lists which Hub models run unmodified on AWS Trainium

Digest AI · Generative AI & Models · published 2026-10-23T00:00:00Z

Canonical: https://digestai.news/story/torchneuron-space-lists-which-hub-models-run-unmodified-on-aws-trainiu

## Summary

A new Space called torch-neuronx model support lets users check whether any model on the Hub can run unmodified on AWS Trainium. The interface shows results for the most downloaded and trending models, indicating if the model passes, how many Trainium cores it is sharded over, wall‑time including compilation, and peak device memory. Users can switch between Selected, Trending or Downloads views and type part of a model name to look it up.

At the time of writing the Space only tests Transformers models for text‑generation and image‑text‑to‑text tasks, and limits testing to models that fit on four Trainium2 devices – a maximum of 16 cores. Tests run on a trn2 instance in the AWS Neuron Deep Learning Container, compile the model with torch.compile(backend="neuron"), and generate 32 tokens for validation. The Space also provides the exact Neuron stack versions, required packages and the run.py script used, plus commands to reuse compiled graphs from the public NEFF cache bucket.

## Key points

- Space shows pass/fail, core count, wall‑time and memory for each Hub model on Trainium
- Only Transformers models for text‑generation and image‑text‑to‑text are tested, up to 4 Trainium2 devices (16 cores)
- Run script compiles with torch.compile(backend="neuron") and generates 32 tokens for validation

## Why it matters

Developers can quickly verify if popular models will run on AWS Trainium, saving time on trial‑and‑error and optimizing deployment costs.

## Sources

1. [Does Your Model Run on AWS Trainium? Look It Up](https://huggingface.co/blog/torch-neuronx-model-support) (Hugging Face, 2026-10-23, primary source)

Part of the developing story: [Amazon Builds Custom AI Silicon Ecosystem](https://digestai.news/thread/amazon-plans-to-sell-8-billion-of-nvidia-chips-to-investors) (5 stories)

## Cite

Digest AI, "TorchNeuron Space lists which Hub models run unmodified on AWS Trainium", 23 October 2026, https://digestai.news/story/torchneuron-space-lists-which-hub-models-run-unmodified-on-aws-trainiu

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/torchneuron-space-lists-which-hub-models-run-unmodified-on-aws-trainiu.json