DigestAI news desk

Cut through the AI noise.

Research

modded-nanoRT leaderboard sets new speed record for Relational Transformers

modded-nanoRT is a new leaderboard for relational transformers that measures wall‑clock time to reach a quality target. The benchmark uses a 45‑minute learning curve and ranks six candidates. The recipe reaches the target in 305.63 seconds on one NVIDIA H200, 8.11x faster than the reference implementation, and wins 13 of 15 pairs outside the development database.

1 source primary source

Key points

  • modded‑nanoRT ranks relational transformer models by wall‑clock time to a quality target
  • the recipe reaches the target in 305.63 seconds on one NVIDIA H200, 8.11x faster than reference
  • it wins 13 of 15 pairs outside the development database

The leaderboard is open and uses typed trilinear attention, Muon and SIGReg. The authors will release the benchmark, its frozen artifacts and record runs. The code is available at https://github.com/kunumi/nanoRT.

Read the original at arXiv cs.AI · by Gabriel Wedson Mendon\c{c}a de Souza Veloso, Luan Borges Teodoro Reis Sena, Denis Oliveira Correa, Francisco Galuppo Azevedo primary sourceOpen source ↗
Topics · follow one to build your own front page
Relational Transformers

The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.

Comments

via GitHub Discussions

More in Research

All →

Related stories