DigestAI news desk

Cut through the AI noise.

Hardware & Compute12 min read

MachGen AI cuts video generation time by 6x with diffusion-focused infrastructure

MachGen AI, co-founded by Kismat Singh and Manoj Krishnan, specializes in optimizing inference and fine-tuning stacks for diffusion models—unlike existing infrastructure built for large language models. Singh, who previously led AI software at Intel and worked on PyTorch at Meta, argues that diffusion models require fundamentally different optimizations due to their compute-bound,…

1 source

Key points

  • MachGen AI cuts video generation latency by up to 6x and inference costs by 2–3x for diffusion models
  • Trusted TV reduced commercial creation time from minutes to under 25 seconds using MachGen’s infrastructure
  • Singh predicts fast, cheap generation will enable personalized ads and interactive video experiences

The impact extends beyond benchmarks. Trusted TV, a platform for small businesses creating broadcast-ready commercials, adopted MachGen after seeing latency improvements. Before, generating a commercial took minutes; now, it’s done in under 25 seconds at scale. Singh envisions this speed enabling geography- and audience-level personalization—like ads tailored to local landmarks—previously only feasible for large budgets. For companies embedding generative video, optimizing GPU utilization becomes strategic when costs rise with usage or latency degrades user experience. MachGen’s approach combines custom GPU kernels, caching, precision optimization, and parallelism, targeting layers like attention (a major compute bottleneck) and spatial/temporal redundancy in video models. While hardware improvements help, Singh insists specialized software—like MachGen’s—is needed to reach production-scale performance.

Full story from Unite.AIOpen source ↗

Kismat Singh, Co-Founder and CEO of MachGen AI

Unite.AI · 29 September 2026

Loading the full article…

This text was published by Unite.AI. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗

Topics · follow one to build your own front page
MachGen AIIntelNVIDIAAMDHPMetaKismat SinghManoj KrishnanIan

The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.

Comments

via GitHub Discussions

More in Hardware & Compute

All →

Related stories