MachGen AI cuts video generation time by 6x with diffusion-focused infrastructure
MachGen AI, co-founded by Kismat Singh and Manoj Krishnan, specializes in optimizing inference and fine-tuning stacks for diffusion models—unlike existing infrastructure built for large language models. Singh, who previously led AI software at Intel and worked on PyTorch at Meta, argues that diffusion models require fundamentally different optimizations due to their compute-bound,…
Key points
- MachGen AI cuts video generation latency by up to 6x and inference costs by 2–3x for diffusion models
- Trusted TV reduced commercial creation time from minutes to under 25 seconds using MachGen’s infrastructure
- Singh predicts fast, cheap generation will enable personalized ads and interactive video experiences
The impact extends beyond benchmarks. Trusted TV, a platform for small businesses creating broadcast-ready commercials, adopted MachGen after seeing latency improvements. Before, generating a commercial took minutes; now, it’s done in under 25 seconds at scale. Singh envisions this speed enabling geography- and audience-level personalization—like ads tailored to local landmarks—previously only feasible for large budgets. For companies embedding generative video, optimizing GPU utilization becomes strategic when costs rise with usage or latency degrades user experience. MachGen’s approach combines custom GPU kernels, caching, precision optimization, and parallelism, targeting layers like attention (a major compute bottleneck) and spatial/temporal redundancy in video models. While hardware improvements help, Singh insists specialized software—like MachGen’s—is needed to reach production-scale performance.
Kismat Singh, Co-Founder and CEO of MachGen AI
Unite.AI · 29 September 2026
Loading the full article…
This text was published by Unite.AI. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Hardware & Compute
All →- Google to launch first Project Suncatcher satellite with TPUs on SpaceX Transporter-18 in October · 16 src
- Meta brings Muse agent to AI glasses, launches VR and audio models · 32 src
- OpenAI VP details Jalapeño ASIC’s AI-assisted design and efficiency focus · 3 src
- Googlebook OS to arrive on select newer Chromebooks, details pending · 1 src
- Meta invests C$13B in Alberta data center to boost AI infrastructure · 1 src
Comments
via GitHub Discussions