MachGen AI cuts video generation time by 6x with diffusion-focused infrastructure
MachGen AI, co-founded by Kismat Singh and Manoj Krishnan, specializes in optimizing inference and fine-tuning stacks for diffusion models—unlike existing infrastructure built for large language models. Singh, who previously led AI software at Intel and worked on PyTorch at Meta, argues that diffusion models require fundamentally different optimizations due to their compute-bound,…
Key points
- MachGen AI cuts video generation latency by up to 6x and inference costs by 2–3x for diffusion models
- Trusted TV reduced commercial creation time from minutes to under 25 seconds using MachGen’s infrastructure
- Singh predicts fast, cheap generation will enable personalized ads and interactive video experiences
The impact extends beyond benchmarks. Trusted TV, a platform for small businesses creating broadcast-ready commercials, adopted MachGen after seeing latency improvements. Before, generating a commercial took minutes; now, it’s done in under 25 seconds at scale. Singh envisions this speed enabling geography- and audience-level personalization—like ads tailored to local landmarks—previously only feasible for large budgets. For companies embedding generative video, optimizing GPU utilization becomes strategic when costs rise with usage or latency degrades user experience. MachGen’s approach combines custom GPU kernels, caching, precision optimization, and parallelism, targeting layers like attention (a major compute bottleneck) and spatial/temporal redundancy in video models. While hardware improvements help, Singh insists specialized software—like MachGen’s—is needed to reach production-scale performance.
Kismat Singh, Co-Founder and CEO of MachGen AI
Unite.AI · 29 September 2026
Loading the full article…
This text was published by Unite.AI. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Hardware & Compute
All →- Applied Materials and Intel expand AI chipmaking collaboration at epic Center · 1 src
- Xeal to deploy 100,000 Nvidia GPUs in EV charging pods across US · 1 src
- Nokia CEO says data center construction could double without supply constraints · 1 src
- Ghost launches $3,499 AI agent computer with $11M seed · 1 src
- Open-source demo runs Qwen models in browser via WASM and WebGPU · 1 src
Comments
via GitHub Discussions