# Google releases ML Drift GPU inference engine as open-source

Digest AI · Agents & Tools · published 2026-10-26T02:45:00Z

Canonical: https://digestai.news/story/google-releases-ml-drift-gpu-inference-engine-as-open-source

## Summary

google has released ml drift gpu inference engine as open-source under apache 2.0, infoq reported on october 25 2026. it replaces the tflite gpu delegate, which will no longer receive new features. ml drift offers a production‑proven gpu compute layer that supports 5‑dimensional tensors, a limitation of the legacy delegate.

in production, youtube shorts saw up to 40% lower average frame latency for real‑time visual effects, google photos unblur gained up to 2‑second speedup, adobe lightroom and photoshop reported up to 30% faster on‑device performance, and snap achieved 30% lower model latency. stable diffusion 1.4 peak gpu memory dropped from 4.31 gb to 387 mb, a 93% reduction. ml drift also achieved up to 12% lower memory overhead than llama.cpp and mlx lm on workstation hardware.

the engine is cross‑platform, supporting android, ios, windows, linux, and web via chrome’s built‑in ai apis. it uses a unified shader model built on ucl, co‑optimized with arm, intel, and qualcomm gpus, and includes an agentic coding guide for custom shaders. the release signals that developers can now use a production‑validated gpu inference layer without patent risk, while the legacy tflite gpu delegate will not receive further updates.

## Key points

- google opens source ml drift gpu engine, replacing tflite gpu delegate.
- ml drift cuts youtube shorts frame latency by up to 40%.
- stable diffusion 1.4 peak gpu memory reduced 93% with ml drift.

## Why it matters

ml drift gives developers a production‑validated, cross‑platform gpu inference layer that reduces latency and memory usage, supports 5‑D tensors, and eliminates the need to maintain legacy code. by open‑sourceing the engine, google lowers patent risk and encourages wider adoption, potentially accelerating on‑device ai across mobile, web, and desktop platforms.

## Sources

1. [Google Open-Sources ML Drift: YouTube Shorts Engine Now Available as TFLite GPU Delegate Ends](https://techtimes.com/articles/329472/20261026/google-open-sources-ml-drift-youtube-shorts-engine-now-available-tflite-gpu-delegate-ends.htm) (techtimes.com, 2026-10-26)

Part of the developing story: [AI Inference Revolution From LLM-D to ML Drift](https://digestai.news/thread/ibm-and-red-hat-launch-llm-d-1-0-distributed-inference-stack) (2 stories)

## Cite

Digest AI, "Google releases ML Drift GPU inference engine as open-source", 26 October 2026, https://digestai.news/story/google-releases-ml-drift-gpu-inference-engine-as-open-source

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/google-releases-ml-drift-gpu-inference-engine-as-open-source.json