Microsoft patents AI to edit live speech and faces in real time
Microsoft filed a patent for an AI system that can alter live video in real time, changing both a speaker’s words and facial expressions. The technology, flagged by patent tracker Patentlyze, uses AI agents to identify and replace or remove specific words or phrases based on user-defined parameters or profiles. It also smooths transitions around edits to maintain audio continuity.
Key points
- Microsoft’s patented AI edits live video speech and facial expressions in near real time
- System removes or replaces words based on user-set parameters or profiles, with smooth transitions
- Potential uses include translation, error correction, and filtering offensive language or dialects
The patent outlines potential uses beyond translation, such as removing filler words like ‘um’ or ‘ah,’ correcting speech impediments, or filtering out offensive or insensitive language. Replacements could even be sourced from internet searches. Critics warn this could deepen personalized media bubbles by allowing viewers to adjust content to their preferences. Microsoft did not respond to a request for comment.
Microsoft Patents an AI That Can Literally Put Words in People’s Mouths in Real Time
futurism.com · 1 November 2026
Loading the full article…
This text was published by futurism.com and written by Maggie Harrison Dupré. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Society & Work
All →- OpenAI pays $5,000 bounty for ChatGPT share link code execution bug · 2 src
- Kyle Kingsbury argues LLMs erode trust in software documentation · 1 src
- OpenCode breach exposes OpenAI, Anthropic, Google API keys to unauthorized charges · 1 src
- IEEE Spectrum reports on AI slop challenges to scientific publishing · 1 src
- GitHub flags 9 fake Claude/Codex npm packages · 1 src
Comments
via GitHub Discussions