Vercel Labs open-sources agent-desktop for cross-platform computer use
Vercel Labs released agent-desktop, an open-source CLI tool for AI agents to interact with desktop apps on macOS, Windows, and Linux. The tool reads apps via OS accessibility APIs—no screenshots or vision models—and returns JSON snapshots of UI elements with unique refs. Version 1.0.2 launched on October 30, 2026, under the Apache-2.0 license, targeting developers who want to control native apps…
Key points
- Open-source CLI **agent-desktop** lets AI agents control desktop apps via OS accessibility APIs, not screenshots
- Self-reported **78–96% token savings** for apps like Slack or VS Code using skeleton traversal
- Runs on macOS, Windows, Linux (x64/ARM64), headless by default, with Rust CLI or C library support
Vercel Labs Open-Sources agent-desktop for Agent Computer Use
MarkTechPost · 31 October 2026
Loading the full article…
This text was published by MarkTechPost and written by Michal Sutter. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- Andy Jassy says outside shopping agents are not yet great or convenient · 5 src
- Google expands Gemini and Search integrations to third-party apps · 2 src
- KoboldCpp v1.124 adds YuE2 music generation and dozens of TTS models · 1 src
- Google Gemini adds custom skills and external app integration · 1 src
- Anthropic study finds experts follow AI agent's hidden preference 86% of the time · 9 src
Comments
via GitHub Discussions