{"version":1,"type":"story","url":"https://digestai.news/story/github-copilot-public-preview-adds-desktop-screen-control-on-macos-and","json":"https://digestai.news/story/github-copilot-public-preview-adds-desktop-screen-control-on-macos-and.json","markdown":"https://digestai.news/story/github-copilot-public-preview-adds-desktop-screen-control-on-macos-and.md","slug":"github-copilot-public-preview-adds-desktop-screen-control-on-macos-and","headline":"GitHub Copilot public preview adds desktop screen control on macOS and Windows","summary":"GitHub released a public preview of Computer Use for Copilot CLI and the Copilot app on October 1. The feature lets the assistant read screen content and perform clicks, typing, scrolling, and drag operations across macOS and Windows applications, including software that lacks APIs. It is disabled by default and requires user approval per application.\n\nMicrosoft also announced three voice models on October 1: MAI-Transcribe-2-Streaming, MAI-Voice-2.1, and MAI-Voice-2.1-Flash. The streaming transcription returns intermediate results mid-utterance and carries no SLA for the public preview; Microsoft says it is not recommended for production use.\n\nELYZA announced the ELYZA RSI Research organization on October 2, focused on AI-driven AI development. The lab released two models based on LLM-jp-4 but states that recursive self-improvement remains a research target, not an achieved result.","keyPoints":["GitHub Copilot Computer Use public preview operates desktop apps on macOS and Windows","Microsoft streaming transcription returns mid-utterance results with no SLA for preview","ELYZA launches RSI Research org and two LLM-jp-4 models; self-improvement still a research goal"],"whyItMatters":"Screen control expands AI to legacy apps without APIs; voice streaming needs guardrails for production; AI self-improvement research separates claims from verified results.","category":{"slug":"agents","name":"Agents & Tools","url":"https://digestai.news/category/agents"},"entities":{"companies":["GitHub","Microsoft","ELYZA"],"models":["MAI-Transcribe-2-Streaming","MAI-Voice-2.1","MAI-Voice-2.1-Flash"],"people":[]},"firstPublishedAt":"2026-10-03T07:11:00Z","updatedAt":"2026-10-03T07:11:00Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"note.com","title":"GitHub Copilot to Operate PC Screens—Progress in Voice AI and Domestic Autonomous Improvement Research [10/3 AI News]","url":"https://note.com/momochan2062/n/nbe145c8a9b13?hl=en","publishedAt":"2026-10-03T07:11:00Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"GitHub Copilot public preview adds desktop screen control on macOS and Windows\", 3 October 2026, https://digestai.news/story/github-copilot-public-preview-adds-desktop-screen-control-on-macos-and","publisher":"Digest AI","title":"GitHub Copilot public preview adds desktop screen control on macOS and Windows","datePublished":"2026-10-03T07:11:00Z","url":"https://digestai.news/story/github-copilot-public-preview-adds-desktop-screen-control-on-macos-and"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}