Microsoft Foundry Local runs Qwen3.8-27B locally with GitHub Copilot on Nvidia GPUs
Microsoft released Foundry Local CLI 0.13.0, which runs the Qwen3.8-27B model on Nvidia GPUs and connects it to GitHub Copilot via Bring Your Own Key. The 4-bit quantized model needs about 18 GB VRAM, so it fits on consumer cards with 24 GB or more. On a GeForce RTX 5090 with 32 GB VRAM, Foundry Local showed higher token generation speed than llama.cpp at every prompt length tested, with the gap…
Key points
- Foundry Local CLI 0.13.0 runs Qwen3.8-27B locally and plugs into GitHub Copilot BYOK
- 4-bit model needs ~18 GB VRAM; 24 GB cards support 64K context, 32 GB cards support 262K
- Microsoft benchmarks show faster generation than llama.cpp on RTX 5090, especially past 131K tokens
Bring Agentic Coding On-Device with Foundry Local
devblogs.microsoft.com · 6 November 2026
Loading the full article…
This text was published by devblogs.microsoft.com and written by Baiju Meswani. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- OpenAI 'dots' verified for planning automation; SBI Securities to offer Anthropic IPO applications · 1 src
- Meta's Muse composes song and produces vertical lyric video · 1 src
- OpenAI, Meta and xAI launch AI agents for long-term task delegation · 5 src
- Meta launches AI fashion app Style Sketch in Indonesia, Singapore and Thailand · 1 src
- Perplexity adds live web searches to Decisions API for real-time answers · 2 src
Comments
via GitHub Discussions