NInfer Studio: Desktop App for Local LLM Inference with GPU Presets
NInfer Studio is a new cross‑platform desktop shell built with Tauri 2 that turns the ninfer‑serve inference engine into a user‑friendly application. It offers per‑GPU presets, Hugging Face model downloads, live token and throughput metrics, and a vision‑enabled chat interface.
Key points
- NInfer Studio bundles ninfer‑serve with GPU presets and vision chat
- Includes an agentic coding harness that plans and executes file operations
- Provides VRAM safety floor and context‑limit warnings for stable inference
The app also includes an agentic coding harness that lets the model plan, edit files, and run shell commands, all while tracking resource usage and providing safety checks such as a VRAM floor and context‑limit warnings. Users can manage models, start and stop the engine, and persist settings across sessions.
Developers can build the app from source with Rust and Node, and the project ships installers for Linux and Windows. The release notes highlight security hardening, a hardened localhost API, and support for multiple operating systems.
Ninfer Studio - oh look another harness
github.com · 11 September 2026Loading the full article…
This text was published by github.com. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Generative AI & Models
All →- Google launches Gemini 4 Argon model globally for Pro and Ultra subscribers with introductory API pricing · 32 src
- Meta releases Muse Spark Open, an 816B-parameter open-weight multimodal model with 42B active parameters and 1M-token context · 20 src
- Microsoft AI chief says in-house model beats OpenAI's using quarter of compute · 1 src
- NVIDIA releases Nemotron 3.5 Super VL and Bolt edge models for enterprise agents · 8 src
- Black Forest Labs releases FLUX 3 Image Klein, a 5.6B-Parameter Open-Weights model for text-to-image generation · 3 src
Comments
via GitHub Discussions