Oh My Pi updates Custom model configurations for version 18.2.7 and later
Recent updates to the Oh My Pi (omp) assistant tool require users to modify their custom model configurations in models.yml for version 18.2.7 and later. Users must rename custom providers from "local" to a unique name to avoid conflicts with omp's new built-in local provider for on-device models. Additionally, users running Qwen 3.8 models must add qwenTemplateReasoningEffort: true to the…
Key points
- Users must rename custom local providers to avoid conflicts with the new built-in local provider in omp 18.2.7.
- Qwen 3.8 configurations require the qwenTemplateReasoningEffort parameter to prevent thinking effort from defaulting to maximum.
- An allowlist in config.yml can restrict omp to local models and prevent accidental fallbacks to paid hosted APIs.
The update also affects how omp handles inference servers like vLLM, llama.cpp, LM Studio, Ollama, and SGLang. To prevent omp from falling back to hosted models when local servers fail, users can implement an allowlist using the enabledModels setting in config.yml. A Python logging script can be used to debug and inspect the exact request payloads omp sends to these custom backends.
Model page: Claude Opus 5.5 →
Custom Models in Oh My Pi: vLLM, llama.cpp, SGLang and More
doug.sh · 23 September 2026
Loading the full article…
This text was published by doug.sh and written by Doug Calobrisi. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- Gemini may delete existing text when asked to append, author reports · 1 src
- Google's Gemini outperforms ChatGPT and Claude as Android assistant · 1 src
- Meta launches Muse AI agent in Mexico, first in Latin America · 11 src
- Meta rolls out real-time voice and expressive avatars for Muse AI in the US · 7 src
- Meta improves Muse and Meta AI with Active Memory and Active Focus · 2 src
Comments
via GitHub Discussions