Oh My Pi updates Custom model configurations for version 18.2.7 and later
Recent updates to the Oh My Pi (omp) assistant tool require users to modify their custom model configurations in models.yml for version 18.2.7 and later. Users must rename custom providers from "local" to a unique name to avoid conflicts with omp's new built-in local provider for on-device models. Additionally, users running Qwen 3.8 models must add qwenTemplateReasoningEffort: true to the…
Key points
- Users must rename custom local providers to avoid conflicts with the new built-in local provider in omp 18.2.7.
- Qwen 3.8 configurations require the qwenTemplateReasoningEffort parameter to prevent thinking effort from defaulting to maximum.
- An allowlist in config.yml can restrict omp to local models and prevent accidental fallbacks to paid hosted APIs.
The update also affects how omp handles inference servers like vLLM, llama.cpp, LM Studio, Ollama, and SGLang. To prevent omp from falling back to hosted models when local servers fail, users can implement an allowlist using the enabledModels setting in config.yml. A Python logging script can be used to debug and inspect the exact request payloads omp sends to these custom backends.
Model page: Claude Opus 5.5 →
Custom Models in Oh My Pi: vLLM, llama.cpp, SGLang and More
doug.sh · 23 September 2026
Loading the full article…
This text was published by doug.sh and written by Doug Calobrisi. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- ChatGPT desktop app adds Appshots feature to read off-screen text · 1 src
- Google launches Intelligent Endpoints to make Chrome an AI execution platform · 1 src
- ChatGPT, Gemini and Claude offer personalization settings · 2 src
- OpenRouter reaches 10 trillion tokens daily as Stripe acquisition completes · 1 src
- Meta’s Muse integrates Spotify for dynamic playlists tied to daily routines · 1 src
Comments
via GitHub Discussions