{"version":1,"type":"story","url":"https://digestai.news/story/prismml-releases-ternary-bonsai-2-models-for-local-ai-on-phones-and-we","json":"https://digestai.news/story/prismml-releases-ternary-bonsai-2-models-for-local-ai-on-phones-and-we.json","markdown":"https://digestai.news/story/prismml-releases-ternary-bonsai-2-models-for-local-ai-on-phones-and-we.md","slug":"prismml-releases-ternary-bonsai-2-models-for-local-ai-on-phones-and-we","headline":"PrismML releases Ternary Bonsai 2 models for local AI on phones and wearables","summary":"They join the existing **Bonsai 2 27B** model, expanding options for developers targeting limited-resource devices like smartphones and wearables.\n\nThe new models prioritize practical tasks such as instruction following, tool use, and concise responses. Benchmarking across **19 tests** in six categories—agentic tool use, math, instruction following, coding, knowledge, and reasoning—shows improved performance over their full-precision counterparts. The models support **NVIDIA GPUs** (via **llama.cpp**) and **Apple devices** (via **MLX**), with weights available under **Apache 2.0**.","keyPoints":["PrismML’s **Ternary Bonsai 2** models (2B, 4B, 9B) use ternary weights to cut memory to **0.43GB–2GB**, enabling local AI on phones and wearables"],"whyItMatters":"Smaller, efficient models like these could enable AI assistants on everyday devices without cloud dependency, lowering latency and power use for mobile and wearable applications.","category":{"slug":"agents","name":"Agents & Tools","url":"https://digestai.news/category/agents"},"entities":{"companies":["PrismML","Google","Samsung","NVIDIA","Apple","Snapdragon AR1 Gen 1 Platform"],"models":["Ternary Bonsai 2 2B","Ternary Bonsai 2 4B","Ternary Bonsai 2 9B","Bonsai 2 27B","Qwen3.5 2B","Qwen3.5 4B"],"people":[]},"firstPublishedAt":"2026-10-15T21:45:44Z","updatedAt":"2026-10-15T21:45:44Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"prismml.com","title":"Ternary Bonsai 2 Family: 2B, 4B, & 9B based on Qwen 3.5","url":"https://prismml.com/news/bonsai-2-family","publishedAt":"2026-10-15T21:45:44Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[{"site":"Reddit","url":"https://www.reddit.com/r/LocalLLaMA/comments/1x6yk1f/ternary_bonsai_2_family_2b_4b_9b_based_on_qwen_35/","points":null}],"thread":null,"cite":{"text":"Digest AI, \"PrismML releases Ternary Bonsai 2 models for local AI on phones and wearables\", 15 October 2026, https://digestai.news/story/prismml-releases-ternary-bonsai-2-models-for-local-ai-on-phones-and-we","publisher":"Digest AI","title":"PrismML releases Ternary Bonsai 2 models for local AI on phones and wearables","datePublished":"2026-10-15T21:45:44Z","url":"https://digestai.news/story/prismml-releases-ternary-bonsai-2-models-for-local-ai-on-phones-and-we"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}