# ToshLLM adds AMD GPU Metal support for Intel Macs

Digest AI · Hardware & Compute · published 2026-11-03T05:51:22Z

Canonical: https://digestai.news/story/toshllm-adds-amd-gpu-metal-support-for-intel-macs

## Summary

ToshLLM, a local LLM inference app for Intel Macs with AMD GPUs, now supports Metal acceleration for AMD Polaris (GCN 4) cards like the RX 580. The project, built on patches to `llama.cpp`, claims near-Vulkan performance on an RX 580 running macOS 12, with benchmarks showing a **66.7% speedup in prefill** and **19% in decode** over its previous branch. The app includes features like native chat, agent tools, math and scientific computing, GPU speech transcription, image input, and image generation (beta). It also supports multi-GPU setups, dynamic MoE memory management, and speculative decoding. ToshLLM is still in beta but is described as stable for daily use, with known limitations around external clients and vision cache persistence.

## Key points

- ToshLLM achieves **66.7% faster prefill** and **19% faster decode** on AMD RX 580 via Metal acceleration patches to `llama.cpp`
- Supports **native chat, agent tools, math/science plugins, GPU speech, and image generation** on Intel Macs with AMD GPUs
- Dynamic MoE memory management and multi-GPU support improve performance for large models like Qwen3.6-35B

## Why it matters

ToshLLM bridges a gap for Intel Mac users with AMD GPUs, offering Metal-accelerated LLM inference where Apple Silicon alternatives don’t work. Its optimizations for AMD hardware could expand local AI adoption beyond Apple’s ecosystem, though benchmarks remain limited to a single card and model.

## Sources

1. [RX580(Polaris AMD) on a MAC with near Vulkan performance!](https://github.com/graydini/toshllm) (github.com, 2026-11-03, primary source)

## Cite

Digest AI, "ToshLLM adds AMD GPU Metal support for Intel Macs", 3 November 2026, https://digestai.news/story/toshllm-adds-amd-gpu-metal-support-for-intel-macs

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/toshllm-adds-amd-gpu-metal-support-for-intel-macs.json