Piotr Wilkin adds int8 coopmat1 matmul implementation for AMD RDNA3 and RDNA4
Piotr Wilkin committed a new int8 coopmat1 matmul implementation for AMD RDNA3 and RDNA4 in the llama.cpp repository. The change adds a quantized matmul shader that supports multiple quantization formats such as IQ4XS, q80, q41, q50, q51, q3k, q4k, q5k, q6k, and nvfp4, and introduces performance improvements and bug fixes for RDNA4 tuning. The commit is co‑authored by OpenAI Codex and Claude…
Key points
- Piotr Wilkin commits int8 coopmat1 matmul for AMD RDNA3/4
- Adds support for IQ4XS, q80, q41, q50, q51, q3k, q4k, q5k, q6k, nvfp4
- Fixes segfaults and improves RDNA4 performance
The update targets AMD GPUs, enabling more efficient integer matrix multiplication for large‑language‑model inference. It also adds support for the new BKSTEP parameter, double buffering, and work‑group scheduling optimizations. The commit notes a 1M context size for the Claude Opus 5 model, indicating its relevance for large‑context inference workloads.
vulkan: int8 coopmat1 matmul implementation for AMD RDNA3 and RDNA4 (... · ggml-org/llama.cpp@70c4e15
github.com · 24 September 2026Loading the full article…
This text was published by github.com. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Hardware & Compute
All →- Meta launches Ray‑Ban Meta Audio glasses and expands AI glasses lineup · 23 src
- PicoJool raises $27.5M Series A to scale optical VCSEL links for AI data centers · 2 src
- Meta CEO Mark Zuckerberg unveils Muse Charm wearable for Muse AI agent at Connect event · 17 src
- Google launches first Suncatcher satellite to test AI chips in orbit · 5 src
- Microsoft removes Copilot+ PC label from new Surface devices · 2 src
Comments
via GitHub Discussions