Jailbroken PS5 runs Qwen3.8-27B model at 20 tokens per second
A Reddit user named u/AdIllustrious7246 forked PS5LM, a port of llama.cpp for the PS5, to run AI models locally. Their version leverages the PS5’s GPU via PS5\[Vulkan\), bypassing the console’s locked-down graphics driver. This allows models like Qwen3.8-27B to run at 20 tokens per second, compared to previous CPU-only versions that froze the system due to memory limits.
Key points
- u/AdIllustrious7246’s fork runs Qwen3.8-27B model at **20 tokens per second** on PS5 GPU
- Previous CPU-only version limited to **6 GiB** RAM, now supports **11.4 GiB** with GPU acceleration
- Web UI and dashboard added for remote access and performance monitoring
The previous unofficial port by GitHub user cobanov ran on the CPU with 6 GiB of RAM, but u/AdIllustrious7246’s fork uses the GPU and supports up to 11.4 GiB of RAM. Smaller models like Gemma 4 E4B and Llama 3.2 3B achieve 61 and 124 tokens per second, respectively. The fork also includes a dashboard for monitoring performance and a web UI for remote chat. Critics warn of GPU demand risks, but the PS5’s hardware limits make mass adoption unlikely.
Jailbroken PS5s can now run local AI models at over 100+ tokens per second
Tom's Hardware · 16 October 2026
Loading the full article…
This text was published by Tom's Hardware and written by Jhet Borja. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Hardware & Compute
All →- Nvidia CEO says AI will transform every industry · 1 src
- Taiwan plans up to $4B Texas industrial park for AI hardware suppliers · 1 src
- Nvidia, AMD, Micron drop premarket as AI financing fears rise · 4 src
- Apple delays Apple Intelligence launch in China to December 2026 · 2 src
- Liteon unveils 800 VDC power tech for NVIDIA’s AI infrastructure at OCP summit · 1 src
Comments
via GitHub Discussions