{"version":1,"type":"story","url":"https://digestai.news/story/intel-releases-llm-scaler-vllm-pv-1-5","json":"https://digestai.news/story/intel-releases-llm-scaler-vllm-pv-1-5.json","markdown":"https://digestai.news/story/intel-releases-llm-scaler-vllm-pv-1-5.md","slug":"intel-releases-llm-scaler-vllm-pv-1-5","headline":"Intel releases LLM-Scaler-vLLM PV 1.5","summary":"Intel software engineers released LLM-Scaler-vLLM PV 1.5, a Docker stack that runs large‑language models on Intel Arc Graphics. It also adds support for several Qwen and Gemma models, including Qwen3.6‑27B, Qwen3.8‑27B, Qwen3.6‑35B‑A3B, gemma‑4‑26B‑A4B‑it and gemma‑4‑31B‑it.\n\nNew quantization options—online FP8 and symmetric INT4—are now available, along with FP8 KV cache support. The stack delivers faster time‑to‑first‑token for Qwen and Gemma 4 models, improved MTP decoding, and better LoRA serving performance. Bug fixes round out the release, which can be downloaded from the project’s GitHub repository. The work is part of Intel’s Project Battlematrix and precedes the upcoming Crescent Island Intel GPU D Series.","keyPoints":["Intel upgrades vLLM from 0.14 to 0.26 in LLM-Scaler-vLLM PV 1.5.","New Qwen and Gemma models added, plus FP8/INT4 quantization and faster token times."],"whyItMatters":"Intel’s update brings higher‑level vLLM and PyTorch support to Arc GPUs, expanding model compatibility and improving inference speed. The new quantization options and faster token times help developers deploy large‑language models more efficiently on Intel hardware, potentially lowering costs and expanding AI adoption in edge and cloud environments.","category":{"slug":"enterprise","name":"Enterprise & Industry","url":"https://digestai.news/category/enterprise"},"entities":{"companies":["Intel"],"models":["vLLM","PyTorch","Qwen3.6-27B","Qwen3.8-27B","Qwen3.6-35B-A3B","gemma-4-26B-A4B-it"],"people":[]},"firstPublishedAt":"2026-10-16T20:16:18Z","updatedAt":"2026-10-16T20:16:18Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"phoronix.com","title":"Intel LLM-Scaler-vLLM PV 1.5 brings big improvements","url":"https://phoronix.com/news/Intel-LLM-Scaler-vLLM-PV-1.5","publishedAt":"2026-10-16T20:16:18Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[{"site":"Reddit","url":"https://www.reddit.com/r/LocalLLaMA/comments/1x7qsh8/intel_llmscalervllm_pv_15_brings_big_improvements/","points":null}],"thread":null,"cite":{"text":"Digest AI, \"Intel releases LLM-Scaler-vLLM PV 1.5\", 16 October 2026, https://digestai.news/story/intel-releases-llm-scaler-vllm-pv-1-5","publisher":"Digest AI","title":"Intel releases LLM-Scaler-vLLM PV 1.5","datePublished":"2026-10-16T20:16:18Z","url":"https://digestai.news/story/intel-releases-llm-scaler-vllm-pv-1-5"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}