ggml-org Merges hc Ops into qwen4exp Graph in llama.cpp
A recent pull request (28901) in the open‑source llama.cpp repository has added new high‑capacity (hc) operations to the qwen4exp graph, targeting both CPU and CUDA backends. The changes fuse a per‑element gate into the hcpre stage and combine an identity operation into hcpost, streamlining the graph’s execution path.
Key points
- Pull request #28901 merges hc pre/post ops into qwen4exp graph for CPU and CUDA.
- Key contributors: feal87, pwilkin, ggerganov.
- Change improves gate fusion and identity combination in llama.cpp.
The merge was approved by key contributors feal87, pwilkin, and ggerganov, and was assisted by the deepseek‑v4‑flash team. While the commit itself is a modest code tweak, it reflects the active community effort to optimize LLM inference pipelines.
These updates may reduce computational overhead and improve throughput for models that rely on the qwen4exp graph, making the open‑source stack more efficient for developers and researchers alike.
qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp
github.com · 16 September 2026qwen4exp: add hc ops - #28901
Merged
Merged
qwen4exp: add hc ops#28901
Conversation
Member
feal87 added a commit to feal87/myllama.cpp that referenced this pull request
Sep 14, 2026
Fuse the per-element gate into hc_pre and the identity comb into hc_post (CPU + CUDA), used by the qwen4exp graph. From ggml-org#28901 Assisted-by: deepseek-v4-flash
Fuse the per-element gate into hc_pre and the identity comb into hc_post (CPU + CUDA), used by the qwen4exp graph. From ggml-org#28901 Assisted-by: deepseek-v4-flash
Member
pwilkinapproved these changes
ggerganovapproved these changes
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This text was published by github.com . It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1 source- Reddit discussion reddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us.
More in Generative AI & Models
All →- OpenAI's GPT-6 Astra Drives Enterprise Spend Ahead of Anthropic · 3 src
- Prior Labs releases TabPFN-3.5, beating 2015 Kaggle winner with default settings · 1 src
- mlabonne releases LFM2.5-230M-Chess, a 230M-parameter chess engine language model · 1 src
- Nums AI launches Causilo, a tabular foundation model that tops TabArena benchmarks · 1 src
- Guardrails Protecting Attackers: Hugging Face Model Incident · 2 src
Comments
via GitHub Discussions