The ggml-org team released llama.cpp b12094 on November 4, 2026, with a faster top-k sampling path for its Hexagon backend. Top-k sampling selects among the highest-scoring options when generating text.
The change targets k values from 2 to 64 and rows wider than 1,024 entries. It skips sorting blocks that cannot contain a top result, but the release gives no measured speedup.
Why it matters
People running llama.cpp on supported Hexagon hardware get a more efficient sampling method for these workloads, though the release does not quantify any real-world speed gain.
