Oossa

llama.cpp adds fused top‑k mask operation in vb11800 release

The open‑source inference library now includes a new fused op for QSA masking, improving performance for certain models.

NoteBy Published by Oossa: 1 min read

The ggml‑org llama.cpp project released version b11800 on 2026-10-21. The update adds a fused top‑k mask operation (ggml_top_k_mask) that can be used by QSA, DSA and DeepSeek V4 CSA models. The op replaces hand‑crafted masking code with a single node that sets non‑selected cells to –inf. It works per‑head and can handle optional scores, block sizes and extra cells.

Why it matters

Developers can run supported models faster because the library now handles masking in one optimized step.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.