Oossa

llama.cpp adds hexagon tensor repacking and new quantization support

The Oct 16 2026 release (b11680) refactors hexagon support, adds tiled Q5_K get‑rows and raw k‑quant tensors, and expands hardware back‑ends.

NoteBy Published by Oossa: 1 min read

The open‑source llama.cpp library released version b11680 on Oct 16 2026. The update overhauls the Hexagon NPU code: it removes a hack, adds tensor repacking for F16/F32/BF16 weights, and supports tiled Q5_K get‑rows and raw k‑quant tensors. The changes also clean up many internal kernels and improve performance on several back‑ends, including CPU, CUDA, Vulkan and Hexagon‑enabled devices. The project lists builds for macOS, Linux, Android, Windows and several openEuler configurations.

Why it matters

Developers can now run llama.cpp models more efficiently on Hexagon‑powered phones and other specialized hardware.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.