The llama.cpp project released a new version that adds support for the SSM_SCAN operation on Qualcomm's Hexagon NPU. The update includes kernel optimizations, DMA pipeline changes, and HMX support. It also expands platform builds, adding CUDA 13 and new Snapdragon CPU‑GPU‑NPU configurations. The change was co‑authored by Max Krasnyansky of Qualcomm.
Why it matters
Developers can run llama.cpp models faster on Snapdragon phones that have Hexagon NPUs.