Oossa

llama.cpp adds Hexagon SSM_SCAN operation support

The open‑source llama.cpp library now supports the SSM_SCAN op on Qualcomm Hexagon NPU, improving performance on Snapdragon devices.

NoteBy Published by Oossa: 1 min read

The llama.cpp project released a new version that adds support for the SSM_SCAN operation on Qualcomm's Hexagon NPU. The update includes kernel optimizations, DMA pipeline changes, and HMX support. It also expands platform builds, adding CUDA 13 and new Snapdragon CPU‑GPU‑NPU configurations. The change was co‑authored by Max Krasnyansky of Qualcomm.

Why it matters

Developers can run llama.cpp models faster on Snapdragon phones that have Hexagon NPUs.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.