The open‑source llama.cpp library released a new version on 2026‑10‑18 that adds non‑contiguous SUM support. The change works on CPU, CUDA, Vulkan and WebGPU back‑ends, and the test suite now includes cases for these views. The update also expands the list of pre‑built binaries for macOS, Linux, Android and Windows, covering many hardware combos such as Apple Silicon, Intel, AMD, NVIDIA CUDA 12/13 and Snapdragon NPU. The project’s website and attestations are linked for download.
Why it matters
Developers can now run faster, memory‑efficient summations on a wider range of devices, improving performance of LLM inference pipelines.
