Oossa

llama.cpp adds new Q8_0 and i8mm kernels for Apple and Linux

The open‑source LLaMA inference library now includes faster quantized kernels for ARM SVE and i8mm, plus new binaries for macOS, iOS and Ubuntu.

NoteBy Published by Oossa: 1 min read

The llama.cpp project released version b11811 on Oct 22 2026. The update adds Q8_0 SVE dot‑product GEMV and SVE i8mm GEMM kernels, which speed up quantized model inference on ARM CPUs. Pre‑built binaries for macOS Apple Silicon, Intel, iOS, and several Ubuntu builds (CPU, Vulkan, CUDA 12.8) are now available for download.

Why it matters

Developers can run LLaMA models faster on newer ARM hardware and on Linux GPUs without writing custom code.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.