Oossa

llama.cpp adds OpenCL DP4A kernels for quantized models

The open‑source LLaMA inference library now includes cooperative‑k DP4A GEMM support for q4_0, q4_k and q6_k formats.

NoteBy Published by Oossa: 1 min read

The ggml‑org/llama.cpp project released version b11741 on 2026‑10‑19. It adds new OpenCL kernels that use DP4A instructions to speed up matrix multiplications for three quantized formats (q4_0, q4_k, q6_k). The update also fixes an alignment issue and bundles pre‑built binaries for macOS (Apple Silicon and Intel) and several Ubuntu targets, including Vulkan builds.

Why it matters

Developers can run LLaMA models faster on OpenCL‑compatible GPUs, making local inference more practical.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.