Oossa

llama.cpp release adds OpenCL dp4a matrix multiply variants

The open-source llama.cpp library version b11789 adds new OpenCL kernels for faster matrix math and provides fresh binaries for macOS, iOS and Ubuntu.

NoteBy Published by Oossa: 1 min read

The ggml‑org team released llama.cpp version b11789. The update adds dp4a GEMM (matrix‑multiply) variants for OpenCL with vector activation loads, and renames related kernels and environment variables. Pre‑built binaries are now available for Apple Silicon, Intel macOS, iOS, and several Ubuntu builds (CPU, Vulkan, CUDA). The changes are aimed at improving performance on GPUs that support the dp4a instruction.

Why it matters

Developers can run llama.cpp faster on compatible GPUs, reducing inference time for local LLM applications.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.