Oossa

llama.cpp b11685 adds SYCL wide stores for q4_K/q5_K dequant

The open‑source LLM runner releases b11685 with a SYCL optimisation for quantized weights and new binaries for macOS, iOS and Linux.

NoteBy Published by Oossa: 1 min read

The ggml‑org team published llama.cpp version b11685. It adds a SYCL optimisation called wide stores for the q4_K and q5_K weight dequantisation. The release includes pre‑built binaries for macOS Apple Silicon, macOS Intel, iOS, and several Ubuntu builds (CPU, Vulkan and CUDA 12.8). The change is aimed at speeding up quantised model inference on SYCL‑compatible GPUs.

Why it matters

Developers can run quantized LLMs faster on SYCL GPUs, expanding cheap hardware options for AI apps.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.