The ggml‑org team published llama.cpp version b11685. It adds a SYCL optimisation called wide stores for the q4_K and q5_K weight dequantisation. The release includes pre‑built binaries for macOS Apple Silicon, macOS Intel, iOS, and several Ubuntu builds (CPU, Vulkan and CUDA 12.8). The change is aimed at speeding up quantised model inference on SYCL‑compatible GPUs.
Why it matters
Developers can run quantized LLMs faster on SYCL GPUs, expanding cheap hardware options for AI apps.