The ggml‑org team published llama.cpp version b11713 on Oct 17, 2026. The update improves CUDA performance for low‑bit types by using a faster MMVQ algorithm. It also adds a small fix for HIP (AMD) GPUs on Q3_K and Q6_K quantizations. Pre‑built binaries for macOS, iOS, and several Ubuntu targets (CPU, Vulkan, CUDA) are now available for download.
Why it matters
Developers can run quantized LLMs on NVIDIA GPUs more quickly, lowering inference costs for local AI applications.