Oossa

llama.cpp adds new WebGPU quantization formats in b11406 release

The open‑source llama.cpp library now supports several new low‑precision formats on WebGPU, and binaries for macOS, Linux and iOS are available.

NoteBy Published by Oossa: 1 min read

The ggml‑org team released llama.cpp version b11406. It adds WebGPU support for the MMVQ quantization paths Q1_0, Q5_0, Q5_1, Q3_K, Q5_K, Q6_K and MXFP4. The release also provides pre‑built binaries for macOS (Apple Silicon and Intel), iOS, and several Ubuntu builds (CPU, Vulkan and CUDA).

Why it matters

Developers can now run more memory‑efficient LLMs in browsers or on GPUs that use WebGPU, expanding where llama.cpp can be deployed.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.