The ggml‑org team released llama.cpp version b12329. It adds a CUDA optimisation that fuses weight‑scale handling into matrix‑multiply writes, speeding up nvfp4 checkpoints. The update also includes new pre‑built binaries for Apple Silicon, Intel macOS, iOS and several Linux flavours. The changes are available for download from the GitHub release page.
Why it matters
Developers can run Llama models faster on NVIDIA GPUs and get ready‑to‑run binaries for more platforms.