Oossa

llama.cpp vb12329 adds CUDA weight‑scale fusion and new binaries

The open‑source LLM runtime releases version b12329 with CUDA optimizations and pre‑built binaries for macOS, iOS and Linux.

NoteBy Published by Oossa: 1 min read

The ggml‑org team released llama.cpp version b12329. It adds a CUDA optimisation that fuses weight‑scale handling into matrix‑multiply writes, speeding up nvfp4 checkpoints. The update also includes new pre‑built binaries for Apple Silicon, Intel macOS, iOS and several Linux flavours. The changes are available for download from the GitHub release page.

Why it matters

Developers can run Llama models faster on NVIDIA GPUs and get ready‑to‑run binaries for more platforms.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.