The llama.cpp project released a small CUDA update on 2026-10-02. It makes Volta GPUs (sm_70) use the same MMVQ tuning table as Turing GPUs. On a Tesla V100 32 GB the change added roughly 3 % throughput for the Qwen3.8‑27B model. The output quality, measured by perplexity, stayed the same. The patch was contributed by anyei and co‑authors.
Why it matters
Users running llama.cpp on V100 GPUs can run models slightly faster without losing accuracy.