The open‑source Llama inference library now handles BF16 precision in its RMS_NORM operation, with binaries for macOS, iOS and Linux.
NoteBy OossaPublished by Oossa: 1 min read
The ggml‑org team released llama.cpp version b12366 on 2026‑11‑13. The update adds BF16 (a 16‑bit floating‑point format) support to the RMS_NORM layer for both CPU and CUDA back‑ends. A single helper now launches the F32/BF16 RMS_NORM kernels. Pre‑built binaries for macOS Apple Silicon, Intel, iOS, and several Ubuntu variants are available for download.
Developers can run Llama models faster on hardware that prefers BF16, lowering memory use without losing much accuracy.
Models
OpenAI's new ChatGPT Wallet lets its ‘dots’ agents purchase items for U.S. Pro subscribers using tokenized card data.
Models
The AI agent can place phone calls to cable companies, DMVs and restaurants, but many businesses still hang up on the synthetic voice.
Models
The new Gemini 4 Hydrogen model beats the larger Argon on speed, cost and several benchmarks, and is now available to developers and consumers worldwide.
Oossa · Newsletter
The week in AI, explained
Every Monday: the stories worth knowing, in plain language. Free, no spam.
