The open‑source LLM runtime releases binaries for macOS, iOS and several Linux builds, improving MoE cache handling so CPU work isn’t stalled.
NoteBy OossaPublished by Oossa: 1 min read
ggml‑org released llama.cpp version b12206. The update fixes the MoE (mixture‑of‑experts) cache so the CPU part no longer waits for cached experts. Pre‑built binaries are now available for Apple Silicon macOS, Intel macOS, iOS, and multiple Ubuntu configurations including x64, arm64, and s390x with Vulkan or zDNN support.
Developers can run LLMs faster on their own machines without the CPU bottleneck introduced by earlier MoE caching.
Models
The model is available through the company’s Tinker service. Thinking Machines says it can handle coding, research and business tasks, and plans to release its weights.
Models
The 65-billion-parameter model is available under Apache 2.0. Ricursive reports a strong coding benchmark score, but results vary across tests.
Models
A North Carolina man alleges ChatGPT helped his wife plan to poison him. OpenAI says it banned her account and shared information with police.
Oossa · Newsletter
The week in AI, explained
Every Monday: the stories worth knowing, in plain language. Free, no spam.
