Oossa

Liquid AI releases 24B LFM2.5 model in MLX 6‑bit format on Hugging Face

The 24‑billion‑parameter LFM2.5 model is now available in a 6‑bit MLX version, runnable with mlx‑lm 0.32.0 or later.

NoteBy Published by Oossa: 1 min read

Liquid AI posted a new version of its LFM2.5‑24B‑A2B model on Hugging Face. The model is converted to MLX format and quantized to 6 bits per weight, keeping the MoE routing gates in full‑precision. It can be loaded with mlx‑lm 0.32.0 or newer; older versions load the model but route experts incorrectly. The model uses a ChatML‑like chat template and supports function calling.

Why it matters

Developers can run a large reasoning model faster on‑device, especially on Apple Silicon machines.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.