Oossa

NVIDIA releases 4B‑parameter Dory model with 256K token context

The Dory1.0‑4B model, released on Oct 16, 2026, offers looped inference and up to 256 000 token windows, available under an OpenMDW license.

NoteBy Published by Oossa: 1 min read

NVIDIA has added a new large language model called Dory1.0‑4B to Hugging Face. It has 4 billion parameters and can handle contexts up to 256 K tokens. The model uses a looped (latent‑recurrent) architecture that lets users trade compute for accuracy without retraining. It is offered in several formats, including BF16 and 4‑bit NVFP4, and can be used for commercial or non‑commercial projects under the OpenMDW‑1.1 license.

Why it matters

Developers can run a single 4B‑parameter model on varying hardware while still supporting very long prompts, reducing the need for multiple specialized models.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.