Oossa

DeepSeek releases DeepInfer inference framework as open source

DeepSeek has made its DeepInfer framework, used for the DeepSeek‑V4.1‑Flash model, available under an Apache 2.0 license.

NoteBy Published by Oossa: Last updated: 1 min read

DeepSeek announced that it is open‑sourcing DeepInfer, the inference engine that runs its DeepSeek‑V4.1‑Flash model in production. The framework is released under the Apache 2.0 license. It is built for NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs and supports only offline inference.

Why it matters

Developers can now use DeepSeek’s production‑grade inference code on supported hardware without building their own stack.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.