DeepSeek announced that it is open‑sourcing DeepInfer, the inference engine that runs its DeepSeek‑V4.1‑Flash model in production. The framework is released under the Apache 2.0 license. It is built for NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs and supports only offline inference.
Why it matters
Developers can now use DeepSeek’s production‑grade inference code on supported hardware without building their own stack.