OossaAI is evolving fast. We explain it simply.

DeepSeek releases DeepEP-Ascend library for Huawei NPU communication

DeepSeek open‑sources a high‑performance communication library that speeds up MoE training on Ascend NPUs, with early benchmarks showing up to 95% bandwidth utilization.

NoteOossa1 min read

DeepSeek has published a new GitHub repo called DeepEP-Ascend. It provides a communication library for training and inference on Huawei Ascend NPUs, supporting expert‑parallel all‑to‑all, pipeline parallelism and remote memory access. The library matches the NVIDIA DeepEP API and can be installed with a pip command. Early tests on Ascend 950DT show dispatch bandwidth close to the hardware limit for expert‑parallel sizes up to 32.

Why it matters

It lets developers use Huawei’s Ascend chips for large‑scale mixture‑of‑experts models with near‑hardware communication speeds.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.

Sources & references

#SourceOutletDateKey takeaway
1New repository deepseek-ai/DeepEP-Ascend: A high-performance communication library for machine learning training and inference on Huawei Ascend NPUs. ↗DeepSeekSep 30, 2026A high-performance communication library for machine learning training and inference on Huawei Ascend NPUs.

1 sources

Last updated: ·Markdown·llms.txt