Oossa

EU consortium trains 1‑trillion‑parameter AI model on public supercomputer

Using PyTorch and TorchTitan, the EUROPA team achieved ~1,300 tokens per second per GPU on 384 NVIDIA GH200 GPUs, proving frontier‑scale training on shared EU infrastructure.

NoteBy Published by Oossa: 1 min read

The EUROPA consortium – Domyn, Fraunhofer IAIS and IIS – trained a mixture‑of‑experts model with about 1 trillion parameters on JUPITER, the EuroHPC exascale supercomputer at Forschungszentrum Jülich. By tuning PyTorch and TorchTitan they raised throughput from 90 to roughly 1,300 tokens per second per GPU across 384 GH200 GPUs (96 nodes). The work shows that public, sovereign compute can support AI at the same scale as private clusters.

Why it matters

It demonstrates that European public compute resources can run frontier‑scale AI, reducing reliance on private cloud rentals.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.