Oossa

Fireworks AI details speed gains for Kimi K3 reinforcement learning

Fireworks AI reports up to 2.6× faster training and better legal‑task scores for its 2.8‑trillion‑parameter Kimi K3 model.

NoteBy Published by Oossa: 1 min read

Fireworks AI released a technical report on how it speeds up reinforcement learning for its Kimi K3 model, a 2.8 trillion‑parameter system with a 1 million‑token context window. The company describes new kernels and communication tricks that give 1.3–2.6× faster forward and backward passes. Using the same setup, the Kimi‑based legal model Harvey Tenet scored 19.7% all‑pass on the LAB Contracts benchmark, beating the prior best Fable 5’s 11.5%.

Why it matters

The speed improvements let developers iterate on specialized AI policies faster, and the higher legal benchmark score shows the model can handle complex contract analysis better.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.