Zhen Li and team released a new technique called TRIAGE on Oct 7 2026. It works inside native NVFP4, a 4‑bit weight‑and‑activation format, to balance policy‑gradient updates during reinforcement learning. The method diagnoses mismatches at the segment level and applies bounded repairs, keeping the low‑precision execution unchanged. Tests on Qwen3‑4B and Qwen3‑30B‑A3B showed stable training and full‑precision quality on five math reasoning benchmarks, while delivering up to 2.3 times faster rollout speed than BF16.
Why it matters
It lets developers train large language models faster with 4‑bit hardware without losing accuracy, saving compute costs.
