AI21 Labs switched its shared GPU pool of about 10,000 GPUs on Google Kubernetes Engine from a manual #gpu-resources channel to Kueue, an open‑source job queueing system. Kueue automatically admits, prioritizes and preempts jobs, reducing the need for people to coordinate requests. The change lowered manual intervention rates and the time critical jobs spent without resources. AI21 worked with the Kueue team, prompting new features like Admission Fair Sharing.
Why it matters
For AI researchers at AI21, the automation means less time spent negotiating GPU access and faster starts for important training jobs.
