Oossa

Hugging Face releases TorchTPU for native PyTorch on Google Cloud TPUs

The new TorchTPU package lets PyTorch code run directly on Google Cloud TPUs, removing the need for torch_xla or Optimum TPU.

NoteBy Published by Oossa: Last updated: 1 min read

Hugging Face announced TorchTPU, a native PyTorch backend that treats TPUs like any other device. Install it with a single pip command and you can load Transformers or Diffusers models on a TPU by setting device_map="tpu". The package includes TPU‑tuned Pallas kernels, distributed training support, and torch.compile integration for extra speed. Optimum TPU is no longer required for Hugging Face models on TPUs.

Why it matters

PyTorch developers can now use Google Cloud TPUs without extra frameworks, simplifying large‑scale training and inference.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.