Hugging Face announced TorchTPU, a native PyTorch backend that treats TPUs like any other device. Install it with a single pip command and you can load Transformers or Diffusers models on a TPU by setting device_map="tpu". The package includes TPU‑tuned Pallas kernels, distributed training support, and torch.compile integration for extra speed. Optimum TPU is no longer required for Hugging Face models on TPUs.
Why it matters
PyTorch developers can now use Google Cloud TPUs without extra frameworks, simplifying large‑scale training and inference.