跳到正文
Rohan Paul· @rohanpaul_ai · X·· 6 天前AI 评分62
AI 导读

Google 开源了 TorchTPU 以替代 PyTorch/XLA,为 TPU 提供原生 PyTorch 后端并支持逐行调试。该工具在训练 Qwen 3 8B 时达到了高达 52% 的 TPU 计算峰值利用率,在生产环境中可切换至 torch.compile 获取运行速度。

正文 · 原文

Google and Amazon now both offer native PyTorch backends that let code leave Nvidia GPUs.

Google just open-sourced TorchTPU that replaces PyTorch/XLA, letting developers debug TPU models step by step.

TorchTPU used up to 52% of peak TPU compute training Qwen 3 8B.

TPUs previously reached PyTorch through PyTorch/XLA, which queued operations for a compiler, so debugging differed from GPU work.

TorchTPU replaces that layer, running each operation as written for debugging, then switching to torch.compile for production speed.

来源:Rohan Paul · x.com