Training vs Inference Use Cases

Graphics processing units (GPUs) have become the most important commodity in the AI boom — and have made Nvidia a multi-trillion dollar company. But the tensor processing unit (TPU) could present itself as competition for the GPU.

TPUs are developed by Google specifically for AI workloads. And so far, Anthropic, OpenAI and Meta have reportedly made deals for Google’s TPUs.

Christopher Miller, historian at Tufts University and author of "Chip War: The Fight for the World's Most Critical Technology," explains what this could mean.