
The Inference Shift
Stratechery
00:00
NVIDIA's response and Dynamo
Ben Thompson describes NVIDIA's Dynamo inference framework and their move to disaggregate memory and CPU racks.
Play episode from 10:46
Transcript

Ben Thompson describes NVIDIA's Dynamo inference framework and their move to disaggregate memory and CPU racks.