Breaking the Memory Wall in the Age of Inference
The Data Exchange with Ben Lorica
00:00
Why HBM Suited Training but Not Inference
Sid traces HBM's origins in HPC/training and explains why inference's efficiency demands make HBM suboptimal.
Play episode from 13:47
Transcript
