Breaking the Memory Wall in the Age of Inference
The Data Exchange with Ben Lorica
00:00
DIMC Scale: Cards, Engines, and Model Sizes
Sid gives DIMC 'lego' metrics: engines per card and rack, and running ~100B-parameter models in a rack with SRAM tier.
Play episode from 23:57
Transcript
