Breaking the Memory Wall in the Age of Inference
The Data Exchange with Ben Lorica
00:00
Client Memory and Flash for On-device Models
Sid discusses high-bandwidth flash for client applications and why flash suits local, pre-downloaded models versus data center needs.
Play episode from 39:12
Transcript
