The Inference Shift
Stratechery
00:00
Tradeoffs: speed versus capacity for agents
Ben Thompson argues agents can tolerate latency when unattended, favoring cheaper, larger memory hierarchies over peak speed.
Play episode from 08:39
Transcript
Ben Thompson argues agents can tolerate latency when unattended, favoring cheaper, larger memory hierarchies over peak speed.
