Prompt caching complexity at Anthropic

When we talk about the cost of AI infrastructure, the focus is usually on Nvidia and GPUs -- but memory is an increasingly important part of the picture.

Learn more about your ad choices. Visit podcastchoices.com/adchoices