Inference by Turing Post

When Will We Give AI True Memory? A conversation with Edo Liberty, CEO and founder @ Pinecone

May 19, 2025
Edo Liberty, founder and CEO of Pinecone, and former Amazon scientist, dives into the fascinating world of AI memory. He discusses the critical distinction between cognitive skills and knowledge, and the limitations of current retrieval-augmented generation models. Edo predicts that within two years, handling massive volumes of documents will be standard for AI. He emphasizes the importance of storage over compute power and raises important questions about the societal implications of accurate knowledge representation in AI. His insights reveal a world where AI could truly remember what matters.
Ask episode
AI Snips
Chapters
Books
Transcript
Episode notes
ADVICE

Train Query Understanding Models

  • Treat query understanding as a modelled task that plans what context to fetch.
  • Use iterative retrieval until the agent has enough information to decide.
ANECDOTE

Founding A New Category

  • Edo recalled launching Pinecone before the ChatGPT boom when few understood vector DBs.
  • He says competition matured the category and pushed rapid innovation and optimization.
INSIGHT

Workload Evolution Demands New Architecture

  • Vector workloads evolved from heavy compute to massive, storage-bound datasets with many small indices.
  • Effective systems must dynamically choose indexing strategies per usage and scale pattern.
Get the Snipd Podcast app to discover more snips from this episode
Get the app