The a16z Show

How Foundation Models Evolved: A PhD Journey Through AI's Breakthrough Era

410 snips
Jan 16, 2026
In this engaging discussion, Omar Khattab, an Assistant Professor at MIT and creator of DSPy, unveils how he unintentionally established a new framework for making large language models programmable. He critiques the conventional obsession with AGI and emphasizes the importance of building systems that bridge the gap between user intent and AI capabilities. Omar articulates the need for a middle layer between natural language and code, illustrating how DSPy captures intent through its innovative abstraction of signatures, enhancing the reliability of AI systems.
Ask episode
AI Snips
Chapters
Books
Transcript
Episode notes
ANECDOTE

PhD Timing Aligned With Foundation Models

  • Omar described starting his PhD in 2019 just as foundation models began to emerge.
  • He focused on how to actually use those models to build systems and applications during his PhD.
INSIGHT

Systems, Not Just Bigger Models

  • The frontier labs accept that scaling alone won't solve application needs and are building post-training pipelines.
  • Omar argues we need systems (with retrieval, tool use, agent training) not just bigger models.
INSIGHT

We Want Programmable Intelligence, Not Vague AGI

  • People don't want general raw intelligence; they want reliable, interpretable systems that encode taste and constraints.
  • Khattab reframes the goal as building programmable intelligence (API) rather than chasing vague AGI.
Get the Snipd Podcast app to discover more snips from this episode
Get the app