Grit Synthetic Data and the Future of AI | Cohere CEO Aidan Gomez
83 snips
Nov 17, 2025 
Aidan Gomez, co-founder and CEO of Cohere and a key figure behind the 'Attention Is All You Need' paper, dives into the transformation of synthetic data from a niche concept to an essential tool for AI. He discusses the importance of efficiency in model development and how expectations of continuous scaling are being reassessed. Aidan also critiques alarmist narratives around AGI and highlights the substantial enterprise opportunities currently untapped. His insights emphasize the role of AI in boosting productivity and driving economic growth.
AI Snips
Chapters
Transcript
Episode notes
Scaling Gains Are Tapering
- Scaling delivered much longer gains than many expected but is now showing diminishing returns in pre-training.
- Labs are shifting focus to better data, training methods, and targeted capabilities rather than raw scale alone.
Reasoning Unlocked New Tasks
- Reasoning capabilities unlocked new classes of tasks like complex math and debugging.
- Aidan sees reasoning as an obvious and transformative advance for language models' utility.
Memory Is The Next Big Capability
- Current LLMs lack lifelong learning: they don't retain experience across sessions.
- Adding memory and skill distillation from experience is the next major product-level unlock.