Doom Debates! Emmett Shear (OpenAI Ex-Interim-CEO)'s New “Softmax” AI Alignment Plan — Is It Legit?
26 snips
Jun 24, 2025 
Emmett Shear, cofounder and former CEO of Twitch, dives deep into his new AI alignment venture, Softmax. He introduces the concept of 'organic alignment,' comparing AI growth to biological systems nurtured within communities. The dialogue explores the evolution of morality, discussing how kin selection influences AI's ethical development. Emmett critiques traditional methods while advocating for cooperation in multi-agent reinforcement learning, emphasizing storytelling's impact on AI behavior and urging a cautious approach towards superintelligence.
AI Snips
Chapters
Transcript
Episode notes
Morality As Evolutionary Module
- Human morality likely evolved as hardwired cognitive modules shaped by evolutionary pressures, not from a mysterious inner light.
- Moral instincts function as evolutionary adaptations to promote group cooperation and fairness.
Use Multi-Agent Simulations
- Multi-agent reinforcement learning is needed to train agents to align and cooperate within populations.
- Observing agent interactions helps evaluate whether agents are aligned with each other and with the group.
Alignment Is Always Symmetric
- Alignment is symmetric; if two agents are aligned to the same goal, they are aligned with each other.
- True alignment involves mutual care, not one-sided control or manipulation.