Emad Mostaque helped kick off the modern AI revolution as the head of Stability AI, the company behind Stable Diffusion. Unlike most AI CEOs, he doesn't sugarcoat the risks of AGI development.
He explains his 50% P(Doom), why we have less than 1,000 days to get our act together, and how his new startup, Intelligent Internet, aims to be a countervailing force against doom of all kinds.
Timestamps
00:00:00 — Cold Open
00:00:39 — Introducing Emad Mostaque
00:02:08 — How Emad Got Involved in AI Development
00:05:46 — The 60-Second Pitch for Intelligent Internet
00:09:29 — What’s Your P(Doom)?™
00:13:32 — Why ASI Doesn’t Need Massive Compute
00:15:56 — AGI Timelines: Cognitive Labor Going to Zero
00:17:29 — Is There a Ceiling Above Human Intelligence?
00:41:22 — Corporations as Slow, Dumb AIs
00:50:19 — Emad’s Mainline Doom Scenario
00:55:28 — Jailbreaks and “Mecha-Hitler” Latent Spaces
00:59:56 — The Last Economy: How to Navigate Economic Doom
01:08:57 — The Coming Unemployment Spike
01:15:13 — Why Isn’t Google Stock Mooning?
01:25:05 — Intelligent Internet as a Solution: Bitcoin for the Intelligence Age
01:33:13 — Can an Aligned Network Stop a Rogue ASI?
01:36:20 — Is the Pause AI Proposal Too Late?
01:40:50 — Are We Facing Russian Roulette Odds with AI?
01:42:29 — Wrap-Up
Links
Emad Mostaque, The Last Economy (Amazon) — https://www.amazon.com/Last-Economy-Guide-Intelligent-Economics/dp/103693411X
Intelligent Internet (ii.inc) —https://ii.inc
Emad Mostaque, Wikipedia — https://en.wikipedia.org/wiki/Emad_Mostaque
Emad Mostaque on X — https://x.com/EMostaquePause Giant AI Experiments open letter (Future of Life Institute) — https://futureoflife.org/open-letter/pause-giant-ai-experiments/
Doom Debates’ Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.
Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates, or to really take things to the next level: Donate 🙏
Get full access to Doom Debates at
lironshapira.substack.com/subscribe
