Instrumental Convergence and Practical Constraints

Multiple live callers join this month's Q&A as we react to Bernie Sanders and AOC's data center moratorium, the sudden shutdown of SORA 2, and the record breaking "Stop the AI Race" protest.

I explain why Claude Code has me claiming a 700% productivity boost, what that means for takeoff timelines and debate instrumental convergence.

Timestamps

00:00:00 — Cold Open

00:01:08 — Can AI Train on Its Own Data to Reach Superintelligence?

00:03:42 — Are We in the Takeoff? 700% Faster with Claude Code

00:04:27 — EJJ Joins: Is Instrumental Convergence Really That Dangerous?

00:16:44 — The Positive Feedback Loop Problem

00:20:09 — S-Risk, Consciousness, and Objective Morality

00:22:27 — Futarchy and Prediction Markets

00:24:31 — Low P(Doom) Arguments and Bayesian Updates

00:31:05 — Lee Cyrano Joins: Superintelligence Won’t Matter for Decades

01:02:45 — Lesaun Joins: Are There Adults in the Room?

01:17:39 — Connor Leahy: “There Are No Adults in the Room”

01:19:51 — Bernie Sanders Calls for a Data Center Moratorium

01:24:23 — Claude Code Anecdotes and Audience Q&A

01:35:49 — The Stop the AI Race Protest in San Francisco

01:41:38 — Known Unknowns and Risk Assessment

01:45:03 — From Waymo to Existential Risk

01:51:28 — Closing: The Road to One Million Subscribers

Links

Quintin Pope vs Liron Shapira debate on Doom Debates — https://lironshapira.substack.com/p/ai-alignment-is-solved-phd-researcher

CAP theorem, Wikipedia — https://en.wikipedia.org/wiki/CAP_theorem

Google Cloud Spanner, Wikipedia — https://en.wikipedia.org/wiki/Spanner_(database)

Newcomb’s problem, Wikipedia — https://en.wikipedia.org/wiki/Newcomb%27s_paradox

Gödel’s incompleteness theorems, Wikipedia — https://en.wikipedia.org/wiki/G%C3%B6del%27s_incompleteness_theorems

Doom Debates’ Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.

Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates, or to really take things to the next level: Donate 🙏