Multiple live callers join this month's Q&A as I react to Dwarkesh Patel's $20K blog prize, debate the orthogonality thesis from first principles, and welcome Bernie Sanders aboard the Doom Train.

Timestamps

00:00:00 — Cold Open

00:01:00 — Welcome to Doom Debates Live!

00:01:30 — What Do You Think of Open Source Models Out-Benchmarking OpenAI and Anthropic?

00:04:55 — Michael Cheers Joins: What If We Don't Give AIs Full Situational Awareness?

00:11:55 — Thoughts on Mythos' Hacking Abilities?

00:15:43 — Liron Reacts to Dwarkesh Patel's $20K AI Questions

00:23:28 — Pretraining Goals vs RL Training Goals

00:28:58 — Mental Model of Yudkowsky-ians & the IABIED Claim

00:37:24 — You Can't Hide Reality from a Superintelligence (The Truman Show Analogy)

00:42:57 — Back to Dwarkesh's Questions: When Do AI Labs Start Making Money?

00:48:50 — Upcoming Guests Reveal!

00:51:35 — Will Lancer Joins: Is The Yudkowskian Thesis Credible?

01:27:03 — Back to Answering Questions from the Chat

01:33:28 — The Cameraman Always Survives Analogy

01:40:52 — Liron's Banger Response to Roon's Tweet

01:47:00 — Nuance About Pausing AI Development

01:50:57 — Capitalism Isn't Going to Steer Us to an Alignment Solution

01:53:10 — Is Optimization Equivalent to Intelligence?

01:57:21 — BREAKING: Bernie Sanders on the Existential Threat of AI

02:01:12 — Spoiler for the Upcoming Mike Israetel Episode

02:01:57 — $500 Bet on AI Unemployment

02:05:46 — Misuse, Surveillance, and the Real Costs of Pausing AI

02:11:04 — Wrap-Up

Links

Nick Bostrom, Deep Utopia: Life and Meaning in a Solved World (Amazon) — https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642

Yudkowsky & Soares, If Anyone Builds It, Everyone Dies (book) — https://www.amazon.com/If-Anyone-Builds-Everyone-Dies/dp/0316571253

Doom Debates’ Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.

Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates, or to really take things to the next level: Donate 🙏

Get full access to Doom Debates at lironshapira.substack.com/subscribe

#744: Your Face Is Not A Password with Gerald Glickman

TFTC: A Bitcoin Podcast

Ad break

The AI-powered Podcast Player