Company Constitutions and Alignment Limits

Dr. Mike Israetel is back in the arena to FIGHT ME (verbally) about the likelihood of AI killing everyone vs. the likelihood of AI making the universe totally awesome!

Back by popular demand after last year’s widely-viewed debate, the renowned exercise scientist, fitness entrepreneur, and low-P(Doom) AI futurist reveals where he gets off the Doom Train™, why he thinks AI is conscious, and how he pictures the coming AI utopia.

Links

Watch Dr. Mike’s AI/futurism YouTube channel —https://www.youtube.com/@mikeisraetelmakingprogress

Dr. Mike on X — https://x.com/misraetel

Make sure to watch Round 1 of our debate from last year — https://www.youtube.com/watch?v=RaDWSPMdM4o

Liron referenced a recent episode, “Steven Byrnes Returns — 90% P(Doom) on the Trajectory to ASI” — https://www.youtube.com/watch?v=oOb9K1KIAyk

Timestamps

00:00:00 — Cold Open

00:00:48 — Returning Champion Dr. Mike Israetel!

00:02:13 — What's Been Your Biggest AI Productivity Gain?

00:03:46 — Can AI Be a Personal Trainer? Dr. Mike Judges Liron's Technique

00:09:41 — Get Good at Taking Advice From AI

00:14:23 — Dr. Mike Israetel, What's Your Latest P(Doom)?™

00:20:12 — Liron's Mainline Scenario: Loss of Control

00:21:39 — Mike's Problems With a Paperclip Maximizer Scenario

00:26:00 — What Will the Goals of a Superintelligence Be?

00:28:49 — AI Labs Have Bit Off More Than They Can Chew

00:31:09 — Current AIs Are Moral

00:34:40 — AIs With a Ruthless Game-Playing Flavor

00:38:48 — Introducing the Doom Train

00:45:07 — "Can It" vs. "Will It" — Two-Part Argument on AI X-Risk

00:49:40 — Mike's Tweet on Superintelligence by 2027

01:01:34 — AI as a Goal Engine

01:20:51 — Offense vs. Defense in the Coming Cyber War

01:39:14 — Is Morality Just Game Theory? The "Different Flavor" of Future AI

01:46:16 — Ricardo's Law: Does AI Have Reason to Keep Us Around?

01:52:14 — Why Mike Gets Off the Doom Train

01:54:58 — Is AI Conscious?

02:01:39 — Mike's Vision for the Coming AI Utopia

02:06:52 — Wrap-Up

Doom Debates’ Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.

Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates, or to really take things to the next level: Donate 🙏