The Diary Of A CEO with Steven Bartlett

chevron_right

The Man Who Wrote The Book On AI: 2030 Might Be The Point Of No Return! We've Been Lied To About AI!

whatshot 1923 snips

Dec 4, 2025

Guest

Stuart Russell

Stuart Russell, a leading AI expert and UC Berkeley professor, discusses alarming truths about artificial intelligence. He warns that the trillion-dollar AI race could lead to the extinction of humanity unless urgent regulations are implemented. Governments struggle to match the power of Big Tech, and the idea of just 'pulling the plug' on AI is a dangerous myth. Russell introduces the 'gorilla problem,' emphasizing that more intelligent systems could control lesser ones. He also critiques the insufficient safety measures in AI development and stresses the need for a societal model as automation increases.

02:04:18

forum

Ask episode

web_stories

AI Snips

view_agenda

Chapters

menu_book

Books

auto_awesome

Transcript

info_circle

Episode notes

Self-Improving Models Enable Fast Takeoff

AIs could perform their own AI research, improving iteratively and causing a rapid intelligence explosion.
That self-improvement dynamic underpins the 'fast takeoff' scenario many fear.

Define The Destination Before Deploying AGI

Plan now for a world where AI can do all human work and define desirable end-states before deployment.
Create transition policies, education, and economic models aligned to that destination.

Abundance Can Undermine Human Purpose

A utopia of abundance risks leaving most people purposeless despite material comfort.
Human flourishing likely requires challenges, social roles, and contribution beyond mere consumption.

Get the Snipd Podcast app to discover more snips from this episode

Stuart Russell's AI background and textbook

04:02 • 1min

chevron_right

Why a catastrophe might be needed to wake people

05:18 • 1min

chevron_right

Private awareness of extinction risk among AI leaders

06:43 • 3min

chevron_right

AGI definition and why embodiment matters

09:26 • 5min

chevron_right

Will AGI arrive and why money fuels it

14:29 • 51sec

chevron_right

Why scale alone won't deliver AGI

15:20 • 1min

chevron_right

The Manhattan Project vs the AGI budget

16:40 • 1min

chevron_right

Safety teams vs commercial pressure inside companies

17:51 • 50sec

chevron_right

Safety hires leaving and cultural concerns

18:40 • 46sec

chevron_right

The gorilla problem: intelligence determines control

19:26 • 3min

chevron_right

Why 'pull the plug' is not a solution

22:11 • 2min

chevron_right

Can superintelligent machines serve human interests?

23:54 • 1min

chevron_right

Stuart's shift to safety-focused research

25:10 • 27sec

chevron_right

Appalled by lack of safety attention

25:37 • 3min

chevron_right

Regret and not understanding current systems

28:09 • 2min

chevron_right

How large neural nets learn and opacity concerns

29:55 • 2min

chevron_right

Self-improvement, intelligence explosion, and fast takeoff

32:06 • 2min

chevron_right

Event horizon and the economic magnet

33:52 • 2min

chevron_right

Creating our successor and King Midas parallel

35:55 • 5min

chevron_right

If AGI succeeds: economic abundance and Keynes' problem

41:20 • 3min

chevron_right

A world where AI does all work: unknown social model

43:54 • 5min

chevron_right

Humanoid robots: why look human and risks

48:31 • 7min

chevron_right

Psychological risks of human-like machines

55:43 • 2min

chevron_right

Career advice for young people in an AI world

Distribution of wealth and universal basic income critique

01:11:38 • 4min

chevron_right

Would Stuart press a button to stop AI progress?

01:15:19 • 2min

chevron_right

Geopolitics, China, and the race argument

01:17:08 • 6min

chevron_right

Economic disruption, hollowing of middle class

Extinction statement and shifting public debate

01:34:27 • 4min

chevron_right

Demanding provable safety thresholds

01:38:50 • 6min

chevron_right

Designing AI as uncertain, human-keyed helpers

01:44:55 • 5min

chevron_right

How average people can help influence policy

01:50:05 • 2min

chevron_right

Personal motivation: devotion to safety work

01:52:06 • 8min

chevron_right

Where to learn more and final reflections

• Mentioned in 13 episodes

The Alignment Problem

Brian Christian

#1865

• Mentioned in 23 episodes

Human Compatible

Artificial Intelligence and the Problem of Control

Stuart J. Russell

In this book, Stuart Russell explores the concept of intelligence in humans and machines, outlining the near-term benefits and potential risks of AI. He discusses the misuse of AI, from lethal autonomous weapons to viral sabotage, and proposes a novel solution by rebuilding AI on a new foundation where machines are inherently uncertain about human preferences. This approach aims to create machines that are humble, altruistic, and committed to pursuing human objectives, ensuring they remain provably deferential and beneficial to humans.

AI Expert STUART RUSSELL, exposes the trillion-dollar AI race, why governments won’t regulate, how AGI could replace humans by 2030, and why only a nuclear-level AI catastrophe will wake us up

Professor Stuart Russell O.B.E. is a world-renowned AI expert and Computer Science Professor at UC Berkeley. He holds the Smith-Zadeh Chair in Engineering and directs the Center for Human-Compatible AI, and is also the bestselling author of the book “Human Compatible: AI and the Problem of Control".

He explains:

◼️What the “gorilla problem” reveals about our future under superintelligent AI

◼️How governments are outfunded by Big Tech

◼️Why current AI systems already lie and self-preserve

◼️The radical solution he’s spent a decade building to make AI safe

◼️The myth of ‘pulling the plug’ and why AI won’t be that easy to stop

[00:00] You've Been Talking About AI for a Long Time

[02:54] You Wrote the Textbook on AI

[03:29] It Will Take a Crisis to Wake People Up

[06:03] CEOs Staying in the AI Race Despite Risks

[08:04] They Know It's an Extinction-Level Risk

[10:06] What Is Artificial General Intelligence (AGI)?

[13:10] Will We Reach General Intelligence Soon?

[16:26] How Much Is Safety Really Being Implemented

[17:29] AI Safety Employees Leaving OpenAI

[18:14] The Gorilla Problem — The Most Intelligent Species Will Always Rule

[19:34] If There's an Extinction Risk, Why Don't They Stop?

[21:02] Can't We Just Pull the Plug if AI Gets Too Powerful?

[22:49] Can We Build AI That Will Act in Our Best Interests?

[24:09] Are You Troubled by the Rapid Advancement of AI?

[26:48] Do You Have Regrets About Your Involvement?

[27:35] No One Actually Understands How This AI Works

[30:36] AI Will Be Able to Train Itself

[32:24] The Fast Takeoff Is Coming

[34:20] Are We Creating Our Successor and Ending the Human Race?

[38:36] Advice to Young People in This New World

[40:52] How Do You Think AI Would Make Us Extinct?

[42:33] The Problem if No One Has to Work

[45:59] What if We Just Entertain Ourselves All Day

[48:43] Why Do We Make Robots Look Like Humans?

[56:44] What Should Young People Be Doing Professionally?

[59:56] What Is It to Be Human?

[01:03:34] The Rise of Individualism

[01:05:34] Ads

[01:06:39] Universal Basic Income

[01:08:41] Would You Press a Button to Stop AI Forever?

[01:15:13] But Won't China Win the AI Race if We Stop?

[01:18:40] Trump's Approach to AI

[01:19:06] What's Causing the Loss in Middle-Class Jobs

[01:21:02] What Will Happen if the UK Doesn't Participate in the AI Race?

[01:23:31] Amazon Replacing Their Workers

[01:29:00] Ads

[01:30:54] Experts Agree on Extinction Risk

[01:38:01] What if Aliens Were Watching Us Right Now

[01:39:35] Can We Make AI Systems That We Can Control?

[01:43:14] Are We Creating a God?

[01:47:32] Could There Have Been Advanced Civilisations Before Us?

[01:48:50] What Can We Do to Help?

[01:50:43] You Wrote the Book on AI — Does It Weigh on You?

[01:58:48] What Do You Value Most in Life?

Follow Stuart:

LinkedIn - https://bit.ly/3Y5fOos

You can purchase “Human Compatible: AI and the Problem of Control", here: https://amzn.to/48eOMkH

The Diary Of A CEO:

◼️Join DOAC circle here - https://doaccircle.com/

◼️Buy The Diary Of A CEO book here - https://smarturl.it/DOACbook

◼️The 1% Diary is back - limited time only: https://bit.ly/3YFbJbt

◼️The Diary Of A CEO Conversation Cards (Second Edition): https://g2ul0.app.link/f31dsUttKKb

◼️Get email updates - https://bit.ly/diary-of-a-ceo-yt

◼️Follow Steven - https://g2ul0.app.link/gnGqL4IsKKb

Sponsors:

Pipedrive - https://pipedrive.com/CEO
Fiverr: https://fiverr.com/diary and get 10% off your first order when you use code DIARY
Stan Store: NO PURCHASE NECESSARY. VOID WHERE PROHIBITED. For Official Rules, visit https://DaretoDream.stan.store

Home Top podcasts Popular guests Top books