Recursive self-improvement concerns and precursors

Andrea Miotti is the founder and CEO of Control AI, a nonprofit. He joins the podcast to discuss efforts to prevent extreme risks from superintelligent AI. The conversation covers industry lobbying, comparisons with tobacco regulation, and why he advocates a global ban on AI systems that can outsmart and overpower humans. We also discuss informing lawmakers and the public, and concrete actions listeners can take.

LINKS:

• Control AI

• Control AI global action page

• ControlAI's lawmaker contact tools

• Open roles at ControlAI

• ControlAI's theory of change

CHAPTERS:

(00:00) Episode Preview

(00:52) Extinction risk and lobbying

(08:59) Progress toward superintelligence

(16:26) Building political awareness

(24:27) Global regulation strategy

(33:06) Race dynamics and public

(42:36) Vision and key safeguards

(51:18) Recursive self-improvement controls

(58:13) Power concentration and action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP