ForeCast

Lukas Finnveden is a Research Analyst at Redwood Research. We talk about making deals with early scheming AIs: paying them to cooperate rather than take over. You can read a full transcript here. To see all Forethought’s published research, visit forethought.org/research. To subscribe to our newsletter, visit forethought.org/subscribe.

This is an AI narration of "The first type of transformative AI?" by Owen Cotton-Barratt, Lizka Vaintrob, and Oly Sourbut. The article was first released on 18th December 2025. You can read more of our research at forethought.org/research. Thank you to Type III audio for providing these automated narrations.

This is an AI narration of "Space Debris and Launch Denial" by Fin Moorhouse. The article was first released on 17th December 2025. You can read more of our research at forethought.org/research. Thank you to Type III audio for providing these automated narrations.

Nora Ammann, a researcher at ARIA with a focus on AI safety and governance, joins Rose Hadshar to dissect the complexities of power concentration and checks and balances. They explore the nuances of when centralization can be beneficial and how AI threatens existing frameworks of power. The duo delves into cultural influences, economic power, and the erosion of shared belief systems. They also discuss the need for transparency, whistleblower protections, and strategies for designing a resilient political economy post-AGI.

Joe Carlsmith, a prominent writer and philosopher on AI safety, dives deep into consciousness and the moral status of beings. He challenges traditional views with thought experiments like the dog vs. car analogy and explores digital minds surpassing biological ones. Carlsmith discusses the implications of AI consciousness, emphasizing empathy failures and historical moral mistakes. With a focus on how competitive dynamics could erode goodness, he advocates for thoughtful interventions to reduce AI suffering and ensure human values thrive amidst rapid technological advancement.

Mia Taylor, a research fellow at Forethought, dives into her role tackling significant societal issues posed by advanced AI, focusing on democracy preservation and the risks of power concentration. She shares her intriguing journey to Forethought, emphasizing the importance of exploring speculative questions about AI's long-term impact. Mia contrasts the dynamic research environment at Forethought with traditional academic paths and highlights the need for curious generalists in their team. She also discusses vital projects and her unique perspective on AI extinction risks.

Explore the intriguing debate on whether humanity should prioritize survival or flourishing. William MacAskill discusses the distinction between merely existing and truly thriving. He argues that focusing on flourishing could have a more significant impact than just avoiding catastrophe. Delve into why this often-overlooked topic deserves more attention and learn about the challenges of making flourishing a reality. MacAskill also introduces 'viatopia,' advocating for flexible visions of positive futures instead of rigid utopias.

David Duvenaud, an associate professor at the University of Toronto and a co-author of 'Gradual Disempowerment', shares insights on the societal impacts of advanced AI. He discusses job protection measures as automation progresses, the evolution of credentialing systems, and the rise of political activism due to increased leisure time. Duvenaud warns of the moral stakes in losing human bargaining power and stresses the need for concrete visions for a post-AGI world, advocating for strong institutions to safeguard human interests.

This is an AI narration of "Evaluating the Infinite" by Toby Ord. The article was first released on 21st September 2025. You can read more of our research at forethought.org/research. Thank you to Type III audio for providing these automated narrations.

Explore how AI can be a game-changer in mitigating existential risks to humanity. The discussion highlights three key application categories where these tools can make a significant difference. There's an urgent emphasis on the need to accelerate innovation to manage challenges posed by advancing AI technologies. Tune in to discover the intersection of technology and security!