Control is the central bottleneck

Ajeya Cotra argues using AI for safety still depends on solving trust and control, because misaligned systems could sabotage any defensive agenda.

Play episode from 01:04:39

chevron_right

Transcript

chevron_right

Transcript

Episode notes

This cross-post from the 80,000 Hours podcast features Ajeya Cotra in conversation with Rob Wiblin about AI timelines, recursive self-improvement, and the “crunch time” window when AI could rapidly accelerate its own development. Ajeya explains why widespread, compounding automation may face fewer bottlenecks than many expect, and what that could mean for the world by 2050. They also discuss transparency, early warning systems, and the emerging strategy of using each generation of AI to align and control its successors.

LINKS:

Ajeya Cotra podcast episode

Sponsors:

AvePoint:

AvePoint is building the control layer for AI agents so you can securely govern, audit, and recover every action at scale. Design trusted agentic outcomes from day one at https://avpt.co/tcr

VCX:

VCX, by Fundrise, is the public ticker for private tech, giving everyday investors access to high-growth private companies in AI, space, defense tech, and more. Learn how to invest at https://getvcx.com

Claude:

Claude is the AI collaborator that understands your entire workflow, from drafting and research to coding and complex problem-solving. Start tackling bigger problems with Claude and unlock Claude Pro’s full capabilities at https://claude.ai/tcr

Tasklet:

Build your own Cognitive Revolution monitoring agent in one click.
Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai

CHAPTERS:

(00:00) About the Episode

(04:17) AI inside safety plans

(06:49) AGI growth expectations (Part 1)

(18:32) Sponsors: AvePoint | VCX

(20:54) AGI growth expectations (Part 2)

(21:56) Disagreement and measurement (Part 1)

(37:28) Sponsors: Claude | Tasklet

(41:19) Disagreement and measurement (Part 2)

(41:19) Transparency before takeoff

(58:00) Redirecting AI labor

(01:09:06) Defense plans and limits