"Autopilot" with Will Summerlin Powering AI: Energy Bottlenecks, Hyperscalers, & AGI w/ Freda Duan, Principal at Altimeter Capital
25 snips
Jun 18, 2024 Will Summerlin sits down with Freda Duan from Altimeter Capital to discuss energy bottlenecks in AI, AGI development, capital expenditure trends in big tech, open source vs closed source models, the rise of XAI, economic risks, investment cycles, and the future impact of AI.
AI Snips
Chapters
Transcript
Episode notes
Big Tech CapEx Has Risen Sharply
- Big tech CapEx has surged to over $200B this year, outpacing past industry peaks.
- The shift reflects hyperscalers' massive infrastructure push and increased capital intensity for AI.
LLMs Add A Costly New Infra Layer
- AI introduces a new infra layer (large language models) that increases total stack costs.
- That extra layer may squeeze application margins unless the overall market expands significantly.
Training Costs Threaten The Long Tail
- Training costs are escalating into the billions, pushing many smaller model companies out of the market.
- Hyperscalers will try to avoid letting a single model company become too dominant because of leverage concerns.