Vik and Austin unpack the Nvidia GTC keynote with fresh, top-of-mind takes while trying to breakdown key announcements, what matters and what doesn't. They discuss Groq's LPX, optics+copper for scale up, new CPU requirements, CPO for networking, and what agents means for software, and much, much, more.
Check out Austin's substack: https://www.chipstrat.com
Check out Vik's substack: https://www.viksnewsletter.com
Chapters
00:00 Introduction and Keynote Context
03:18 Keynote Highlights and Gaming Innovations
06:18 Generative AI: The Three Eras
09:28 Inference: The New Revenue Generator
12:21 NVIDIA's Tiered Approach to AI Models
15:30 The Grok Chip and Its Role
18:35 Vera Rubin System: A Full Data Center
21:18 CPU Demand and Performance
24:31 Networking Innovations and Future Directions
32:32 Innovations in PCB Technology
34:06 Scaling GPU Systems
36:57 Understanding the STX Rack and AI Storage
38:23 The Rosa CPU and Its Significance
40:07 Digital Twin Platforms and AI Factories
43:53 NVIDIA's New Software Innovations
47:09 The Future of Token Budgets in AI
54:15 Balancing CapEx and OpEx in AI Deployments
