The Circuit EP 156: Evolving Dynamics of AI Infrastructure, Open Source Agents, Meta's ASIC Roadmap
48 snips
Mar 16, 2026 AI Snips
Chapters
Transcript
Episode notes
The Open Source Customer Competition Dilemma
- NVIDIA faces a tension: making open models high-quality helps infrastructure demand but risks competing with hyperscaler and frontier-model customers.
- Jay warned NVIDIA must choose how far to push openness to avoid undermining customers like OpenAI and Anthropic.
Orchestrator Is Becoming The Critical AI Layer
- Multi-agent orchestration (agents picking models for tasks) is emerging as the key abstraction layer that will route workloads across models and clouds.
- Ben and Jay noted Perplexity, CloudBot and router features show orchestration will optimize cost, latency and quality dynamically.
Optimize Token Spend With Model Routing
- Do expect orchestration tooling to optimize for token spend and automatically route to cheaper or higher-quality models as needed.
- Jay highlighted OpenAI router and OpenClaw community tips that focus on reducing token costs by orchestrating models.