The Reasoning Show AI News of the Month for March 2026
19 snips
Mar 29, 2026 A fast roundup of March AI headlines, from Arm moving into chip manufacturing to rising ARM and NVIDIA momentum in data centers. Deep dives on NVIDIA’s GTC moves, frontier model ambitions, and the challenges of hardware firms doing software. Debate over inference demand, token pricing and whether the AI market is a bubble. Coverage of Apple’s cautious AI posture and OpenAI’s strategic retrenchment and hires.
AI Snips
Chapters
Transcript
Episode notes
Arm Moving From IP To Chipmaker
- Arm entering chip manufacturing signals a shift from Intel/AMD dominance toward ARM and Nvidia for data center CPUs.
- Brian and Brandon cite density forecasts (30k→120k CPUs per GW) and Linux support as the foundation enabling ARM's move.
NVIDIA As The Token Machine And Hedge
- NVIDIA is effectively the dominant token-machine vendor and is vertically expanding by funding its own foundation model work.
- Brian notes Nvidia carved out $25–30B to build a frontier model to learn usage and secure capacity.
Inference Demand Creates Time‑of‑Day Pricing
- Inference capacity demand is surging but cost dynamics vary by time and provider, creating temporal price patterns.
- Brandon observed token prices drop in afternoons and Claude offering cheaper slots during US work hours as an example.