Semi Doped ARM AGI CPU has entered the chat, TurboQuant thrashes memory stocks
7 snips
Mar 27, 2026 They dig into a high‑stakes patent clash in the semiconductor world and what it could mean for companies. They unpack TurboQuant and how aggressive KV cache compression reshapes memory needs. They explore ARM moving into CPUs tailored for agentic AI and the practical challenges of cores, NUMA and memory supply. Short timelines and system designs get close attention.
AI Snips
Chapters
Transcript
Episode notes
GF Files Patent Suits Against Tower and Market Reacts
- GlobalFoundries filed lawsuits against Tower Semiconductor claiming infringement of 11 U.S. patents targeting high-performance process tech.
- Austin and Vikram note stock reaction (Tower down ~5%), the use of Western District of Texas, and uncertainty over which patents are asserted.
Use Compression To Expand Context Not Kill HBM Demand
- Do treat KV cache compression as a feature tradeoff to expand context rather than a threat to memory demand.
- Austin argues product teams will use saved memory to deliver larger context windows or more users, not to eliminate HBM usage.
Don't Sell Memory Stocks On Every Algorithmic Paper
- Avoid treating every algorithmic win as a memory company death knell; instead, model product responses and likely increased feature deployment.
- Austin recommends updating valuations but expects engineers and PMs to redirect savings into larger context or more users, sustaining hardware demand.