Round Table China

The Why: Tokens

9 snips
Mar 26, 2026
A new tech segment unpacks why tokens became central to AI, from the jump to 140 trillion units to what a token actually is. They explain how everyday interactions and uploads consume tokens and why that shapes pricing and business models. The conversation compares tokens to kilowatt hours and explores future demand, efficiency, limits, and equity around access to high-quality AI.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Tokens Are The Fundamental Unit Of AI Usage

  • Tokens are the smallest chunks of information an AI processes and now measure AI usage at scale.
  • China reported 140 trillion daily AI tokens, a >1,000× rise from early 2024's 100 billion, signaling explosive industrial use.
ANECDOTE

Using ChatGPT As A Personal Diet Coach

  • Steve uses ChatGPT daily, even as a diet coach that remembers meals and estimates calories.
  • He shared a moment where ChatGPT offered nutritional data mid-meal, prompting him to turn off his phone and enjoy his roast duck.
INSIGHT

Tokens Link Computation To Cost

  • Tokens directly map to cost, memory, and computation, so counting tokens equals measuring AI economic activity.
  • Yu Shun contrasts token counting with word counts and rejects tokens as a traded universal currency.
Get the Snipd Podcast app to discover more snips from this episode
Get the app