The Delphi Podcast

Revisiting The Fundamentals of Crypto x AI with NEAR | Crypto x AI Event

Oct 25, 2024
Illia Polosukhin and Alex Skidanov, co-founders of NEAR Protocol, dive deep into the intersection of AI and blockchain. They discuss the revolutionary 'Attention is All You Need' paper and its impact on language processing. The duo emphasizes the vision for user-owned AI and how decentralization empowers individuals over platforms. They share insights on the challenges of distributed AI training, the necessity of private computing for user control, and creating fair compensation models using smart contracts. Their thought-provoking ideas shed light on the future of technology and democratic access to AI.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Transformers Enabled Scalable World Models

  • The Transformer unlocked large-context, parallel training that made compressing internet knowledge into models practical.
  • Illia says that pretraining on next-token prediction scaled to capture broad world knowledge for downstream tasks.
ANECDOTE

AI Labeling Pain Led To NEAR Protocol

  • Near began as an AI startup solving data-labeling and payments for global contributors.
  • Alex and Illia pivoted to build NEAR Protocol because blockchain fixed payout frictions for annotators.
INSIGHT

User-Owned AI Puts People First

  • User-owned AI aims to optimize models for individual wellbeing and choice rather than platform profit.
  • Illia frames this as returning control over assets, data and attention to people via open web principles.
Get the Snipd Podcast app to discover more snips from this episode
Get the app