The Moonshot Podcast  cover image

The Moonshot Podcast Deep Dive: Andrew Ng on Deep Learning and Google Brain

The Moonshot Podcast

00:00

Transformer Roots and Scalability Design

Andrew highlights how Transformer design prioritized parallelizability for GPUs, enabling foundation models and attention mechanisms.

Play episode from 22:02
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app