Get the app
Irwan Bello
Research scientist formerly at Google Brain, now on the founding team of a stealth AI startup. Expert in large-scale language modeling and sparse expert models.
Best podcasts with Irwan Bello
Ranked by the Snipd community
10 snips
Apr 25, 2022
• 46min
Mixture-of-Experts and Trends in Large-Scale Language Modeling with Irwan Bello - #569
chevron_right
Irwan Bello, a research scientist formerly with Google Brain and now part of a stealth AI startup, dives into the world of sparse expert models. He discusses his recent work on designing effective architectures that improve performance while managing computational costs. The conversation uncovers how the mixture-of-experts technique can extend beyond NLP to various tasks, including vision. Bello also shares insights on enhancing alignment in language models through instruction tuning and the challenges of optimizing these large-scale systems.
The AI-powered Podcast Player
Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
Get the app