Super Data Science: ML & AI Podcast with Jon Krohn 559: GPT-3 for Natural Language Processing
Mar 22, 2022
Melanie Subbiah, NLP expert, and PhD student, chats with Jon Krohn about GPT-3 strengths, autoregression, fine-tuning, bias issues, and future NLP models. They discuss addressing climate change and bias, Melanie's work at OpenAI, ML tools she's excited about, and her PhD journey at Columbia University.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10
Intro
00:00 • 3min
Exploring GPT-3's Architecture and Few-Shot Learning Abilities
03:05 • 12min
Challenges in Natural Language Inference Tasks and Machine Learning Operations
14:53 • 3min
Comparing Auto-Regression and Bi-Directional Systems in NLP
18:17 • 10min
Exploring Model Scaling in Natural Language Processing and Discussing Non-Differentiable Information Storage
28:05 • 4min
Advancements in Natural Language Processing and AI at OpenAI
32:10 • 24min
Exploring Culture, Decision-making, and Technical Tools in AI Research
55:59 • 18min
Exploring the Excitement of AI Applications in Various Fields and the Trend of Incorporating Computing Skills
01:13:40 • 3min
Exploring Whoop Tracker, Athletic Pursuits, and Advancements in NLP
01:16:40 • 9min
Exploring GPT-3 and Natural Language Processing
01:25:12 • 3min