What's AI Podcast by Louis-François Bouchard From Microsoft GitHub to Google DeepMind - Paige Bailey on AI Research and Products. What's AI Ep. 21
10 snips
Nov 8, 2023 Paige Bailey, Lead product manager at Google DeepMind and previously working at Microsoft GitHub, talks about the democratization of AI, advancements in AI-assisted coding, and the ethics of innovation. They also discuss the challenges of training large foundational models, the importance of model size for language models, and the potential impact of generative models on the future of work and education.
AI Snips
Chapters
Transcript
Episode notes
Fine-Tune With Few High-Quality Examples
- Use high-quality human demonstrations and a few hundred curated examples to improve model performance.
- Even 500 well-chosen examples can significantly boost fine-tuned models.
Prototype Fine-Tuning In Colab
- Learn by fine-tuning small open models in Colab to build intuition before productionizing.
- Compare pre- and post-fine-tuning outputs to guide dataset curation and evaluation.
AI Democratizes Premium Experiences
- Generative AI can democratize premium services like tutors and stylists at scale.
- Paige frames models as personalized teachers that make previously expensive experiences accessible.