Daliana's Game Case studies from the GenAI frontier, scaling ML teams, from biologist to machine learning consultant- Erik Gafni - The Data Scientist Show #082
Feb 24, 2024
Discussion on GenAI projects, stable diffusion models for social media apps, AI in biotech, and scaling ML teams. Insights on self-supervised learning, research vs production, AGI, and data quality in GenAI. Erik's journey from biologist to ML consultant, mistakes made, and new trends in GenAI. Philosophy in LLMs, OpenAI vs Open Source, and how he hires people.
AI Snips
Chapters
Transcript
Episode notes
Research Engineering Defined
- Research engineering blends experimental innovation with practical outcomes.
- Most exciting projects have clear goals but involve pushing unknown boundaries.
Scaling AI Advances Intelligence
- Scaling transformers with more compute and data yields emergent cognitive capabilities.
- Multimodal models and new modalities could further expand intelligence in AI systems.
Promise of Synthetic Data
- Synthetic data will be a valuable supplement for training, especially for math and coding.
- Self-improving loops like reinforcement learning can generate data without external sources.