Episode 39: From Models to Products: Bridging Research and Practice in Generative AI at Google Labs

24 snips

Nov 25, 2024

Hugo chats with Ravin Kumar, a Senior Research Data Scientist at Google Labs, whose career journey includes roles at SpaceX and Sweetgreen. They delve into the balance between technical rigor and practical utility in generative AI. Ravin shares insights on building scalable AI systems, such as using Gemma to optimize bakery operations. He emphasizes the critical role of UX in AI adoption, showcases the Notebook LM tool in action, and explores how AI can aid small businesses—demonstrating the transformative power of accessible technology.

Ask episode

AI Snips

Chapters

Transcript

Episode notes

INSIGHT

Limitations of Traditional Data Analysis

Traditional data analysis methods like averages and standard deviations often fail to capture real-world complexities.
Bayesian modeling allows for specifying constraints and generating a range of possibilities with associated probabilities.

ANECDOTE

The Fluidity of Job Titles

Ravin Kumar's job titles have varied greatly throughout his career, highlighting the fluidity of roles in the tech industry.
He emphasizes focusing on fundamental mathematical skills, as job titles often don't reflect the core work.

ANECDOTE

Breadboard for LLM Application Development

Ravin Kumar highlighted "Breadboard", a visual programming language for building LLM applications.
This tool enables non-coders, including children and adults, to create LLM applications without extensive coding knowledge.

Get the Snipd Podcast app to discover more snips from this episode

Get the app

Hugo speaks with Ravin Kumar,*Senior Research Data Scientist at Google Labs. Ravin’s career has taken him from building rockets at SpaceX to driving data science and technology at Sweetgreen, and now to advancing generative AI research and applications at Google Labs and DeepMind. His multidisciplinary experience gives him a rare perspective on building AI systems that combine technical rigor with practical utility.
In this episode, we dive into:
• Ravin’s fascinating career path, including the skills and mindsets needed to work effectively with AI and machine learning models at different stages of the pipeline.
• How to build generative AI systems that are scalable, reliable, and aligned with user needs.
• Real-world applications of generative AI, such as using open weight models such as Gemma to help a bakery streamline operations—an example of delivering tangible business value through AI.
• The critical role of UX in AI adoption, and how Ravin approaches designing tools like Notebook LM with the user journey in mind.
We also include a live demo where Ravin uses Notebook LM to analyze my website, extract insights, and even generate a podcast-style conversation about me. While some of the demo is visual, much can be appreciated through audio, and we’ve added a link to the video in the show notes for those who want to see it in action. We’ve also included the generated segment at the end of the episode for you to enjoy.
LINKS
The livestream on YouTube (https://www.youtube.com/live/ffS6NWqoo_k)
Google Labs (https://labs.google/)
Ravin's GenAI Handbook (https://ravinkumar.com/GenAiGuidebook/book_intro.html)
Breadboard: A library for prototyping generative AI applications (https://breadboard-ai.github.io/breadboard/)
As mentioned in the episode, Hugo is teaching a four-week course, Building LLM Applications for Data Scientists and SWEs, co-led with Stefan Krawczyk (Dagworks, ex-StitchFix). The course focuses on building scalable, production-grade generative AI systems, with hands-on sessions, $1,000+ in cloud credits, live Q&As, and guest lectures from industry experts.
Listeners of Vanishing Gradients can get 25% off the course using this special link (https://maven.com/hugo-stefan/building-llm-apps-ds-and-swe-from-first-principles?promoCode=VG25) or by applying the code VG25 at checkout.

Get full access to Vanishing Gradients at hugobowne.substack.com/subscribe