"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis Robotics Research Update, with Keerthana Gopalakrishnan and Ted Xiao of Google DeepMind
7 snips
Apr 22, 2024 
Keerthana Gopalakrishnan and Ted Xiao from Google DeepMind reveal cutting-edge advancements in AI robotics. They discuss breakthroughs enabling robots to learn from human demonstrations and handle novel objects. The duo dives into the debate on specialized versus generalist robots and emphasizes ethical considerations in robotic design. They shed light on the integration of internet-scale data in enhancing robotic learning and reflect on the challenges of training robots to navigate human environments safely and effectively.
AI Snips
Chapters
Transcript
Episode notes
Blurring Perception and Control
- Traditional robotics pipelines separate perception and control.
- RT2 blurs this line, treating both as a single problem like Visual Question Answering (VQA).
RT2's Internet Understanding
- RT2 understands internet-scale concepts, like choosing spicy chips based on color.
- However, movement knowledge still comes from in-house data, limiting motion generalization.
RTX: Robots are Similar
- Previously, robot data was considered highly embodiment-specific.
- RTX shifted this view, suggesting robots are similar, differing only in expression.