The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) AI Trends 2023: Causality and the Impact on Large Language Models with Robert Osazuwa Ness - #616
33 snips
Feb 14, 2023 Robert Osazuwa Ness, a senior researcher at Microsoft and professor at Northeastern University, dives into exciting trends in causal modeling. He highlights advances in causal discovery and its implications for drug discovery and healthcare. The conversation delves into the significance of causality in large language models, exploring how these models can enhance reasoning about cause and effect. Ness also discusses innovative applications like SayCan, which transforms verbal commands into robotic actions, merging AI with practical tasks.
AI Snips
Chapters
Transcript
Episode notes
Gaming Example
- Imagine a gaming company analyzing how guild membership, side quests, and in-game purchases relate.
- An intervention, like forcing side quest engagement, helps determine causal effects, but the target node isn't always known.
Predicting Intervention Targets
- Predicting intervention targets helps determine downstream effects in causal discovery.
- Matching predicted effects with observed data helps learn the underlying causal graph.
Simulators and Causal Knowledge
- Simulators encode causal knowledge, often from physical domains, about causal mechanisms.
- Use simulators to generate data, especially when combined with real-world data, for training foundation models.