Machine Learning Street Talk (MLST)
Machine Learning Street Talk (MLST)
Welcome! We engage in fascinating discussions with pre-eminent figures in the AI field. Our flagship show covers current affairs in AI, cognitive science, neuroscience and philosophy of mind with in-depth analysis. Our approach is unrivalled in terms of scope and rigour – we believe in intellectual diversity in AI, and we touch on all of the main ideas in the field with the hype surgically removed. MLST is run by Tim Scarfe, Ph.D (https://www.linkedin.com/in/ecsquizor/) and features regular appearances from MIT Doctor of Philosophy Keith Duggar (https://www.linkedin.com/in/dr-keith-duggar/).
Episodes
Mentioned books
8 snips
Sep 12, 2024 • 1h 30min
Cohere's SVP Technology - Saurabh Baji
Saurabh Baji, SVP of Engineering at Cohere, shares insights from his journey in deploying large language models for business. He explains how Cohere focuses on pragmatic models tailored for enterprises, emphasizing flexible deployment options like cloud and on-premises solutions. Highlighting the importance of retrieval-augmented generation, he details how models can leverage enterprise data. Baji predicts a surge in AI adoption in the coming months, stressing the significance of trust and security in enterprise applications.
9 snips
Sep 10, 2024 • 53min
David Hanson's Vision for Sentient Robots
David Hanson, CEO of Hanson Robotics and creator of the humanoid robot Sophia, dives into the intricate balance between AI and humanity. He advocates for incorporating compassion and ethical principles into AI to nurture empathy and enhance human wisdom. The conversation touches on the potential for AI to tackle societal challenges, the dangers of technological inequality, and the need for a shared moral framework in advancing sentient robots. Hanson envisions a future where AI not only complements but elevates human values and capabilities.
41 snips
Sep 5, 2024 • 46min
The Fabric of Knowledge - David Spivak
David Spivak, a mathematician specializing in category theory, explores thought-provoking ideas about intelligence, creativity, and knowledge. He breaks down category theory into accessible concepts and discusses the role of embodiment in learning. Spivak examines how artificial intelligence impacts human thought and creativity, emphasizing open-endedness in problem-solving. He also highlights the significance of language in shaping our understanding and facilitating collective intelligence. It's a deep dive into how abstract ideas interact with real-world applications.
55 snips
Aug 28, 2024 • 1h 40min
Jürgen Schmidhuber - Neural and Non-Neural AI, Reasoning, Transformers, and LSTMs
Jürgen Schmidhuber, the father of generative AI and a pioneer in deep learning, shares insights on neural and non-neural AI. He discusses the evolution of LSTMs and linear transformers, highlighting their importance in modern AI systems. Topics include the intricacies of reasoning in AI, the balance between memorization and generalization, and the potential breakthroughs in reducing computational needs. Schmidhuber also critiques public misconceptions about AI and explores advanced AI planning methods as pathways to achieve AGI.
57 snips
Aug 25, 2024 • 2h 12min
"AI should NOT be regulated at all!" - Prof. Pedro Domingos
In this engaging discussion, Pedro Domingos, a renowned AI researcher and author, critiques current AI regulation efforts, arguing they hinder innovation. He explores his satirical novel "2040", which humorously tackles tech culture and politics. Domingos emphasizes the importance of a 'master algorithm' in unifying AI techniques and critiques existing approaches from OpenAI and others. He shares insights on the complexities of language models and highlights his work on tensor logic, calling for a faster, more innovative AI development.
36 snips
Aug 22, 2024 • 1h 28min
Adversarial Examples and Data Modelling - Andrew Ilyas (MIT)
Andrew Ilyas, a PhD student at MIT soon to be a professor at CMU, dives deep into the fascinating world of machine learning. He explains how datasets influence model predictions and why adversarial examples are crucial features rather than mere bugs. The discussion spans the complexities of robustness, black box attacks, and biases in data collection, especially in the ImageNet dataset. Ilyas also shares innovative solutions to self-selection bias and his ambitious future research plans in the field.
66 snips
Aug 21, 2024 • 57min
Joscha Bach - AGI24 Keynote (Cyberanimism)
Dr. Joscha Bach, an AI researcher renowned for his insights into consciousness and AGI, introduces the intriguing concept of "cyber animism." He explores the idea that nature might host self-organizing software agents, similar to ancient spirits. Bach combines philosophy, history, and cutting-edge science, suggesting consciousness could be more widespread than we think. He encourages a rethinking of the distinctions between human, artificial, and natural intelligence, probing the connections between consciousness, self-awareness, and even plant signaling.
18 snips
Aug 17, 2024 • 1h 12min
Gary Marcus' keynote at AGI-24
In this discussion, Gary Marcus, a renowned professor and AI expert, critiques the current state of large language models and generative AI, highlighting their unreliability and tendency to hallucinate. He argues that merely scaling data won't lead us to AGI and proposes a hybrid AI approach that integrates deep learning with symbolic reasoning. Marcus voices concerns about the ethical implications of AI deployment and predicts a potential 'AI winter' due to overhyped technologies and inadequate regulation, emphasizing the necessity for deeper conceptual understanding in AI.
12 snips
Aug 15, 2024 • 33min
Is ChatGPT an N-gram model on steroids?
In this discussion, Timothy Nguyen, a DeepMind Research Scientist and MIT scholar, shares insights from his innovative research on transformers and n-gram statistics. He reveals a method to analyze transformer predictions without tapping into internal mechanisms. The conversation covers how transformers evolve during training, particularly in curriculum learning, and how to detect overfitting without traditional holdout methods. Nguyen also dives into philosophical questions about AI understanding, highlighting the complexities of interpreting neural network behavior.
42 snips
Aug 11, 2024 • 57min
Jay Alammar on LLMs, RAG, and AI Engineering
Jay Alammar, a prominent AI educator and researcher at Cohere, dives into the latest on large language models (LLMs) and retrieval augmented generation (RAG). He explores how RAG enhances data interactions, helping reduce hallucination in AI outputs. Jay also addresses the challenges of implementing AI in enterprises, emphasizing the importance of education for developers. The conversation highlights semantic search innovations and the future of AI architectures, offering insights on effective deployment strategies and the need for continuous learning in this rapidly evolving field.
