The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

In this discussion, Dave Castillo, Managing VP for ML at Capital One, shares his journey from creating early ML systems at NASA to leading ML adoption at a major financial institution. He highlights the shift from lab-based ML to enterprise-wide integration and discusses innovative use cases. Dave introduces a new role that combines product management and design thinking, aimed at enhancing user experience. He also addresses the challenges of model risk documentation, automation opportunities, and the evolving skill sets required in data science and ML roles.

Bryton Shang, Founder and CEO of Aquabyte, is pioneering the integration of computer vision in fish farming. He discusses the challenges of measuring fish health underwater and how AI can revolutionize operations. Fascinating insights include the development of fish facial recognition for health tracking and innovative camera tech to tackle sea lice issues. Bryton shares his journey from academia to entrepreneurship, emphasizing the need for sustainable and efficient aquaculture practices to help feed the world.

Ville Tuulos, Machine Learning Infrastructure Manager at Netflix and a key contributor to Metaflow, shares insights on this human-centric framework for data science. He discusses the evolution of machine learning infrastructure and the importance of accessibility for practitioners. The conversation dives into integrating Metaflow with Jupyter and SageMaker, streamlining workflows with automated version control, and managing model artifacts effortlessly. Tuulos also highlights the framework's open-source nature and its future cloud integrations, enriching the data science community.

Stephen Merity, an NLP and deep learning researcher at DDX Times, shares insights into his innovative work on Single Headed Attention RNNs. He delves into his motivations for developing this model and contrasts it with conventional transformers. Merity emphasizes the importance of efficient model benchmarking, revealing how he made training accessible on a single GPU. He also discusses the significance of diversifying AI research, encouraging exploration beyond just large models. Plus, he reflects on the balance between academic writing and accessibility.

Scott Clark, Co-founder and CEO of SigOpt, dives into automated model tuning and its transformative potential for AI applications. He showcases SigOpt's platform with a live demo, highlighting how tailored solutions drive efficiency in enterprise modeling. The discussion covers the importance of customization, the need for effective experimentation platforms, and strategies to navigate machine learning optimization. Clark also explains Bayesian optimization techniques for parameter tuning, emphasizing a holistic approach to balancing multiple performance metrics.

Erez Barak, Partner Group Manager of Azure ML at Microsoft, shares his expertise in automated machine learning. He discusses the transformative impact of AutoML on the data science process, emphasizing its role in featurization, model selection, and hyperparameter tuning. The conversation also explores the balance between automation and human intuition, alongside the importance of systematic model building in lead scoring and ensuring model fairness. Erez dives into practical post-deployment use cases and the evolving landscape of MLOps.

In this engaging conversation, Sarah Bird, a Principal Program Manager at Microsoft specializing in Azure Machine Learning and responsible AI, shares insights on the new tools aimed at ethical machine learning. She discusses the InterpretML toolkit and its user-friendly interface for model insights. The conversation also delves into the challenges of differential privacy, emphasizing the balance between data accuracy and individual privacy. Additionally, Sarah highlights the importance of fairness in AI through the FairLearn toolkit, showcasing collaborative strategies for responsible AI development.

Jordan Edwards, Principal Program Manager for MLOps at Microsoft, shares his expertise on MLOps and model lifecycle management. He discusses how Azure ML enhances collaboration between data scientists and IT teams, streamlining model deployment. Key topics include the challenges of scaling machine learning in enterprises and the importance of reproducibility and automation in evolving customer needs. Jordan also delves into the significance of a maturity model for organizations in adopting effective MLOps practices.

Luke Marsden, Founder and CEO of Dotscience, shares insights on streamlining MLOps for machine learning projects. He discusses the integration of MLOps and DevOps, highlighting the challenges faced in collaboration and reproducibility. The conversation dives into a manifesto that promotes software engineering practices in ML, aiming for better accountability and continuous deployment. Luke also explores features enhancing collaborative workflows and the benefits of using Jupyter for data science, along with containerized deployment strategies using Docker for optimized model performance.

Mike Tung, Founder and CEO of Diffbot, dives into the unique world of autonomous knowledge graphs. He explains how Diffbot's approach differs from traditional search engines like Google and Bing. The conversation highlights the importance of structured data in AI, challenges of knowledge fusion, and the developer experience with tools like Extraction API and Crawlbot. Tung also discusses their dual role in research and commercial viability, offering insights into their subscription model for accessing the knowledge graph.