Practical AI

Clément Delangue, Co-founder and CEO of Hugging Face, dives into the world of social AI. He highlights how it fosters emotional connections and enhances user interaction, unlike traditional AI. Clem discusses innovative products like sassy chatbots and selfie-trading AIs. He also shares insights on the evolution of natural language understanding, the importance of large datasets, and the advantages of working in smaller AI organizations, emphasizing flexibility and innovation.

Explore the recent White House executive order on artificial intelligence and its role in maintaining U.S. leadership in the field. Discuss the ethical concerns surrounding AI regulations and the impact on civil liberties. Compare the U.S. strategy to China's aggressive approach in AI investment. Debate the effectiveness of the order amidst criticisms about its vagueness and the necessity of federal funding and workforce training. Advocate for improved public education on AI to foster a knowledgeable community.

While covering Applied Machine Learning Days in Switzerland, Chris met El Mahdi El Mhamdi by chance, and was fascinated with his work doing AI safety research at EPFL. El Mahdi agreed to come on the show to share his research into the vulnerabilities in machine learning that bad actors can take advantage of. We cover everything from poisoned data sets and hacked machines to AI-generated propaganda and fake news, so grab your James Bond 007 kit from Q Branch, and join us for this important conversation on the dark side of artificial intelligence.Sponsors:Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogRollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:El Mahdi El Mhamdi – Website, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:El Mahdi El Mhamdi on LinkedInGoogle ScholarPersonal blogWorld Health Organization | Ten threats to global health in 2019AggregaThorThe Hidden Vulnerability of Distributed Learning in ByzantiumMachine Learning with Adversaries: Byzantine Tolerant Gradient DescentAsynchronous Byzantine Machine Learning (the case of SGD)Upcoming Events: Register for upcoming webinars here!

This week we discuss GPT-2, a new transformer-based language model from OpenAI that has everyone talking. It’s capable of generating incredibly realistic text, and the AI community has lots of concerns about potential malicious applications. We help you understand GPT-2 and we discuss ethical concerns, responsible release of AI research, and resources that we have found useful in learning about language models.Sponsors:Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogRollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Relevant learning resources:Jay Alammar “Illustrated” blog articles: The illustrated transformerThe illustrated BERT, elmo, and coMachine Learning Explained blog: An In-Depth Tutorial to AllenNLP (From Basics to ELMo and BERT)Paper Dissected: “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” ExplainedReferences/notes:GPT-2 blog post from OpenAIGPT-2 PaperGPT-2 GitHub RepoGPT-2 PyTorch implementationEpisode 22 of Practical AI about BERTOpenAI’s GPT-2: the model, the hype, and the controversy (towardsdatascience)The AI Text Generator That’s Too Dangerous to Make Public (Wired)Transformer paperPreparing for malicious uses of AI (OpenAI blog)Upcoming Events: Register for upcoming webinars here!

While at Applied Machine Learning Days in Lausanne, Switzerland, Chris had an inspiring conversation with Anna Bethke, Head of AI for Social Good at Intel. Anna reveals how she started the AI for Social Good program at Intel, and goes on to share the positive impact this program has had - from stopping animal poachers, to helping the National Center for Missing & Exploited Children. Through this AI for Social Good program, Intel clearly demonstrates how a for-profit business can effectively use AI to make the world a better place for us all.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Anna Bethke – LinkedIn, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:AI for Social Good at IntelNational Center for Missing & Exploited ChildrenData for DemocracyData KindDelta AnalyticsDriven DataPartnership on AITech Jobs for GoodApplied Machine Learning DaysUpcoming Events: Register for upcoming webinars here!

Chris sat down with Marta Martinez-Cámara and Miranda Kreković to learn how GirlsCoding.org is inspiring 9–16-year-old girls to learn about computer science. The site is successfully empowering young women to recognize computer science as a valid career choice through hands-on workshops, role models, and by smashing prevalent gender stereotypes. This is an episode that you’ll want to listen to with your daughter!Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Marta Martinez-Cámara – WebsiteMiranda Kreković – WebsiteChris Benson – Website, GitHub, LinkedIn, XShow Notes:GirlsCoding.orgGirlsCoding.org on TwitterGirlsCoding.org on LinkedInGirlsCoding on FacebookGirlsCoding.org at Applied Machine Learning DaysApplied Machine Learning DaysÉcole Polytechnique Fédérale de LausanneUpcoming Events: Register for upcoming webinars here!

Chris caught up with Jennifer Marsman, Principal Engineer on the AI for Earth team at Microsoft, right before her speech at Applied Machine Learning Days 2019 in Lausanne, Switzerland. She relayed how the team came into being, what they do, and some of the good deeds they have done for Mother Earth. They are giving away $50 million (US) in grants over five years! It was another excellent example of AI for good!Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Jennifer Marsman – GitHub, XChris Benson – Website, GitHub, LinkedIn, XShow Notes:Jennifer Marsman’s blogAI for EarthProject Premonition (mosquitos/genomics)FarmBeats (agriculture)Wildbook (recognizing individual animals) #1Wildbook (recognizing individual animals) #2Repository of data setsMicrosoft Green TwitterUpcoming Events: Register for upcoming webinars here!

Fully Connected – a series where Chris and Daniel keep you up to date with everything that’s happening in the AI community.If you’re anything like us, your New Year’s resolutions probably included an AI section, so this week we explore some of the learning resources available for artificial intelligence and deep learning. Where you go with it depends upon what you want to achieve, so we discuss academic versus industry career paths, and try to set you on the Practical AI path that will help you level up.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:CoursesAmazon Machine Learning with AWSGoogle Machine Learning Crash Course with TensorFlow APIsMicrosoft Professional Program for Artificial IntelligenceCoursera / deeplearning.aiNVIDIA Deep Learning InstituteGoogle, Amazon, Microsoft: How do their free machine-learning courses compare?Stanford Machine Learning Videos on YouTubeBooks“Deep Learning” by Ian Goodfellow, Yoshua Bengio, and Aaron Courville“Natural Language Processing with PyTorch” by Delip Rao and Brian McMahan“Machine Learning With Go” by Daniel Whitenack and Janani Selvaraj(Daniel is too humble to put his own book in this list, so Chris inserted it above without Daniel’s knowledge - because it’s a damn fine book!)Hybrid resourcesMachine learning with TensorFlow crash course Intro to deep learning with PyTorch Spinning Up in Deep RLMeetupsPyData Atlanta Deep Learning MeetupUpcoming Events: Register for upcoming webinars here!

Ajay Royyuru and Guillermo Cecchi from IBM Healthcare join Chris and Daniel to discuss the emerging field of computational psychiatry. They talk about how researchers at IBM are applying AI to measure mental and neurological health based on speech, and they give us their perspectives on things like bias in healthcare data, AI augmentation for doctors, and encodings of language structure.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We catch our errors before our users do because of Rollbar. Resolve errors in minutes, and deploy your code with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Ajay Royyuru – WebsiteGuillermo Cecchi – Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:IBM 5 in 5: With AI, our words will be a window into our mental healthPredicting Cognitive Impairments with a Mobile ApplicationAutomated analysis of recent-onset and prodromal schizophreniaPrediction of psychosis across protocols and risk cohorts using automated language analysisUpcoming Events: Register for upcoming webinars here!

Fully Connected – a series where Chris and Daniel keep you up to date with everything that’s happening in the AI community.This week we look back at 2018 - from the GDPR and the Cambridge Analytica scandal, to advances in natural language processing and new open source tools. Then we offer our predications for what we expect in the year ahead, touching on just about everything in the world of AI.Sponsors:Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We catch our errors before our users do because of Rollbar. Resolve errors in minutes, and deploy your code with confidence. Learn more at rollbar.com/changelog. Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelogAlgolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:2018 in ReviewFocus on more challenging ML problemsSemi-supervised learningDomain adaptationGenerative modelsReinforcement learningNLPELMOBERTFear about AIGDPR, trust and privacyCambridge analyticaFacial recognitionTons of open sourced tooling, modelsPredictions for 2019Focus on trust and transparencyBiasRegulationGDPR and transparency, interpretabilityWhat will other countries do regarding regulation?AI for goodBetter voice and conversational resultsAI assistantsVoice interfacesNLP advancesMore focus on product development, less on researchDeep learning will explode in production product / service developmentComputer vision, NLP, speech recognition will be table stakesIncreased accessibility of DL to software engineers / developersMore testing/toolingBetter training for data scientistsBetter integrations and infrastructureAutoMLOrganizational / Cultural ShiftsNew roles for data-based leadership - CDO, CAIO, etc.,Strategy - AI becoming first-class concernCompetitive Analysis - AI and data assessments mandatoryFragmentation into distinct subfields - AI, analytics, data science, prognosticsA changing relationship between humans and automationAI + robotics - first stepsPervasive AI + IoT - first stepsThe importance of creative expertise for humansHow to school your child today to prep for tomorrowNarrowly-scoped, highly-specific job functions at most riskUpcoming Events: Register for upcoming webinars here!