MLOps.community Trustworthy Data for Machine Learning // Chad Sanderson // MLOps Meetup #93
MLOps Community Meetup #93! Two weeks ago, we talked to Chad Sanderson, Trustworthy Data for Machine Learning.
// Abstract
The most common challenge for ML teams operating at scale is data quality.
In this talk, Chad discusses how Convoy invested in a large-scale data quality effort to treat data as an API and provide a data change management surface to enable trustworthy machine learning.
// Bio
Chad Sanderson is the Product Lead for Convoy's Data Platform team, which includes the data warehouse, streaming, BI & visualization, experimentation, machine learning, and data discovery.
Chad has built everything from feature stores, experimentation platforms, metrics layers, streaming platforms, analytics tools, data discovery systems, and workflow development platforms. He’s implemented open source, SaaS products (early and late-stage) and has built cutting-edge technology from the ground up. Chad loves the data space, and if you're interested in chatting about it with him, don't hesitate to reach out.
// Related links
----------- ✌️Connect With Us ✌️-------------
Join our Slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, Feature Store, Machine Learning Monitoring, and Blogs: https://mlops.community/
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Chad on LinkedIn: https://www.linkedin.com/in/chad-sanderson/
Timestamps:
[00:00] Introduction to Chad Sanderson
[00:30] Chad's journey to Convoy
[04:25] Evolution of Convoy's platform
[10:33] Definition and measurement data quality of KPI's
[13:36] COVID-19 effect on the distribution data supply chain
[17:15] Justifying investments in ML
[20:00] Examples of data Convoy deals with and models they build
[20:50] Examples of techniques Convoy uses to maintain quality data
[21:00] Concept of a Data Contract
[21:53] Enterprise Data Model
[25:13] Feature store and reuse or use by the business
[28:32] Impact of COVID-19 on the data quality process
[31:54] Software engineers' reactions to the implementation of ideas
[33:21] Other value props
[37:54] Point of a framework to step back from full automation
[41:26] War stories
[45:49] Metrics layer
[50:17] Convoy is hiring!!!
Reach out to Chad at https://www.linkedin.com/in/chad-sanderson/ or chad.sanderson@convoy.com