MLOps.community Product Management in Machine Learning // Laszlo Sragner // MLOps Meetup #54
MLOps community meetup #54! Last Wednesday, we talked to Laszlo Sragner, Founder, Hypergolic.
Get the newsletter: https://go.mlops.community/YTNewsletter
// Abstract:
How my experience in quant finance and software engineering influenced how we ran ML at a London Fintech Startup. How to solve business problems with incremental ML? What's the difference between academic and industrial ML?
// Bio:
Laszlo worked as a quant researcher at multiple investment managers and as a DS at the world's largest mobile gaming company. As Head of Data Science at Arkera, he drove the company's data strategy, delivering solutions to Tier 1 investment banks and hedge funds. He currently runs Hypergolic (hypergolic.co.uk), an ML Consulting company helping startups and enterprises bring the maximum out of their data and ML operations.
// Takeaways
Continuous evaluation and monitoring are indistinguishable in a well-set-up product team. Separation of concerns (SE, ML, DevOps, MLOps) is very important for smooth operation, and low-friction team coordination/communication is key.
To be able to iterate business features into models, you need a modeling framework that can express these, which is usually a DL package.
DS-es are well motivated to go more technical because they see the rewards of it. All well-run (from the DS perspective) startups in my experience do the same.
// Related Links
Free eBook about MLPM: https://machinelearningproductmanual.com/
Lightweight MLOps Python package: https://hypergol.ml/
Blog: laszlo.substack.com
----------- Connect With Us ✌️-------------
Join our Slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Laszlo on LinkedIn: https://www.linkedin.com/in/laszlosragner/
Timestamps:
[00:00] Introduction to Laszlo Sranger
[02:15] Laszlo's Background
[09:18] Being a Quant, then influenced what you were doing with the Investment Banks?
[12:24] Do you think this can be applied in different use cases or specific to what you are doing?
[14:41] Do you have any thoughts of a potentially highly opinionated person?
[16:54] Product management in Machine Learning
[24:59] You have to be at a large company, or you have to have a large team? [26:38] What are your thoughts on MLOps products helping with product management for ML? Is it an overreach or scope creep?
[32:00] In the messy world of startups, due to the high cost of an MVP for NLP, is RegEx, which means to incorporate user feedback, it's incorporated by tweaking RegEx?
[33:04] Do the ensemble recent models more than older models? If so, what is the decay rate of weights for older models?
[35:40] Since the iterative management model is generic enough for most ML projects, which component of it can be easily generalized, and what tools are built for version control?
[36:38] Topic Extraction: What type of model do you train for that task?
[52:55] Thoughts on Notebooks
[53:34] "I don't hate notebooks. Let's be clear about that. I put it this way: notebooks are whiteboards. You don't want your whiteboards to be your output because they're a sketch of your solution. You want the purest solution."