MLOps.community Engineering MLOps // Emmanuel Raj // MLOps Meetup #69
MLOps community meetup #69! Last Wednesday, we talked to Emmanuel Raj, Senior Machine Learning Engineer at TietoEvry.
Get the newsletter: https://go.mlops.community/YTNewsletter
// Abstract
The talk focuses on simplifying/demystifying MLOps, encourages others to take steps to learn this powerful SE method. We also talked about Emmanuel's journey in ML engineering, the evolution of MLOps, daily life, and SE problems, and what's next in MLOps (fusion of AIOps, EU AI regulations impact on MLOps workflow, etc).
// Bio
Emmanuel Raj is a Finland-based Senior Machine Learning Engineer. He is a passionate ML Researcher, Software engineer, speaker, and author. He is also a Machine Learning Engineer at TietoEvry and a Researcher at Arcada University of Applied Sciences in Finland. With over 6+ years of experience building ML solutions in the industry, he has worked on multiple domains such as Healthcare, Manufacturing, Finance, Retail, e-commerce, aviation, etc.
Emmanuel is passionate about democratizing AI and bringing state-of-the-art research to the industry. He has a keen interest in R&D in technologies such as Edge AI, Blockchain, NLP, MLOps, and Robotics. He believes the best way to learn is to teach, and he is passionate about teaching new technologies; that's one reason for writing a book and making an online course on MLOps.
Emmanuel is the author of the book "Engineering MLOps". The book covers industry best-case practices and hands-on implementation to rapidly build, test, and manage production-ready machine learning life cycles at scale. There is a big evolution happening in Data science for good, and we are moving away from notebooks and models sharing to a collaborative way of working via MLOps. We will discuss this big evolution of DevOps, MLOps, Data Engineering, Data Science, and Data-Driven business in the meetup.
----------- Connect With Us ✌️-------------
Join our Slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Emmanuel on LinkedIn: https://www.linkedin.com/in/emmanuelraj7/
// Related Links:
www.emmanuelraj.com
https://www.youtube.com/watch?v=m32k9jcY4pY
https://www.youtube.com/watch?v=1sGECHbc9zg
[00:00] Introduction to Emmanuel Raj
[03:37] Emmanuel’s Background in Tech
[04:18] Software Beyond Deterministic Rules
[05:48] Common Machine Learning Failures
[09:07] Real-World Testing Importance
[10:10] Onyx vs. Jupyter for Production
[12:13] Keep Solutions Lean and Simple
[12:20] Building Robust CI/CD Pipelines
[14:58] Monitoring the ML Lifecycle
[15:48] Developing AIOps Systems
[16:20] AIOps in CI/CD Pipelines
[19:33] Starting MLOps Capability Building
[22:00] Company Legacy Considerations
[24:47] Optimal Solutions Over Tools
[26:47] Open-Source Tools Discussion
[29:08] Security as a Roadblock
[31:00] What’s Next for MLOps
[32:08] Three Core MLOps Blocks
[34:40] MLflow Live Coding Highlights
[38:00] FastAPI Microservice Overview
[40:28] FastAPI Terminal Demo
[40:40] Local Testing with Locust
[40:56] Running Image and Container
[41:10] Predict Endpoint Post Request
[41:54] Load Testing Process
[43:47] Running Locust on Server
[44:38] Specifying the Endpoint
[45:20] Starting Locust Tests
[47:40] Pushing to Production
[48:15] Automating the Workflow
[50:00] Engineering MLOps Release Announcement