MLOps.community  cover image

How A Manager Became a Believer in DevOps for Machine Learning // Keith Trnka // MLOps Podcast #152

MLOps.community

00:00

Lambda vs. EKS: A Comparison

For us it was Lambda and ECS we didn't have actually Kubernetes experience I don't think in New York but so we did a bake off between two did some load testing. Surprisingly even for the machine learning workload without any provisioning and currency in our low test we found that Lambda had lower latency which shocked me. We would periodically have just you know cold start latency spikes on Lambda. Our real production traffic was not predictable enough for Lambda to scale gracefully.

Play episode from 52:51
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app