MLOps.community cover image

The Long Tail of ML Deployment // Tuhin Srivastava // #161

MLOps.community

00:00

The Importance of Knowledge Distillation

The idea is to create generalized models that can be used for solving problems at a higher level. The first question you're gonna almost make is like, is there an objective truth here? And then the secondary question is like, what do I need to do to solve this? Maybe it's maybe like you need this response within 100 milliseconds, and you need to, and you don't want it to be very, very expensive because it's happening every three or four seconds. You're gonna have to get a smaller, more concentrated model. But I think intuitively, that that seems right.

Play episode from 28:54
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
 Get the app