MLOps.community  cover image

Calibration for ML at Etsy - apply() special // Erica Greene and Seoyoon Park // MLOps Coffee Sessions #78

MLOps.community

00:00

How to Evaluate the Metrix?

We haven't explored isotonic regression yet, but a, it's relatively simple. So when we did with tense flow, it came to be pretty easy after we migrated towards it. The tricky part is just now with the calbrated scores a within the a space. In order to rank our listings, we actually have this ranking formula where we have a e cliptory diction and the prediction of another a model. We kind of combine it in a non linear fashion to order these ads in terms of relevance, revenue balancing objectives. But since the distribution of these a model outputs are different, o some of the order and changes in the final output has direct implications to cost charged lars

Play episode from 29:45
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app