689: Observing LLMs in Production to Automatically Catch Issues
Super Data Science: ML & AI Podcast with Jon Krohn
00:00
Detecting Data Distribution Changes in Production and Scalability Challenges with LLMs
This chapter emphasizes the significance of promptly and precisely identifying shifts in data distribution in production, with a spotlight on isolating the precise locations of drift or alterations and furnishing users with in-depth insights on the data points requiring scrutiny. ARISE products target resolving customer challenges associated with conventional drift detection techniques, particularly focusing on scalability, processing large volumes of data, and choosing the most suitable metrics for distinct use cases.
Play episode from 43:27
Transcript
