The Product Podcast cover image

Shopify VP of Product on Transforming SaaS to AI-Native and Building $100B+ Agent-Led Commerce | Vanessa Lee | E288

The Product Podcast

00:00

Evaluating AI: building LLM judges (ACEs)

Vanessa demos Shopify's internal judge system (ACEs) for grading Sidekick conversations and defining quality metrics.

Play episode from 26:08
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app