Deployed: The AI Product Podcast

What It Takes to Run Agents on Billions of Messages: Kevin Stanton, Sprout Social

Feb 6, 2026
Kevin Stanton, distinguished engineer who built Trellis for social listening at Sprout Social, walks through running agents over billions of posts. He explains why chat UI helps seed eval data and why MCP/tool-calling fit their architecture. He covers scaling signals, collapsing costly tool chains, building eval pipelines from traces, and shifting teams toward fast, multidisciplinary agent development.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Tool Use Fits SaaS Workflows

  • Tool use felt like a more natural fit than RAG for applying LLMs to SaaS systems of record.
  • Kevin Stanton saw MCP as enabling agents to select and fetch relevant data from existing platform APIs.
ANECDOTE

Trellis: Chat Co-Pilot With UI Awareness

  • Trellis launched as a chat-based co-pilot inside Sprout used by thousands of beta customers.
  • It reads the UI context (search, filters, date range) to modulate tool calls and reduce friction.
ADVICE

Use Chat To Seed Real Eval Data

  • Use a conversational UI early to collect real user traces and seed eval datasets.
  • Conversation starters guide users and produce higher-quality, production-relevant prompts for evaluation.
Get the Snipd Podcast app to discover more snips from this episode
Get the app