
Deployed: The AI Product Podcast What It Takes to Run Agents on Billions of Messages: Kevin Stanton, Sprout Social
Feb 6, 2026
Kevin Stanton, distinguished engineer who built Trellis for social listening at Sprout Social, walks through running agents over billions of posts. He explains why chat UI helps seed eval data and why MCP/tool-calling fit their architecture. He covers scaling signals, collapsing costly tool chains, building eval pipelines from traces, and shifting teams toward fast, multidisciplinary agent development.
AI Snips
Chapters
Transcript
Episode notes
Tool Use Fits SaaS Workflows
- Tool use felt like a more natural fit than RAG for applying LLMs to SaaS systems of record.
- Kevin Stanton saw MCP as enabling agents to select and fetch relevant data from existing platform APIs.
Trellis: Chat Co-Pilot With UI Awareness
- Trellis launched as a chat-based co-pilot inside Sprout used by thousands of beta customers.
- It reads the UI context (search, filters, date range) to modulate tool calls and reduce friction.
Use Chat To Seed Real Eval Data
- Use a conversational UI early to collect real user traces and seed eval datasets.
- Conversation starters guide users and produce higher-quality, production-relevant prompts for evaluation.

