MLOps.community The Agent Landscape - Lessons Learned Putting Agents Into Production
103 snips
Feb 20, 2025 
Paul van der Boor, VP of AI at Prosus Group, and Floris Fok, AI Engineer at the same group, dive into the evolving landscape of AI agents. They discuss the transition from basic models to interactive systems, exploring integration challenges akin to building a Mars Rover. The duo shares insights on generative AI risks and security innovations, the unique roles of AI engineers, and the critical balance between advanced capabilities and user-friendliness. With lessons from over 20 projects, their conversation is packed with practical takeaways for anyone in AI.
AI Snips
Chapters
Transcript
Episode notes
Why Use Agents and the Challenges They Face
- Agents expand task possibilities but face challenges in real-world application.
- Existing interfaces and APIs are not designed for agent interaction.
Prosus Internal Assistant Cost Dynamics
- Prosus' internal assistant's token usage increased by 150% while cost per token decreased by 50%.
- This highlights the shifting cost dynamics of more complex agent systems.
Prosus Agent Projects
- Prosus tested over 20 agent projects, with two achieving real-world use.
- One is a general assistant (Token) and the other is a SQL analyst.