The InfoQ Podcast

Mandy Gu on Generative AI (GenAI) Implementation, User Profiles and Adoption of LLMs

16 snips
Jul 7, 2025
Mandy Gu, a Senior Software Development Manager at Wealthsimple, dives into the world of Generative AI and its implementation in organizations. She discusses the critical role user profiles play in adopting large language models and shares insights from her journey overcoming challenges in AI program integration. Mandy highlights the importance of building robust infrastructure, developing proprietary LLM gateways for security, and creating tailored educational programs to boost user engagement. Tune in for valuable insights on enhancing workflow efficiency with AI!
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ANECDOTE

High LLM Adoption Examples

  • Nearly two-thirds of Wealthsimple employees use LLMs daily via an internal gateway.
  • Use cases include content generation, information retrieval, and optimizing client call workflows.
ADVICE

Control LLM Access Internally

  • Create an internal LLM gateway to control data privacy and usage.
  • Discourage external tools for work to mitigate security risks with sensitive info.
ADVICE

Best Practices for GenAI Lifecycle

  • Standardize model interactions through gateways and proxy servers to avoid data leaks.
  • Provide optimized configurations and prompt templates to maintain high usage standards.
Get the Snipd Podcast app to discover more snips from this episode
Get the app