Public LLMs versus proprietary data

Christian Idiodi sits down with SVPG founder and partner Marty Cagan to reconsider a position SVPG has held for 20 years: that great product people are developed primarily through human coaching. Marty makes the case that foundation models, when grounded in the right operating model and strategic context, have crossed the threshold to serve as scalable, always-on product coaches. They’re not a replacement for managers, but a practical alternative for the 99% of product people whose managers lack the time or craft to coach them.

–

Today’s discussion unpacks:

• Why "model as coach" is a real shift, not a hype cycle

• What human managers still bring that an AI coach can’t

• The single most important instruction to give your LLM coach: which operating model to work in

• How to develop real product sense without outsourcing your thinking

• The surprising domains where an AI coach is becoming effective

–

References:

• Anthropic: https://www.anthropic.com/

• Claude Code: https://www.anthropic.com/claude-code

• Google Gemini: https://gemini.google.com/

• OpenAI: https://openai.com/

• Teresa Torres: https://www.linkedin.com/in/teresatorres/

–

SVPG on product coaching and AI:

• Product Coaching and AI: https://www.svpg.com/product-coaching-and-ai/

• AI Product Coach examples: https://www.svpg.com/examples/

–

Where to find Marty Cagan:

• LinkedIn: https://www.linkedin.com/in/cagan/

• SVPG profile: https://www.svpg.com/team/marty-cagan/

–

Where to find Christian Idiodi:

• LinkedIn: https://www.linkedin.com/in/cidiodi/

• SVPG profile: https://www.svpg.com/team/christian-idiodi/

–

Where to find SVPG:

• SVPG's newest book, TRANSFORMED: https://www.svpg.com/books/transformed/

• Other books: https://www.svpg.com/books/

• Articles: https://www.svpg.com/articles/

• Workshops: https://www.svpg.com/

• Videos: https://www.svpg.com/videos/
  

–

Timestamps:

00:00 Introduction

01:14 Why this is a shift from 20 years of coaching advocacy

03:28 When AI crossed the "good enough" threshold

07:11 The role for human managers alongside an AI coach

10:33 AI exposing product management theater

15:25 Coaching product creators vs. product leaders

18:36 How an AI coach can help you develop product sense

24:46 Are the public LLMs enough without proprietary data?

26:34 The most important initial instruction to give your AI coach

30:30 How to feed your AI coach the right strategic context

33:34 Automating PRD generation is a fast track to bad products

35:10 How an AI coach can quickly onboard new PMs

38:11 Mitigating the non-deterministic nature of model answers

40:05 Can people become too dependent on their AI coach?

48:12 AI coaches are surprisingly good at understanding office politics

52:16 The rise of the triple-threat product builder

58:09 Where AI coaches still fall short

–

Disclaimer:

While this podcast is named "Product Therapy", it is not hosted by licensed therapists or mental health professionals, and it is in no way a substitute for professional mental health services. We recognize the importance of mental well-being and encourage anyone facing personal difficulties to seek support from qualified professionals. See https://findahelpline.com/

–

Production:

Production by supermix.io