How to Be a Better Product Manager

Product managers should be working with ML folks a little bit more. It's hard to develop a deep rooted understanding of how users are using the product. You don't have to be a product person to do this sort of work but talking to those people and then working with somebody in product or doing yourself to figure out those metrics you want to move.

Play episode from 48:38

chevron_right

Transcript

chevron_right

Transcript

Episode notes

MLOps Coffee Sessions #170 with Phillip Carter, All the Hard Stuff with LLMs in Product Development.

We are now accepting talk proposals for our next LLM in Production virtual conference on October 3rd. Apply to speak here: https://go.mlops.community/NSAX1O

// Abstract

Delve into challenges in implementing LLMs, such as security concerns and collaborative measures against attacks. Emphasize the role of ML engineers and product managers in successful implementation. Explore identifying leading indicators and measuring ROI for impactful AI initiatives.

// Bio

Phillip is on the product team at Honeycomb, where he works on a bunch of different developer tooling things. He's an OpenTelemetry maintainer -- chances are, if you've read the docs to learn how to use OTel, you've read his words. He's also Honeycomb's (accidental) prompt engineering expert by virtue of building and shipping products that use LLMs. In a past life, he worked on developer tools at Microsoft, helping bring the first cross-platform version of .NET into the world and grow to 5 million active developers. When not doing computer stuff, you'll find Phillip in the mountains riding a snowboard or backpacking in the Cascades.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links⁠

Website: https://phillipcarter.dev/

https://www.honeycomb.io/blog/improving-llms-production-observability

https://www.honeycomb.io/blog/hard-stuff-nobody-talks-about-llm https://phillipcarter.dev/posts/how-to-make-an-fsharp-code-fixer/

The "hard stuff" post: https://www.honeycomb.io/blog/hard-stuff-nobody-talks-about-llm

Our follow-up on iterating on LLMs in prod: https://www.honeycomb.io/blog/improving-llms-production-observability

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack