Scaling experiments incrementally

AI is reshaping product development faster than most organizations can even rethink how they work—and that gap sits at the heart of this conversation with product design guru Jeff Gothelf. Lou and Jeff explore why proven methods like Agile and OKRs so often become “process theater” instead of real change, and what it actually takes to shift organizations from output-driven cultures to outcome-driven ones.

Jeff explains that most transformations fail because incentives still reward shipping outputs, not creating real value. Meaningful change tends to emerge only in pockets led by leaders willing to experiment and treat ways of working as something to test and evolve.

They also explore how AI is shifting risk upstream—from engineering to vision, validation, and decisionmaking—making design and research more critical than ever. Along the way, they reflect on consulting as organizational therapy, the need to prove design’s value in the AI era, and why companies that relentlessly embrace new technology are best positioned to endure.

 

What You'll Learn from this Episode:

• Why Agile, OKRs, and similar frameworks often fail to create real change
• The critical shift from measuring output to measuring outcomes
• The two traits shared by successful pockets of transformation in large companies
• How to run small, time-boxed experiments to change ways of working at scale
• Why AI makes design, research, and product thinking more valuable
• How to explain and prove the value of “thinking before the prompt” in AI-driven organizations

 

Quick Reference Guide:

0:10 - Meet Jeff Gothelf; Lou and Jeff discuss bridging the gap between ritual and cultural change

7:44 - Good ideas without a clear understanding of why

9:42 - What it takes for organizations to successfully communicate and incentivize 

15:21 - 5 reasons to use the Rosenverse

17:37 - Consultants validate insiders; AI shifts risk toward design clarity

24:20 - AI speeds output, but critical thinking, research, and testing prove designers’ value

27:50 - Jeff and Lou speculate on Amazon’s future

30:49 - Jeff’s gift for listeners

 

Resources and Links from Today's Episode:

Books by Jeff Gothelf https://jeffgothelf.com/books/ 

Ignorance by Milan Kundura https://www.amazon.com/Ignorance-Novel-Milan-Kundera/dp/0060002107 

 

Quotes:

“The types of conversations that we're having about good design, about good information architecture, about good research, about agility and customer centricity and all of those types of things, for some reason, those continue to be difficult conversations in organizations today.”

“The risk of engineering is no longer a risk, not like it was not five years ago. It's going to get cheaper and cheaper and cheaper. Where's the risk? The risk is in definition, vision, clarity, validation. In other words, it's in design, discovery, research, product management.”

“The differentiation, the uniqueness, the creativity, the innovation is going to come from the critical thinking of the designers and the researchers who are actually doing the thinking before the prompt.”