Lenny's Podcast: Product | Career | Growth

chevron_right

How to measure and improve developer productivity | Nicole Forsgren (Microsoft Research, GitHub, Google)

whatshot 274 snips

Jul 30, 2023

Guest

Nicole Forsgren

Nicole Forsgren, a developer productivity and DevOps expert currently at Microsoft Research, digs into the intricacies of measuring developer productivity. She discusses frameworks like DORA and SPACE, shedding light on the benchmarks of excellence and frequent pitfalls to avoid. Nicole emphasizes the importance of a healthy developer experience, and her Four-Box framework provides a unique approach to analyzing data relationships. Listeners can expect actionable strategies to enhance team culture and productivity, all while embracing the evolving tech landscape.

01:16:17

forum

Ask episode

web_stories

AI Snips

view_agenda

Chapters

menu_book

Books

auto_awesome

Transcript

info_circle

Episode notes

volunteer_activism

ADVICE

DevOps Capabilities

Improve development capabilities, not just metrics, to improve speed and stability.
Focus on technical, architectural, and cultural capabilities for better outcomes.

insights

INSIGHT

SPACE Framework

The SPACE framework helps teams choose the right metrics to measure complex work.
It includes five dimensions: satisfaction, performance, activity, communication, and efficiency.

question_answer

ANECDOTE

Pull Request Pitfalls

A team wanted to improve pull requests by pinging reviewers every 15 minutes.
Nicole Forsgren advised against it, suggesting balanced metrics for efficiency, flow, and satisfaction.

Get the Snipd Podcast app to discover more snips from this episode

A Journey Through Developer Productivity and Experience

02:38 • 5min

chevron_right

Enhancing Developer Productivity and Experience

07:49 • 21min

chevron_right

Enhancing Developer Productivity through DORA and SPACE Frameworks

28:55 • 3min

chevron_right

Measuring Developer Productivity

31:34 • 9min

chevron_right

Navigating the Challenges of Developer Productivity Measurement

40:34 • 4min

chevron_right

Enhancing Developer Productivity

44:31 • 26min

chevron_right

Entertainment, Insights, and Product Innovation

01:10:05 • 6min

chevron_right

#2171

• Mentioned in 20 episodes

The DevOps handbook

Gene Kim

The DevOps Handbook provides a detailed and practical roadmap for improving IT in any organization by bridging the gap between development and operations teams. It includes case studies from companies like Google, Capital One, Netflix, and others, demonstrating how DevOps practices can enhance business outcomes. The book focuses on culture, automation, measurement, and sharing, and it extends the solutions presented in 'The Phoenix Project' to cover information security and compliance. The second edition features new case studies and insights from renowned researcher Dr. Nicole Forsgren.

#875

• Mentioned in 41 episodes

Accelerate

The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations

Nicole Forsgren

Gene Kim

Jez Humble

Accelerate presents the findings from four years of research, including data from the State of DevOps reports, to identify key capabilities that drive high performance in software delivery. The book focuses on 24 practices grouped into five categories: Continuous Delivery, Architecture, Product and Process, Lean Management and Monitoring, and Cultural. It provides practical guidance on how to apply these practices to improve team performance, reduce deployment pain, and enhance overall business value. The book is ideal for management at every level involved in digital transformation and software development.

#2933

• Mentioned in 16 episodes

How to Measure Anything

Douglas W Hubbard

Douglas Hubbard's "How to Measure Anything" provides a practical framework for quantifying even the seemingly unmeasurable. The book emphasizes the importance of understanding uncertainty and using Bayesian methods to improve decision-making. Hubbard presents a systematic approach to identifying and addressing sources of uncertainty, helping readers make more informed choices. The book is widely used by professionals in various fields, including business, engineering, and science. It offers valuable insights into the challenges of measurement and the importance of using data effectively to improve decision-making.

#346

• Mentioned in 80 episodes

Designing your life

How to Build a Well-Lived, Joyful Life

Dave Evans

Bill Burnett

Bill Burnett and Dave Evans

In this book, Bill Burnett and Dave Evans apply the principles of design thinking to help readers design and build a life that is both meaningful and fulfilling. The authors, who are also educators at Stanford University, emphasize the importance of prototyping, experimentation, and iteration in life design. They provide practical exercises and tools to help readers navigate life's challenges and create a future that aligns with their values and aspirations. The book is based on their highly successful course at Stanford and has been widely praised for its empowering and practical approach to life design.

#274

• Mentioned in 93 episodes

Ender's Game

Orson Scott Card

Set in a future where humanity is threatened by the Formics, an insect-like alien species, the novel follows Ender Wiggin, a child prodigy who is drafted into Battle School at the age of six. Ender undergoes intense military training, including zero-gravity battles and psychological manipulation, to prepare him to lead the human fleet against the Formics. The book explores themes of war, leadership, and the moral complexities of using children as soldiers. It is known for its deep and complex sensibilities, and its ability to pose profound questions about the nature of war and humanity.

#547

• Mentioned in 57 episodes

Good Strategy/Bad Strategy

The Difference and Why It Matters

Richard Rumelt

In *Good Strategy/Bad Strategy*, Richard Rumelt clarifies the distinction between effective and ineffective strategies. He argues that a good strategy is a specific and coherent response to overcoming obstacles, harnessing power where it will have the greatest effect. Rumelt debunks elements of 'bad strategy' such as equating goals, motivational slogans, and financial targets with actual strategy. He introduces the 'kernel' of strategy, which includes a diagnosis of the challenge, a guiding policy, and coherent action. The book uses diverse examples from business, nonprofit, and military contexts to illustrate these concepts and emphasizes the importance of analytical rigor and focused effort in strategy development.

This episode is brought to you by DX—a platform for measuring and improving developer productivity.

—

Dr. Nicole Forsgren is a developer productivity and DevOps expert who works with engineering organizations to make work better. Best known as co-author of the Shingo Publication Award-winning book Accelerate and the DevOps Handbook, 2nd edition and author of the State of DevOps Reports, she has helped some of the biggest companies in the world transform their culture, processes, tech, and architecture. Nicole is currently a Partner at Microsoft Research, leading developer productivity research and strategy, and a technical founder/CEO with a successful exit to Google. In a previous life, she was a software engineer, sysadmin, hardware performance engineer, and professor. She has published several peer-reviewed journal papers, has been awarded public and private research grants (funders include NASA and the NSF), and has been featured in the Wall Street Journal, Forbes, Computerworld, and InformationWeek. In today’s podcast, we discuss:

• Two frameworks for measuring developer productivity: DORA and SPACE

• Benchmarks for what good and great look like

• Common mistakes to avoid when measuring developer productivity

• Resources and tools for improving your metrics

• Signs your developer experience needs attention

• How to improve your developer experience

• Nicole’s Four-Box framework for thinking about data and relationships

—

Find the full transcript at: https://www.lennysnewsletter.com/p/how-to-measure-and-improve-developer

—

Where to find Nicole Forsgren:

• Twitter: https://twitter.com/nicolefv

• LinkedIn: https://www.linkedin.com/in/nicolefv/

• Website: https://nicolefv.com/

—

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• Twitter: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

—

In this episode, we cover:

(00:00) Nicole’s background

(07:55) Unpacking the terms “developer productivity,” “developer experience,” and “DevOps”

(10:06) How to move faster and improve practices across the board

(13:43) The DORA framework

(18:54) Benchmarks for success

(22:33) Why company size doesn’t matter

(24:54) How to improve DevOps capabilities by working backward

(29:23) The SPACE framework and choosing metrics

(32:51) How SPACE and DORA work together

(35:39) Measuring satisfaction

(37:52) Resources and tools for optimizing metrics

(41:29) Nicole’s current book project

(45:43) Common pitfalls companies run into when rolling out developer productivity/optimizations

(47:42) How the DevOps space has progressed

(50:07) The impact of AI on the developer experience and productivity

(54:04) First steps to take if you’re trying to improve the developer experience

(55:15) Why Google is an example of a company implementing DevOps solutions well

(56:11) The importance of clear communication

(57:32) Nicole’s Four-Box framework

(1:05:15) Advice on making decisions

(1:08:56) Lightning round

—

Referenced:

• Chef: https://www.chef.io/

• DORA: https://dora.dev/

• GitHub: https://github.com/

• Microsoft Research: https://www.microsoft.com/en-us/research/

• What is DORA?: https://devops.com/what-is-dora-and-why-you-should-care/

• Dustin Smith on LinkedIn: https://www.linkedin.com/in/dustin-smith-b0525458/

• Nathen Harvey on LinkedIn: https://www.linkedin.com/in/nathen/

• What is CI/CD?: https://about.gitlab.com/topics/ci-cd/

• Trunk-based development: https://cloud.google.com/architecture/devops/devops-tech-trunk-based-development

• DORA DevOps Quick Check: https://dora.dev/quickcheck/

• Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations: https://www.amazon.com/Accelerate-Software-Performing-Technology-Organizations/dp/1942788339

• The SPACE of Developer Productivity: https://queue.acm.org/detail.cfm?id=3454124

• DevOps Metrics: Nicole Forsgren and Mik Kersten: https://queue.acm.org/detail.cfm?id=3182626

• How to Measure Anything: Finding the Value of Intangibles in Business: https://www.amazon.com/How-Measure-Anything-Intangibles-Business/dp/1118539273/

• GitHub Copilot: https://github.com/features/copilot

• Tabnine: https://www.tabnine.com/the-leading-ai-assistant-for-software-development

• Nicole’s Decision-Making Spreadsheet: https://docs.google.com/spreadsheets/d/1wItAODkhZ-zKnnFbyDERCd8Hq2NQ03WPvCfigBQ5vpc/edit?usp=sharing

• How to do linear regression and correlation analysis: https://www.lennysnewsletter.com/p/linear-regression-and-correlation-analysis

• Good Strategy/Bad Strategy: The difference and why it matters: https://www.amazon.com/Good-Strategy-Bad-difference-matters/dp/1781256179/

• Designing Your Life: How to Build a Well-Lived, Joyful Life: https://www.amazon.com/Designing-Your-Life-Well-Lived-Joyful/dp/1101875321

• Ender’s Game: https://www.amazon.com/Enders-Game-Ender-Quintet-1/dp/1250773024/ref=tmm_pap_swatch_0

• Suits on Netflix: https://www.netflix.com/title/70195800

• Ted Lasso on AppleTV+: https://tv.apple.com/us/show/ted-lasso

• Never Have I Ever on Netflix: https://www.netflix.com/title/80179190

• Eight Sleep: https://www.eightsleep.com/

• COSRX face masks: https://www.amazon.com/COSRX-Advanced-Secretion-Hydrating-Moisturizing/dp/B08JSL9W6K/

—

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.

—

Lenny may be an investor in the companies discussed.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.lennysnewsletter.com/subscribe

Home Top podcasts Popular guests Top books