

Evidence-Based Management
Center for Evidence-Based Management
This podcast is a study companion to the course on Evidence-Based Management from the Center for Evidence Based Management and Carnegie Mellon University. Hosted by CEBMa Fellow and 20 year change management veteran Karen Plum, each episode is dedicated to exploring some of the challenges, opportunities, issues, frustrations and lightbulb moments associated with learning to be more evidenced-based in organisational decision making.
Episodes
Mentioned books

15 snips
Mar 24, 2022 • 32min
Module 9 Appraise evidence from the organisation
Join Martin Walker, a Banking & Finance Director, Eric Barends, Managing Director at the Center for Evidence-Based Management, Jeroen Stouten, a Professor of Organisational Psychology, and Ravishanker Jonnalagadda, a Data Science expert at Novartis. They delve into the pitfalls of over-relying on organisational data and the hype surrounding big data. The importance of distinguishing meaningful KPIs from misleading metrics is emphasized, alongside the necessity of using multiple evidence sources. Their insights highlight the critical need for transparency and ongoing validation in data analytics.

19 snips
Mar 23, 2022 • 30min
Module 8 Acquire evidence from the organisation
Eric Barends, Managing Director at the Center for Evidence-Based Management, and Martin Walker, Director for Banking & Finance at the same center, dive into evidence-based decision-making. They discuss the crucial differences between data, information, and evidence, and the pitfalls of overtrusting organizational data. Martin highlights how poor system design and siloed data can sabotage decisions. The duo emphasizes ethical concerns in data use and advises on measuring the right metrics rather than just the easy ones. Their insights encourage questioning and appraising evidence more critically.

17 snips
Feb 7, 2022 • 29min
Module 7 Appraise evidence from the scientific literature
Eric Barends, Managing Director of the Center for Evidence-Based Management, emphasizes the importance of a practical approach to evidence appraisal. Denise Rousseau from Carnegie Mellon University highlights the precision needed in academic language and the cognitive challenges of adopting new evidence-based practices. Rob Briner from Queen Mary University navigates the messy nature of scientific literature, advising listeners on effective search strategies. Together, they discuss the significance of matching research design to questions and the need for a balanced view of diverse evidence sources.

22 snips
Feb 4, 2022 • 28min
Module 6 A short introduction to science
Denise Rousseau is an expert in organizational research at Carnegie Mellon University, while Rob Briner teaches Organizational Psychology at Queen Mary University, and Eric Barends leads the Center for Evidence-Based Management. They explore how academics choose research topics based on interest and practicality. The guests discuss reading academic papers effectively, the significance of effect sizes, and the importance of comparing lab versus field studies. They also emphasize the need for control groups to differentiate between real and placebo effects in research.

22 snips
Dec 13, 2021 • 27min
Module 4 Appraise evidence from practitioners
Eric Barends, Managing Director at the Center for Evidence-Based Management, and Dr. Christina Rader, Associate Professor of Economics and Business, dive into the complexities of practitioner evidence. They highlight key biases like confirmation bias and outcome bias, stressing the importance of critical questioning. Eric outlines three criteria for assessing evidence reliability: experience volume, objective feedback, and stable environments. The duo also discusses how to distinguish evidence from opinion to improve decision-making in dynamic work settings.

24 snips
Dec 10, 2021 • 26min
Module 3 Acquire evidence from practitioners
Eric Barends, Managing Director at the Center for Evidence Based Management, emphasizes the importance of selecting practitioners with real experience over mere opinions. Denise Rousseau, a distinguished professor at Carnegie Mellon, offers practical tips on designing effective questionnaires and focus groups. Dr. Christina Rader from Colorado College shares the challenges students face in questioning authority figures and the importance of clear communication. Together, they explore techniques for avoiding biases and gathering reliable practitioner evidence.

18 snips
Nov 19, 2021 • 29min
Module 2 ASK critical questions
In this insightful discussion, Eric Barends, Managing Director at CEBMa, emphasizes the necessity of asking critical questions in decision-making. Denise Rousseau, a renowned professor at Carnegie Mellon, explores how to cultivate a culture of inquiry to improve organizational outcomes. They share techniques for framing problems accurately and avoiding premature solutions, advocating for respectful questioning to build trust. The conversation also covers the importance of engaging stakeholders for context and using logic models to clarify interventions, making a strong case for evidence-informed practices.

20 snips
Nov 12, 2021 • 31min
Module 1 Principles of evidence-based management
In this enlightening discussion, Eric Barends, Managing Director at the Center for Evidence-Based Management, emphasizes the importance of utilizing multiple reliable evidence sources in decision-making. Rob Briner, a Professor of Organizational Psychology, delves into the pitfalls of biases and the allure of management fads that often misguide organizations. They tackle how structured approaches can be daunting for leaders and urge a shift towards critically appraising claims from both practitioners and academics. Ultimately, they advocate for an evidence-based strategy to enhance decision quality.

15 snips
Nov 1, 2021 • 28min
Taking the course
Join Eric Barends, Managing Director at the Center for Evidence-Based Management, Denise Rousseau, H. J. Heinz University Professor, and Erin Czerwinski, Learning Engineering Manager at Carnegie Mellon University, as they explore innovative learning strategies. They discuss how the course emphasizes reflective practice over performance, the importance of learning by doing, and how diverse student experiences enhance understanding. Discover the ICAP framework's role in evidence-based design and how to apply skills effectively in real-world situations.

16 snips
Oct 25, 2021 • 28min
Course Introduction
The podcast introduces the contributors who have been promoting evidence-based management for 20 years. They discuss their motivations, frustrations in academia, challenges in practicing evidence-based management, and the progress made in closing the research practice gap.


