Evidence-Based Management

Center for Evidence-Based Management
  • 4.0 (1)
  • COURSES

This podcast is a study companion to the course on Evidence-Based Management from the Center for Evidence Based Management and Carnegie Mellon University. Hosted by CEBMa Fellow and 20 year change management veteran Karen Plum, each episode is dedicated to exploring some of the challenges, opportunities, issues, frustrations and lightbulb moments associated with learning to be more evidenced-based in organisational decision making.

  1. DEC 15

    Module 12 Aggregate - Weigh and pull together the evidence

    This episode was updated in 2025 to reflect changes to the online course relating to how best to aggregate the evidence (via parallel or serial approaches) and the importance of cross-validation with the parties contributing to the evidence. This episode accompanies Module 12 of the course, which explores how to bring together the various sources of evidence gathered throughout the process. It’s the stage where the question becomes “What does this really tell us?” and where ideas about confidence, belief, and openness to new evidence come to the fore. The episode looks at why existing beliefs can be so sticky, how confidence shifts as new information arrives, and how a little Bayesian thinking can help keep our perspectives flexible. There are also practical stories from the field, including how asking “How certain are you?” — or even framing a claim as a bet — can reveal far more than expected. The purpose of an evidence-based approach is to reduce uncertainty in decision making by examining likelihoods and probabilities, and this episode explores both how Bayes’ rule can support that and what to do when evidence appears to conflict. Contradictory evidence turns out to be far rarer than many students assume, and the discussion highlights how confidence levels can be surfaced and constructively challenged, and how cross-validation helps build shared understanding and ownership. Aggregation is reframed not as a technical exercise but as a human one: a process of dialogue, reflection, and sense-making. The episode considers how to handle myths and “zombie ideas,” and how to craft an evidence story that is both accurate and memorable. Above all, the message is to slow down, check assumptions, and involve others — because good decisions depend on understanding the evidence together rather than rushing to action. Further reading / sources mentioned during the episode: Nate Silver - "The Signal and the Noise" Host: Karen Plum  Guests: Eric Barends, Managing Director, Center for Evidence-Based Management Denise Rousseau, H J Heinz University Professor, Carnegie Mellon UniversityAdditional material with thanks to: Julia Galef - President and co-founder of the Center for Applied Rationality - YouTube videos  Find out more about the course here:   https://cebma.org/resources-and-tools/course-modules/  UPDATED EPISODES In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    29 min

  2. AUG 19

    Ask the experts

    This episode was recorded live with three evidence-based management experts, Denise Rousseau, Rob Briner and Eric Barends, answering and discussing questions sent in by teachers and students of the subject.  During the disucssion, we touched on many aspects of evidence-based management, including: Starting with basic principles rather than complex frameworks makes evidence-based management accessible to busy professionalsProblem identification is the most critical and often overlooked step in the evidence-based management processAI tools can support evidence-based decisions but require specific prompting and critical evaluation of outputsEvidence-based management works best as a team sport where colleagues help identify each other's blind spots - including biasesRather than trying to build a whole evidence-based culture, start with your sphere of influence and share evidence supportivelyBuilding evidence-based practices requires social networks of support within and outside organizations If you have questions about evidence-based management that you'd like addressed in future episodes, please send them to us. We're planning to make "Ask the experts" a regular feature of the podcast.   Host: Karen Plum Guests: Eric Barends - Managing Director, Center of Evidence-Based ManagementDenise Rousseau, H J Heinz University Professor, Carnegie Mellon University, Pennsylvania, USARob Briner, Professor of Organisational Psychology, Queen Mary University of London; Associate Research Director at Corporate Research Forum  Contact:  Eric Barends, Managing Director of the Center for Evidence-Based Management  In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    48 min

  3. JUL 1

    Module 5 Acquire evidence from the scientific literature

    This episode was updated in 2025 to reflect the use of AI tools such as Consensus and Google Scholar for searching academic databases. This episode accompanies Module 5 of the course, which focuses on gathering evidence from the scientific literature (academic studies) that will help us address the question we are trying to answer. This module aligns to chapter 6 of the Evidence-Based Management book. Modules 5, 6 and 7 all focus on the scientific literature, so when you listen to their corresponding podcast episodes, the picture will hopefully become more complete.  In this episode we discuss the process of searching for academic studies; the difference between everyday / managerial terms and academic constructs; how to find the right terms to search for; the importance of obtaining studies from the right sources, most especially peer reviewed academic journals; the difference between journals and “magazines”; and the importance of documenting the process you followed to identify your evidence base. We also explore how the peer review process and the meta-analysis help us get to the best available evidence.  Host: Karen Plum Guests: Eric Barends, Managing Director, Center for Evidence-Based Management Denise Rousseau, H J Heinz University Professor, Carnegie Mellon UniversityBarbara Janssen, Fellow of the Center for Evidence-Based Management  Find out more about the course here:   https://cebma.org/resources-and-tools/course-modules/  UPDATED EPISODES In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    37 min

  4. 06/01/2022

    Module 15 Building the capacity for evidence-based management

    This episode accompanies the last module of the course – module 15, which is all about building an evidence-based management capacity in organisations.  There are 3 levels – you as an evidence-based manager; your colleagues who you can influence and guide in evidence based approaches; and the skills, practices and processes in your organisation. We hear from several experts about ways to build on what you’ve learned, and how others have approached the development of evidence-based practices in their organisations, including the CIPD, the professional HR body, about how it promotes this practice among its membership. And you’re never alone, there are always others forging a path in evidence-based management who you can reach out to, learn from and share with. Host: Karen Plum  Guests: Eric Barends, Managing Director, Center for Evidence-Based Management Denise Rousseau, H J Heinz University Professor, Carnegie Mellon UniversityJonny Gifford, Senior Researcher, CIPD, the professional body for HR and people development with a worldwide community of 160k membersDavid Creelman, CEO of Creelman Research and an expert of HR strategy, analytics and learningStefanie Nickel, Global Head of Diversity & Inclusion, pharmaceutical manufacturer Sandoz, part of the Novartis GroupSteven ten Have, Partner TEN HAVE Change Management & Professor of Strategy and Change at VU University AmsterdamFind out more about the course here:   https://cebma.org/resources-and-tools/course-modules/  In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    30 min

  5. 05/25/2022

    Module 14 Assess - evaluate the outcome of the decision taken

    This episode accompanies Module 14 of the course, which is about evaluating the outcome of the decision we’ve taken or the solution we implemented. This is the last stage of our evidence-based management process and is vital to ensuring that we learn from what we’ve done. Assessing outcomes is vital, because otherwise, how do we know if what we did was effective, and how can we learn and develop our approach to decision making?  Did we capture a baseline before the decision was implemented? And was the decision implemented as planned? If we assess outcomes without these two, then conclusions could be very suspect. We continue our case study of the large trial at pharmaceutical organization Sandoz (part of Novartis Group), and find out how the D&I interventions were assessed. Denise Rousseau's 2020 paper: Making Evidence based organisational decisions in an uncertain world  After action review paper: https://www.cebma.org/wp-content/uploads/Guide-to-the-after_action_review.pdf  Host: Karen Plum  Guests: Eric Barends, Managing Director, Center for Evidence-Based Management Denise Rousseau, H J Heinz University Professor, Carnegie Mellon UniversityStefanie Nickel, Global Head of Diversity & Inclusion, pharmaceutical manufacturer Sandoz, part of the Novartis GroupAdditional speaker, courtesy of CIPD: Niamh McNamara, Global Head of People & Organisation, Novartis  Find out more about the course here:   https://cebma.org/resources-and-tools/course-modules/  In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    29 min

  6. 05/25/2022

    Module 13 Apply - incorporating evidence into decision-making

    This episode accompanies Module 13 of the course, which is about incorporating evidence into the decision making process. Is the evidence appropriate for our situation (is it generalizable). Can we (and should we) action  the evidence? And what are the practical aspects associated with using the evidence that we’ve gathered? The real world is messy and complex, so there are many things to take into consideration. We share real world examples  from professional HR body CIPD, Creelman Research and a large trial at pharmaceutical organization Sandoz (part of Novartis Group), which shows not only the power of capturing stakeholder experiences, but the value of keeping interventions simple and practical.   Host: Karen Plum  Guests: Eric Barends, Managing Director, Center for Evidence-Based Management Denise Rousseau, H J Heinz University Professor, Carnegie Mellon UniversityJonny Gifford, Senior Researcher, CIPD, the professional body for HR and people development with a worldwide community of 160k membersDavid Creelman, CEO of Creelman Research and an expert of HR strategy, analytics and learningStefanie Nickel, Global Head of Diversity & Inclusion, pharmaceutical manufacturer Sandoz, part of the Novartis Group  Find out more about the course here:   https://cebma.org/resources-and-tools/course-modules/  In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    31 min

  7. 04/25/2022

    Module 11 Appraise evidence from stakeholders

    This episode accompanies Module 11 of the course, which is about appraising evidence from stakeholders – the people affected by our decision or the people who are able to influence it. The acquisition of this evidence is covered in Module 10 and its corresponding podcast episode. In this episode we are reminded that sometimes we engage with certain parties as practitioners (those with experience in the problem or solution we’re working with) and sometimes as stakeholders – with feelings and perceptions about how our decision will impact them, and how they might want to affect it, if they have sufficient power.  We hear several examples from the guests about stakeholder situations  which show how things can be quite complicated, with lots of things at stake. We consider a number of ethical considerations, because at the end of the day, even though it may be possible to make a decision and implement a solution, it is also necessary to ask – should we?  Stakeholder evidence has the potential to throw us off course, perhaps slowing down our timetable and complicating matters. But consider the consequences if we don’t know their perspectives and concerns or if we haven't weighed up whether their views are representative. There may be ethical, political, organisational and societal outcomes that could do irreparable harm.  Host: Karen Plum Guests: Eric Barends, Managing Director, Center for Evidence-Based Management Denise Rousseau, H J Heinz University Professor, Carnegie Mellon UniversitySteven ten Have, Partner TEN HAVE Change Management & Professor of Strategy and Change at VU University AmsterdamDr Lisa J Griffiths, CEO, OzChild National Support Office Find out more about the course here:   https://cebma.org/resources-and-tools/course-modules/  In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    33 min

  8. 04/24/2022

    Module 10 Acquire evidence from stakeholders

    This episode accompanies Module 10 of the course, which is about acquiring evidence from stakeholders – the people affected by our decision or the people who are able to influence it. The appraisal of this evidence is covered in Module 11 and its corresponding podcast episode. In this episode we explore the nature and extent of stakeholder individuals and groups – from governments and regulators, to organisational shareholders, the people implementing the decision and those that will live with the consequences. Rather than assuming that we know how these groups will react to our plans or solutions, we have to consult them.  In the experience of the guests, there is much to be learned which will inform and enrich the decision making process – including gaining an understanding of the complexities of implementing solutions and unearthing consequences we might not have anticipated. Stakeholder engagement, assessment and management are all critical aspects of successfully implementing change – and understanding their points of resistance can help to unblock obstacles or just make the process smoother and the outcome more effective. Host: Karen Plum Guests: Eric Barends, Managing Director, Center for Evidence-Based Management Denise Rousseau, H J Heinz University Professor, Carnegie Mellon UniversityDr Lisa J Griffiths, CEO, OzChild National Support OfficeSteven ten Have, Partner TEN HAVE Change Management & Professor of Strategy and Change at VU University Amsterdam  Find out more about the course here:   https://cebma.org/resources-and-tools/course-modules/  In 2025 we updated two episodes to reflect changes in CEBMa's online Evidence-Based Management course: Episode 5 - acquiring evidence from the scientific literature (updated in June 2025); andEpisode 12 - aggregating the evidence sources (updated in December 2025)

    34 min
See All (18)

About

This podcast is a study companion to the course on Evidence-Based Management from the Center for Evidence Based Management and Carnegie Mellon University. Hosted by CEBMa Fellow and 20 year change management veteran Karen Plum, each episode is dedicated to exploring some of the challenges, opportunities, issues, frustrations and lightbulb moments associated with learning to be more evidenced-based in organisational decision making.

Information

  • Creator
    Center for Evidence-Based Management
  • Years Active
    2021 - 2025
  • Episodes
    18
  • Rating
    Explicit
  • Copyright
    © 2025 Center for Evidence-Based Management
  • Show Website
    Evidence-Based Management

You Might Also Like