The Method to Our Madness

staceymerola
  • 5.0 (2)
  • Social Sciences
  • Updated Biweekly

The Method to Our Madness is a podcast that explores the art, ethics, and impact of research and evaluation. Hosted by award-winning evaluator and musician Dr. Stacey Merola, and William Pate, who together have close to 50 years of evaluation experience, each episode dives into the stories behind the data. Join our two hosts as they discuss their trials and tribulations as program evaluators: how they engage stakeholders, ask questions, measure change, and translate findings into action.  From equity-driven frameworks to creative data storytelling, this show brings together thought leaders, community advocates, and methodologists to rethink what meaningful evidence looks like. Whether you're a seasoned researcher or just curious about how evaluation shapes the world, tune in for insights that are rigorous, resonant, and real. 

  1. 6d ago

    From Weeks to Minutes: How AI Is Transforming Research and Teaching

    What if the most tedious parts of your research workflow could shrink from months to minutes? In this episode, hosts Stacey Merola and William Pate sit down with Ron Wilson, Assistant Graduate Program Director for the GIS program at the University of Maryland Baltimore County, to explore how AI is reshaping the way researchers and educators work. Ron shares how AI went from helping him stress-test research ideas to slashing coding time, generating synthetic datasets, and building classroom visualizations in 20 minutes flat. But it's not all hype — Ron also gets candid about responsible AI use, the importance of prompt engineering, and why treating AI as a tool rather than a revolution is the key to getting real results. Whether you're a data professional, educator, or just AI-curious, this episode is packed with practical insight. Links to additional information For a summary of this episode, check out the notes here.  Learn more about the UMBC GIS graduate program here, including their GIS Master of Professional Studies which is a two-year (18 credits) program designed for early-to-mid-career professionals seeking a more foundational knowledge of GI that goes beyond learning the basics of technology or application of analytical tools.  For more information about this topic, check out the UMBC Mic’d Up Podcast where they recently released an episode on GIS and AI.  The podcast music was written and produced by Stacey Merola. The podcast artwork was created by Zoe Targino.

    46 min

  2. Jun 11

    The GovCon Stories Project: What Happens When Public Service Jobs Disappear

    What does it mean to be “DOGEd”? In this powerful episode of The Method to Our Madness Podcast, hosts Stacey and Bill sit down with sociologist Tara Fannon, Ph.D. to unpack the human impact behind the 2025 federal funding cuts—and the often-overlooked fallout for government contractors. Drawing from her GovCon Stories Project, Tara shares insights from a mixed-methods study of 92 surveyed contractors and in-depth interviews with 20 individuals affected by sudden layoffs. What emerges is a deeply personal look at job loss in a sector once seen as stable: stories of disrupted identities, financial strain, lost healthcare, and the emotional toll of feeling invisible and disposable.  This episode goes beyond the headlines to explore: The psychological impact of being laid off from mission-driven work How poor communication and lack of support compounded the crisis Why long-held assumptions about stability in government contracting no longer hold true How contractors are rebuilding—through entrepreneurship, upskilling, and new career paths  Despite the challenges, this conversation also highlights resilience. Many impacted professionals remain committed to public-service values while reimagining what equitable and sustainable work could look like in the future.  If you care about workforce equity, the future of government contracting, or the human stories behind economic disruption, this episode is a must-listen. A downloadable summary of the episode can be found here: Episode 14 notes If you are interested in finding out more about services provided by Mind the Movement, their website can be found here: Mind the Movement Podcast music written and produced by Stacey Merola. Podcast artwork created by Zoe Targino.

    29 min

  3. May 28

    Residuals, Red Flags, and Reality: Lessons in Evaluation Management

    In Episode 13 of The Method to Our Madness Podcast, we sit down with evaluation management expert Kirk Knestis to unpack the real-world challenges of managing evaluation firms and projects—and how to handle them like a pro. From avoiding scope creep to setting up airtight quality assurance processes, Kirk shares practical strategies that can make or break an evaluation project. He dives into why separating study protocols from contracts is essential, how to establish clear expectations with clients, and what it really takes to run evaluation work as a sustainable business. Through two cautionary “horror stories,” Kirk reveals common pitfalls—from misaligned reporting expectations to misunderstandings of statistical results—that can be problematic for even the most well-designed evaluations. Whether you’re leading projects, managing teams, or transitioning into independent consulting, this episode offers essential lessons on protecting your work, maintaining flexibility, and navigating client relationships with confidence. A longer summary of the episode can be found at Episode 13 Notes.  Podcast music written and produced by Stacey Merola. Podcast artwork designed and created by Zoe Targino.

    39 min

  4. May 14

    Training Tomorrow’s Evaluators in a Changing World

    What does it take to prepare the next generation of evaluators to meet the challenges of a changing world? This episode dives into the shifting demands on the field, from federal funding uncertainty to the growing influence of AI tools, and the skills future evaluators will need to rise to the challenges. Our guests from the University of Minnesota discuss how future evaluators should be trained to think systemically, challenge assumptions, and act as collaborative problem-solvers, as well as possibly be prepared for an employment model based on project work, rather than extended tenure at one organization. Whether you're in education, public policy, or nonprofit work, this conversation offers timely insight into how evaluation is being redefined for the future.   Our guests this week from the University of Minnesota are: John Hitchcock, Ph.D., Professor of Evaluation Studies and Marilyn Sime Professor for Educational Excellence, hitch141@umn.edu Jodi Benenson, Ph.D., Associate professor in the Department of Organizational Leadership, Policy, and Development in the College of Education and Human Development, benenson@umn.edu Stuart Yeh, Ph.D., Professor and Coordinator of Graduate Programs in Evaluation Studies, yehxx008@umn.edu   We cover a lot of topics in this episode, so if desired, a written summary can be found here: Episode 12 summary   Podcast music written and produced by Stacey Merola. Podcast artwork by Zoe Targino.

    47 min

  5. Apr 30

    Logic Models: Keeping them Simple, Useful, and Dynamic

    Logic models don’t have to be complicated or static. In this conversation with guest Deborah Levy, Stacey and Bill discuss why simplicity matters, how logic models should evolve over time, and what happens when programs face unexpected challenges like shifting audiences or external disruptions. The episode also offers practical tips for engaging stakeholders, collecting data, and using logic models as living tools throughout an evaluation.    Podcast music written and produced by Stacey Merola. Podcast artwork by Zoe Targino.

    32 min

  6. Apr 16

    The Practice and Judgement Behind Measuring Fidelity of Implementation

    Fidelity of implementation is often talked about but rarely understood. In Episode 10 of The Method to Our Madness, Allan Porowski, Principal Associate at Abt Global, brings clarity to this critical concept in program evaluation. Drawing on years of experience and large‑scale evaluation work, Allan explains why fidelity metrics must be tailored to each program, how planned‑offered‑received frameworks reveal meaningful variation, and why imperfect implementation can still drive valuable insight. This episode offers practical wisdom for evaluators seeking to interpret results with context, nuance, and purpose.   Podcast music written and produced by Stacey Merola. Podcast artwork by Zoe Targino.

    32 min

  7. Apr 2

    Keeping Statistics Useful: From Descriptive Data to Meaningful Impact

    In this episode of The Method to Our Madness, Stacey and Bill unpack the different types of statistics commonly used in program evaluation—and why “simple” doesn’t mean unsophisticated. They explore how evaluators balance accessibility with rigor, discussing when descriptive statistics, t-tests, and ANOVA are the right tools, and when more advanced methods like hierarchical linear modeling or propensity score matching make sense. Along the way, they dig into the hidden complexity behind clean-looking results, the limits of common data visualization tools, and why effect sizes often matter more than p-values. Drawing on real research experiences, disciplinary perspectives from sociology and psychology, and lessons learned from both practice and academia, this conversation highlights what it really takes to produce statistical findings that are both credible and useful. The episode wraps up with a reflection on communicating results clearly—and an open invitation for listeners to suggest future topics they’d like to explore in greater depth.   Podcast music written and produced by Stacey Merola. Podcast artwork by Zoe Targino.

    38 min

  8. Mar 18

    Different Types of Evaluation

    What’s the difference between formative, process, outcome, and impact evaluation? When should you actually use each one? In this episode, Stacey and Bill break down the why and when of evaluation, drawing on real-world examples from education, training programs, and policy work. They talk implementation fidelity, stakeholder engagement, logic models, and why not every evaluation is about proving causality. The takeaway: good evaluation is about learning, improvement, and usefulness—not just measurement.   Music written and produced by Stacey Merola. Podcast artwork by Zoe Targino.

    36 min
See All (15)

Ratings & Reviews

5
out of 5
2 Ratings

About

The Method to Our Madness is a podcast that explores the art, ethics, and impact of research and evaluation. Hosted by award-winning evaluator and musician Dr. Stacey Merola, and William Pate, who together have close to 50 years of evaluation experience, each episode dives into the stories behind the data. Join our two hosts as they discuss their trials and tribulations as program evaluators: how they engage stakeholders, ask questions, measure change, and translate findings into action.  From equity-driven frameworks to creative data storytelling, this show brings together thought leaders, community advocates, and methodologists to rethink what meaningful evidence looks like. Whether you're a seasoned researcher or just curious about how evaluation shapes the world, tune in for insights that are rigorous, resonant, and real. 

Information

  • Creator
    staceymerola
  • Years Active
    2025 - 2026
  • Episodes
    15
  • Rating
    Clean
  • Copyright
    © Copyright 2025 All rights reserved.
  • Show Website
    The Method to Our Madness