EvalNetwork

EvalNetwork

0,0 (0)
Non-profit
Maandelijks bijgewerkt

Program Evaluation and Research Consulting

14-05-2024

The Power of Retrospective Pretests to Address Common Survey Research Challenges

James Pann interviews Melanie Hwalek, Ph.D., an evaluation researcher and consultant, to discuss the retrospective pretest (RPT) design, focusing on its practical applications and the findings from her recent research detailed in the paper, “Designing a Questionnaire with Retrospective PrePost Items: Format Matters.” Below, I break down what a retrospective pretest is, when it works...
02-10-2023

Empowering Change: David Fetterman on Using Evaluation to Build a Better World

James Pann interviews David Fetterman, Ph.D., a leading figure in empowerment evaluation. David introduced empowerment evaluation during his 1993 presidential address at the American Evaluation Association, and the approach has since been adopted in more than 16 countries across government agencies, nonprofits, school systems, and community organizations. In this conversation, we discuss what empowerment evaluation...
19-09-2023

From Lecture Halls to Real-World Calls: Tiffany Berry’s Evaluation Insights

Whether you're an educator, a student, or simply someone passionate about youth development and educational programs, this podcast episode with Tiffany Berry, PhD., promises to give you insights into the complex world of evaluation. She is the Dean and a full research professor in the Division of Behavioral & Organizational Sciences at Claremont Graduate University, where she also received her Ph.D. Her research interests include Educational Program Evaluation, Educational Curricula, Comprehensive School Reform, after-school services, social-emotional learning, and other areas. She has published over 75 technical evaluation reports and peer-reviewed articles in leading evaluation and youth development journals. See XXXXX for a detailed description of the interview. OUTLINE: 0:00 Overview of episode 2:07 Evaluation models and conceptual models she uses 8:56 Common challenges Tiffany encountered evaluating educational programs 11:59 Challenges in measuring youth development outcomes 17:36 Changing her evaluation approach due to unforeseen circumstances or changes in the program 23:00 How to stay current in the field of evaluation 28:10 Advice for those interested in becoming an evaluator 32:41 Advantages and disadvantages of getting a graduate degree in evaluation versus other disciplines 38:15 Credentialing in evaluation in the US 44:32 The uniqueness of Claremont’s evaluation program 49:40 Claremont’ Doctoral program in evaluation 55:09 Building a professional network in the evaluation field CONNECT WITH JAMES: - Subscribe to this YouTube channel: https://www.youtube.com/user/jamesmpa... - LinkedIn: https://www.linkedin.com/in/pannjames/ Please reach out with comments and questions. Thanks!
11-04-2023

Mindfulness Meets Evaluation: Insights from Jim McDavid

In this episode, I talk with Jim McDavid, Ph.D., about his experience with mindfulness and meditation practice, how it has influenced him, and how it affects how he views and practices evaluation. Our conversation also covers practical wisdom, Jim’s interest in the environment, and challenges associated with determining cause and effect in evaluation. Jim is Professor Emeritus at the School of Public Administration, University of Victoria, which he joined as faculty in 1980. He was a recipient of the University of Victoria Alumni Teaching Award, and he received the University of Victoria’s highest academic honor, the UVic Distinguished Professorship Award. He has contributed significantly to the field of evaluation, and the reason I reached out to him related to his work related to mindfulness and evaluation. 00:00 Introduction 01:57 Jim’s definition of mindfulness 05:20 The ethical dimension of mindfulness 08:49 How Jim’s mindfulness practice has evolved over time 11:46 Difference between Transcendental Meditation and Vipassana 15:33 The spiritual dimension of meditation 22:10 Subjectivity of cause and effect 29:34 How mindfulness opens up the mind 35:52 Mindfulness can support evaluation practice 40:32 Connection to practical wisdom 44:45 Importance of being present and really listening in evaluation contexts 49:20 Judgment and evaluation 50:46 Starting a mindfulness practice For more go to: https://evalnetwork.com/mindfulness-meets-evaluation/
02-03-2023

Maximize Your Survey Response Rates: Expert Insights from Sheila Robinson

In this episode, James Pann, Ph.D., interviews Sheila Robinson, Ed.D., about the topic of surveys and response rates. We focus on the significance of response rates in surveys and the steps that can be taken to maximize them. Sheila is a career educator and professional learning designer with experience in K-12 public education and higher education, a certified program evaluator, and Certified Presentation Specialist (CPS™) with particular interests in survey design, data visualization, and presentation design. Read more here: https://evalnetwork.com/maximize-your-survey-response-rates Timeline 00:40 Why Sheila is interested in survey research 03:50 Why survey response rate is critical 05:15 The optimal response rate 07:37 Ensuring accurate demographic representation of the sample 09:30 How to improve response rate 12:01 The survey invitation message is critical 13:26 Transparency in the length of time to complete the survey is important 15:19 Survey reminders can be used tactically to improve the response rate 16:43 Incentives should be used carefully 20:46 Timing of incentives and the principle of reciprocity 23:08 Building survey completion time into program activities can increase response rate 26:17 Importance of piloting the survey prior to use 28:15 Who sends the survey is important 33:20 How to reach Sheila EPISODE LINKS: - Sheila's website: https://www.sheilabrobinson.com/ - Sheila's Linkedin: https://www.linkedin.com/in/sheilabrobinson/ CONNECT WITH JAMES: - Subscribe to this YoutTube channel: https://www.youtube.com/user/jamesmpann?sub_confirmation=1 - LinkedIn: https://www.linkedin.com/in/pannjames/ Please reach out with comments and questions. Thanks!
28-03-2022

Young Adult Cancer Survivors Increase Mindfulness and Connection During Nature Treks with David Victorson

James Pann, Ph.D., interviews David Victorson, Ph.D., of True North Treks, a nonprofit organization whose mission is to empower young adults and caregivers affected by cancer to “find direction through connection” and mindfulness. As a child, David grew up surrounded by nature and its many restorative benefits. Therefore, when he went on to complete his...
11-07-2021

What’s the difference between research and evaluation? with Dana Wanzer

James Pann, Ph.D. interviews Dana Wanzer, Ph.D., assistant professor of psychology in evaluation at the University of Wisconsin-Stout, about her American Journal of Evaluation paper “What is evaluation? Perspectives of how evaluation differs or not from research.” Dana surveyed members of the American Evaluation Association and the American Educational Research Association to find out how...
17-12-2020

The Importance of How We Define Evaluation with Amy Gullickson

In this interview, I speak with Amy Gullickson, acting Co-Director and Senior Lecturer at the Centre for Program Evaluation at Melbourne Graduate School of Education. She is also Chair of the International Society for Evaluation Education. We talk about what is the best definition of evaluation and why it is important to have a clear definition. Amy...
12-11-2020

Evaluative Thinking with Thomas Archibald

Thomas Archibald, Ph.D. is an Associate Professor and Extension Specialist in the Department of Agricultural, Leadership, and Community Education at Virginia Tech. His practice and research are focused primarily on program evaluation and evaluation capacity building. He serves as the Chief of Party/Director of the Feed the Future Senegal Youth in Agriculture project, funded by...
24-09-2020

Evaluation’s Role in Guiding Public Policy and Government with Rakesh Mohan

Rakesh Mohan has been the director of the Office of Performance Evaluations (OPE) an independent and nonpartisan agency of the Idaho State Legislature, since 2002. We cover important issues related to evaluation and how evaluation can guiding government and public policy. Under Rakesh’s direction, the office has received many awards, including the American Evaluation Association’s...

10 afleveringen

Program Evaluation and Research Consulting

Maker

EvalNetwork
Jaren actief

2015 - 2024
Afleveringen

10
Beoordeling

Veilig
Website van aflevering

EvalNetwork