Improving Development Evaluation

David Wand
  • 0.0 (0)
  • NON-PROFIT
  • EVERY TWO WEEKS

Join Dr. David Wand as he takes you on a provocative, investigative journey challenging Canadian & American international development organizations as well as international organizations to improve their performance measurement frameworks (PMFs) or Activity Monitoring and Evaluation (MEL) Plans. In Season 1, part 1 of the episode, Dr. Wand will introduce you to an international development organization and one of its projects where flaws in their PMF will be identified. In part 2 of the episode, the international development organization and evaluation experts will be invited to discuss Dr. Wand's critique and offer solutions to improving the evaluation of the project. For Season 2, Dr. Wand expands the scope of his podcast to include USA government funded international development projects by acquiring Activity Monitoring Evaluation Learning Plans (MEL Plans) or their equivalent as well as continue acquiring Canada government funded international development projects that require PMFs or their equivalent. For Season 2 the focus of the podcast has also been improved whereby several projects from the same international development organization are covered in the same episode exposing how the international development organization fails to properly measure and evaluate whether its expected outcomes have been achieved. This is despite these organizations falsely claiming on their websites that they have achieved these outcomes at the expense of the taxpayer.

  1. Failure of CUSO International to properly evaluate its 2 projects worth $7.5 Million

    17 DEC

    Failure of CUSO International to properly evaluate its 2 projects worth $7.5 Million

    Please sign the petition here https://www.change.org/EvaluateCanadaAid to have the Government of Canada require all Canadian taxpayer funded international development organizations release on their websites their Performance Measurement Frameworks (PMFs) or its equivalent and data for all output and outcome indicators listed in the PMF. CUSO International (www.cusointernational.org) has failed to properly measure and evaluate its 2 projects costing the Canadian taxpayer $7.5 Million. CUSO International cannot make the claim that it has achieved its outcomes for their 2 projects. This is based upon a review and critique of the Performance Measurement Frameworks (PMFs) for these 2 projects. This critique is explained for each outcome and outcome indicator from these 2 PMFs in this episode. These PMFs and PMF critique can be requested by emailing evaluatecanadaaid@gmail.com. Details on these 2 CUSO International projects is available here: Blueprints for Gender Equality https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p010478001 and Building Bricks Caribbean https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p013586001 For the Blueprints for Gender Equality CUSO International project, the PMF had 9 Outcomes with 13 Outcome Indicators. Only 1 of those Outcome Indicators was properly designed to support the claim that the Outcome was achieved. Even if it was achieved, no data was provided to support that claim. The remaining 12 poorly designed Outcome Indicators were poorly designed due to either self-reporting bias or conflict of interest when an external consultant should have been used instead to objectively measure whether the outcome was achieved. They used an external consultant for the 1 good Outcome Indicator but oddly refused to do it for the other Outcome Indicators!! Other poorly designed Outcome Indicators were due to measures that had nothing to do with whether the Outcome was achieved. For the Building Bricks CUSO International project, the PMF had 8 Outcomes and 15 Outcome Indicators. 4 of those Outcome Indicators were properly designed to support the claim that some of the Outcomes were achieved. Even if they were achieved, no data was provided to support that claim. The remaining 11 poorly designed Outcome Indicators were poorly designed due to either self-reporting bias or due to measures that had nothing to do with whether the Outcome was achieved. CUSO International has been invited to attend the podcast to provide a response to this critique of their project PMFs. The PMF critique and PMFs have been sent to CUSO International as well as the Secretary of State for International Development and the shadow critics for International Development. For a 20/15% discount on sunhats, sunglasses, and cotton polo shirts when visiting the Global South use this discount link: https://mydeals.page/1hjl Donate here: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL Or at buymeacoffee.com/davidwand to help the podcast

    51 min
  2. GCERF fails to show it is achieving its outcomes from spending $1.1 Million USD from Global Affairs Canada

    13 NOV

    GCERF fails to show it is achieving its outcomes from spending $1.1 Million USD from Global Affairs Canada

    In this episode, the Global Community Engagement Resilience Fund (GCERF) (www.gcerf.org) fails to evaluate the effectiveness of its $ 1.1 Million USD received from Global Affairs Canada. GCERF claims to be achieving its 4 outcomes by funding organizations in developing countries to deliver services to achieve those outcomes. But GCERF provides no measures on these outcomes through outcome indicators nor any data related to those outcome indicators in the document they sent to Dr. Wand. This document was a response to his request for the outcome indicators and their data used to measure changes in these outcomes. The 4 outcomes that GCERF claims to be achieving with this $1.1 Million USD Government of Canada funding are: Increased social cohesionIncreased ability to mobilize, organize, represent their own interests (agency)Increased knowledge, skills, and subsequent increases in income/livelihoods.Increased confidence, critical thinking, life skills, self-worth, resilience (sense of purpose).GCERF claims on its website, "At grant level, each project is guided by a theory of change and a results framework with outcome and output indicators, requiring grantees to collect baseline data, report quarterly, and conduct final assessments." GCERF is falsely claiming to Canadians that they have achieved these 4 outcomes because GCERF provides no outcome indicators nor data from these outcome indicators showing that social cohesion, agency, skills & income, or sense of purpose have increased. Dr. Wand has sent his critique of this GCERF document to the Secretary of State for International Development as well as the shadow critics for International Development. He has recommended that all funding to GCERF be suspended until outcome indicators and the data used to measure the achievement of these outcomes is provided on their website for all grants including this grant, if such outcome indicators and data exist. Sign the petition here to require GCERF to put all its PMFs and related data on its website: www.change.org/EvaluateCanadaAid GCERF has also been sent the critique of their response as well as an invitation to be on the podcast to respond and offer actions to address the absence of outcome measures for their expected outcomes or to respond in writing to evaluatecanadaaid@gmail.com. https://mydeals.page/1hjl Donate here to increase the number of organizations that receive performance audits like this one: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL Or at buymeacoffee.com/davidwand

    22 min
  3. Oxfam Canada (www.oxfam.ca) fails to evaluate its 2 projects worth $13,140,000: Care Connect and Camino Verde

    19 SEPT

    Oxfam Canada (www.oxfam.ca) fails to evaluate its 2 projects worth $13,140,000: Care Connect and Camino Verde

    Sign the petition here to require Oxfam to put all its PMFs and related data on its website: www.change.org/EvaluateCanadaAid In this episode, Dr. Wand reviews the Performance Measurement Frameworks (PMFs) for 2 Oxfam Canada (www.oxfam.ca) projects: Care Connect https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p012493001 at a cost of $5,950,000 and Camino Verde https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p005232001 at a cost of $7,190,000. He concludes from his review that Oxfam Canada has failed to design proper outcome indicators (with the exception of 2 outcome indicators out of 18 outcome indicators for the Care Connect project) to meet the Development Assistance Committee (DAC) criteria of achieving effectiveness or impact for these 2 projects. In addition, Oxfam Canada has failed to provide any outcome indicators in its PMF for 10 of the 14 outcomes listed in its Camino Verde project. Therefore, Oxfam Canada cannot make the claim that their projects are achieving their expected outcomes of effectiveness and impact. Dr. Wand has sent this episode along with his critique of the PMFs and the 2 original PMFs to the Secretary of State for International Development as well as the shadow critics for the Conservative party, the New Democratic Party, and the Bloc Quebecois party. He has recommended to all of these individuals that Government of Canada funding for these 2 projects be stopped immediately until proper outcome indicators are designed so that proper evaluation of the effectiveness and impact of these projects can be achieved. Oxfam Canada has also been sent this episode as well as the critique of the PMFs and the 2 original PMFs inviting them to respond to the critique, including an invitation to attend a future podcast to discuss their flaws in their project PMF outcome indicators as well as their proposed actions to address these flaws. If you wish to receive your discount on the purchase of sun hats, sunglasses, or polo shirts designed for the Global South, select the link below: https://mydeals.page/1hjl If you wish to make a donation to this podcast click on either of the links below: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL https://buymeacoffee.com/davidwand Listeners can receive the PMFs and my critique of the PMFs by sending an email to: evaluatecanadaaid@gmail.com

    45 min
  4. Global Community Engagement Resilience Fund (www.gcerf.org) fails to evaluate its $5 Million USAID funding

    7 FEB

    Global Community Engagement Resilience Fund (www.gcerf.org) fails to evaluate its $5 Million USAID funding

    In this episode, the Global Community Engagement Resilience Fund (www.gcerf.org) fails to evaluate its $ 5 Million USD received from the United States Agency for International Development. Although GCERF claims on its website to be achieving its 4 expected outcomes through funding its implementing partners in developing countries to deliver services to achieve those outcomes, they provide no evidence in the form of outcome indicators and any data related to those outcome indicators on its website. The 4 expected outcomes that GCERF claims to be achieving with this $5 Million USAID funding are: Increased social cohesionIncreased ability to mobilize, organize, represent their own interests (agency)Increased knowledge, skills, as well as subsequent increases in income/access to livelihoods.Increased confidence, critical thinking, life skills, self-worth, resilience (sense of purpose).In addition, letters from the USAID and U.S. State Department indicate that no records exist specific to results frameworks/outcome indicators and related data for these expected outcomes for this $5 Million USD given to GCERF from the US AID. GCERF is falsely claiming to the American people on their website with their taxpayer funds that they are achieving these expected outcomes because they provide no evidence on their website of achieving these outcomes in the form of outcome indicators and data to show that these expected outcomes have been achieved. As a result, the Improving Development Evaluation podcast has mailed a letter along with copies of the letters from the USAID and U.S. State Department to the Chairman of the Foreign Affairs Committee, Brian Mast, requesting that he request GCERF to post all their results frameworks, including all outcome indicators and data for those outcome indicators that measure the achievement of their 4 expected outcomes, from all the grants/projects produced by GCERF in collaboration with their implementing partners that have come from the original $5 Million USD that GCERF received from USAID up to September 15, 2023 specific to Activity ID; 77266; Project #: SCTOOP21VC004; International Sector: Government & Civil Society; USG Sector: Counter-Terrorism; Managing Agency: Department of State; Funding Agency: USAID https://mydeals.page/1hjl Donate here to increase the number of organizations that receive performance audits like this one: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL Or at buymeacoffee.com/davidwand

    15 min
  5. Doctors of the World: Flaws in its Performance Measurement Framework - Access to health rights Burkina Faso

    13/11/2024

    Doctors of the World: Flaws in its Performance Measurement Framework - Access to health rights Burkina Faso

    Sign the petition here to require Doctors of the World to put all its PMFs and related data on its website: www.change.org/EvaluateCanadaAid In this episode, Dr. Wand reviews the Government of Canada-funded $14 Million Doctors of the World https://medecinsdumonde.ca/ project entitled Access to health rights in Northern Burkina Faso. Details about the project can be found here: https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/P008979001 From a review of the project's Performance Measurement Framework (PMF), he concludes that Doctors of the World cannot claim that their project is responsible for achieving any of the 8 expected outcomes due to the absence of control or comparison groups as well as invalid or missing outcome indicators for some of the 8 expected outcomes for the project. Dr. Wand has emailed the link to this episode as well as the PMF and summary Excel critique to the Minister of International Development, Doctors of the World, and the shadow critics for international development for the Conservative Party, the NDP, and the Bloc Quebecois. Dr. Wand has also invited Doctors of the World to respond to his critique in writing and/or be attending his podcast. Listeners can receive the PMF and summary critique by emailing evaluatecanadaaid@gmail.com. https://mydeals.page/1hjl Donate here to increase the number of organizations that receive performance audits like this one: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL Or at buymeacoffee.com/davidwand #international development #evaluation

    31 min
  6. UNFPA Somalia reproductive health project: Flaws in the Performance Measurement Framework

    25/10/2024

    UNFPA Somalia reproductive health project: Flaws in the Performance Measurement Framework

    Sign the petition here to require UNFPA to put all its PMFs and related data on its website: www.change.org/EvaluateCanadaAid In this episode, Dr. Wand reviews the Government of Canada-funded $10 Million UNFPA Somalia project entitled Strengthening Sexual Reproductive Health and Rights through Midwives. Details about the project can be found here: https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p007483001 He reviews the Performance Measurement Framework (PMF) for this project and notes flaws in the outcome indicators whereby the UNFPA Somalia country office cannot claim that they have achieved the following project outcomes: Reductions in maternal mortality;Increased quality of midwifery trainingIncreased skill of midwifery associations to lead and advocate;Increased knowledge and awareness of maternal nutrition.However, properly designed outcome indicators in the PMF do support the opportunity to show the achievement of increased access to and use of sexual reproductive health services, although actual data needs to be provided. Listeners can receive the PMF and the full summary of the Excel outcome indicators by emailing evaluatecanadaaid@gmail.com. Those documents and this podcast will be shared with the Minister for International Development as well the shadow critics for the Conservative party, the NDP, the Bloc Quebecois, and the Green Party. https://mydeals.page/1hjl Donate here to increase the number of organizations that receive performance audits like this one: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL Or at buymeacoffee.com/davidwand #international development #UNFPA Somalia #evaluation

    27 min
  7. Season 2: Trailer

    SEASON 2 TRAILER

    Season 2: Trailer

    In this trailer, Dr. Wand outlines the following focus and changes in format and content for Season 2: The focus of the this podcast is to expose those Government of Canada funded international development organizations that are falsely claiming that their development outcomes are being achieved by reviewing their Performance Measurement Frameworks (PMFs). The podcast will not be reviewing charity or emergency projects such as the payment of school fees or cash transfers or the delivery of emergency services such as food, water, medical care, and shelter.Each episode will identify which of the following OECD Development Assistance Committee evaluation criteria have not been achieved: Relevance, Coherence, or Impact.The podcast will begin reviewing United States Agency for International Development projects by looking at Activity Monitoring Evaluation Learning Plans that are equivalent to the Canadian PMFs.Format changes will include: Combining the project description and a critique of its PMF/Activity MEL Plan into 1 episode; Focusing on a single international development organization with multiple projects that have poor evaluation design to invite to respond to our critique with evaluation experts.Dr. Wand invites experts in Outcome Harvesting, Most Significant Change, and Appreciative Inquiry to be interviewed to explain their contribution to proper evaluation by emailing him at evaluatecanadaaid@gmail.com.Dr. Wand will continue to email his critiques and episodes to the Minister for International Development and all other political parties as well as the international development organizations as proper evaluation is an issue for all Canadians.All PMFs/US AID Activity MEL Plans and their critiques are available upon request through evaluatecanadaaid@gmail.com.https://mydeals.page/1hjl Donate here to increase the number of organizations that receive performance audits like this one: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL Buy Me A Coffee here to support the podcast: buymeacoffee.com/DavidWand

    15 min
  8. UNDP Bangladesh: Episode 8 Part 2 Evaluation experts discuss flaws in the PMF and provide solutions on how the evaluation of the project can be improved

    28/06/2024

    UNDP Bangladesh: Episode 8 Part 2 Evaluation experts discuss flaws in the PMF and provide solutions on how the evaluation of the project can be improved

    Sign the petition here to require UNDP to put all its PMFs and related data on its website: www.change.org/EvaluateCanadaAid In this episode 8, part 2, Dr. Wand critiques the UNDP Performance Measurement Framework (PMF) for a $30 Million project in Cox's Bazar District Bangladesh entitled Fighting environmental degradation and promoting greener energy. You can learn more about the project here: https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p010741001. He concludes that the PMF is flawed and that UNDP www.undp.org needs to improve the design of its outcome indicators since only 2 out of the 9 outcome indicators are properly designed. He provides alternative indicators for the remaining 7 outcome indicators that are flawed that will actually evaluate the project properly. Finally, he suggests that even the Liquefied Petroleum Gas (LPG) should be replaced by either solar cookers or biogas which has been used in other refugee camps as an even greener energy compared to LPG. https://mydeals.page/1hjl Donate here to increase the number of organizations that receive performance audits like this one: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL Or at buymeacoffee.com/davidwand #UNDP #internationaldevelopment #evaluation

    21 min
See All (25)

Trailers

About

Join Dr. David Wand as he takes you on a provocative, investigative journey challenging Canadian & American international development organizations as well as international organizations to improve their performance measurement frameworks (PMFs) or Activity Monitoring and Evaluation (MEL) Plans. In Season 1, part 1 of the episode, Dr. Wand will introduce you to an international development organization and one of its projects where flaws in their PMF will be identified. In part 2 of the episode, the international development organization and evaluation experts will be invited to discuss Dr. Wand's critique and offer solutions to improving the evaluation of the project. For Season 2, Dr. Wand expands the scope of his podcast to include USA government funded international development projects by acquiring Activity Monitoring Evaluation Learning Plans (MEL Plans) or their equivalent as well as continue acquiring Canada government funded international development projects that require PMFs or their equivalent. For Season 2 the focus of the podcast has also been improved whereby several projects from the same international development organization are covered in the same episode exposing how the international development organization fails to properly measure and evaluate whether its expected outcomes have been achieved. This is despite these organizations falsely claiming on their websites that they have achieved these outcomes at the expense of the taxpayer.

Information