Tried and Tested Podcast

PSI Services
  • 5.0 (4)
  • Business
  • Updated Monthly

Welcome to PSI’s Tried and Tested Podcast, hosted by Isabelle Gonthier. Tune in every other Thursday for expert conversations on testing, credentialing, and assessment. Each episode explores industry trends, practical insights, and the real work behind high stakes testing, featuring leaders and practitioners shaping the future of the assessment industry.

  1. 14h ago

    Reaching the Future Workforce: Messaging, Value, and Candidate Demand with NBCOT’s Angela Macauley

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Angela Macauley, PMP, President and CEO of the National Board for Certification in Occupational Therapy, about workforce demand, candidate pipelines, and the role credentialing organizations can play in helping professions stay visible, relevant, and understood. Drawing on nearly 20 years at NBCOT across marketing, communications, governance, strategy, and organizational leadership, Angela shares a broad perspective on the opportunities and challenges facing occupational therapy and the future professionals entering the field. As workforce needs shift and younger generations discover careers in new ways, Angela explains why credentialing organizations must think beyond certification as a final step and consider how they communicate value much earlier in the candidate journey. The conversation covers future-facing messaging, social media and digital outreach, education-to-workforce alignment, employer expectations, public protection, and how professions can make their pathways feel both credible and compelling to the next generation. What you’ll learn: Why candidate demand and workforce visibility are becoming strategic priorities for credentialing organizationsHow professions can communicate value before future candidates are actively thinking about certificationWhy occupational therapy must remain visible, understandable, and compelling to the next generationHow younger audiences discover careers through digital channels, peer networks, and online communitiesWhat future candidates need to understand about cost, time, flexibility, growth, and long-term relevanceWhere education, certification, and employer expectations may need stronger alignmentHow credentialing organizations can support public protection while making career pathways feel accessibleWhat workforce-led marketing can teach programs about messaging that resonates with prospective candidates Who should listen: Certification and credentialing leaders focused on workforce demandProgram leaders responsible for candidate pipelines and future growthMarketing and communications teams supporting credentialing or professional associationsOccupational therapy leaders and stakeholders thinking about the future of the professionEducation and workforce partners aligning preparation with employer needsOrganizations trying to make career pathways clearer, more visible, and more compellingLeaders balancing public protection, professional standards, and candidate engagement About the Guest: Angela Macauley is President and CEO of the National Board for Certification in Occupational Therapy (NBCOT), where she has spent nearly 20 years working across marketing, communications, governance, strategy, and organizational leadership. Her experience has given her a broad perspective on credentialing and the opportunities and challenges facing the occupational therapy profession. She leads NBCOT’s strategic direction and its work to uphold the standards that support safe, competent occupational therapy practice and advance its mission of public protection.

  2. Sep 3

    From School to Skills: Rethinking Assessment, Credentials, and Workforce Readiness with Chad Buckendahl

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Chad Buckendahl, PhD, ICE-CCP, Managing Partner at ACS Ventures, about how assessment, credentials, and workforce readiness can be better connected across the learner journey. Drawing on his work in program design, evaluation, standard setting, policy, legal issues, and validation studies across credentialing and education, Chad explores why school, work, and professional credentialing should not be treated as separate systems. As more education and credentialing leaders look for ways to connect classroom learning with future careers, Chad explains why durable skills, quantitative reasoning, data interpretation, and career-connected credentials deserve closer attention. The conversation covers credentials as checkpoints across lifelong learning, the role of high school in building workforce-ready skills, the risks of siloed systems, the importance of validity, reliability, and fairness, and why AI literacy should start with being a critical consumer of new technologies. What you’ll learn: How credentials can serve as checkpoints across a lifelong learning pathwayWhy school, workforce, and professional credentialing systems need stronger connectionsWhat durable skills, including reading, communication, and quantitative reasoning, mean for career readinessWhy data interpretation may be one of the most important skills students need for work and lifeHow high school credentials can help students explore career pathways without narrowing opportunityWhat education and credentialing leaders should consider before adding workforce credentials to school programsWhy AI literacy should focus on critical thinking, source credibility, and responsible useHow multidisciplinary learning can help people adapt as work, technology, and assessment continue to evolve Who should listen: Education and assessment leaders connecting school outcomes to workforce readinessCredentialing and certification professionals exploring earlier career pathwaysK-12 and secondary education leaders evaluating workforce-related credentialsEmployers and workforce development teams focused on durable skills and talent pipelinesPsychometricians and program evaluators working across education and credentialingPolicy and program leaders responsible for validity, fairness, and quality assuranceOrganizations thinking about how AI and technology should shape future-ready skillsAbout the guest: Chad Buckendahl, PhD, ICE-CCP, is a Managing Partner with ACS Ventures, LLC with an emphasis in program design, evaluation, standard setting, policy, and legal issues. Dr. Buckendahl has designed and led development and validation studies for programs in credentialing and education. He regularly contributes thought leadership through professional conference presentations, white papers, journal articles, and book chapters. He currently serves on the joint committee for the revision of the Standards for Educational and Psychological Testing, technical advisory committees in the United States, Canada, and the United Kingdom for diverse licensure, certification, and education programs; and previously served on volunteer committees for the Association of Test Publishers (ATP), Institute for Credentialing Excellence (I.C.E.), International Test Commission (ITC), and National Council on Measurement in Education (NCME).

  3. Aug 20

    Start Small, Build Trust, Scale Up: WPI’s Approach to AI in Credentialing

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Haley Vanness, CAE, ICE-CCP, CMP, AAiP, Vice President of Water Professionals International, about WPI’s journey toward building trust in AI adoption. Drawing on her work leading certification programs for water and wastewater professionals, Haley shares how WPI approached AI intentionally, starting with a practical use case that could support candidates, engage subject matter experts, and build confidence with the board and stakeholders. As credentialing organizations explore where AI can responsibly fit into program strategy, Haley explains why WPI began with practice exam development before expanding into broader operational opportunities. The conversation covers board confidence, stakeholder communication, SME review and oversight, candidate preparation, AI governance, application and renewal workflows, exam development, and why successful AI adoption depends on solving real problems, staying transparent, and scaling only after trust has been built. What you’ll learn: Why WPI chose practice exam development as a practical starting point for AI adoptionHow board oversight, stakeholder expectations, and public trust shaped WPI’s approachWhy AI adoption should begin with a real program need, not a technology announcementHow subject matter experts supported item development, rationales, references, and reviewWhat changes when SMEs move from manual creation toward validation, refinement, and oversightHow AI-supported practice tools can help candidates understand concepts, not just answer questionsWhere AI can support operations such as communications, applications, renewals, and candidate supportWhy governance, transparency, and human oversight are essential as AI use expands Who should listen: Credentialing and certification leaders exploring AI adoptionProgram owners balancing innovation, governance, and stakeholder trustAssessment professionals involved in item development, practice tests, or exam preparationSubject matter expert committees adapting to AI-supported workflowsLicensure and certification organizations serving public safety professionsOperations and product teams looking for responsible ways to use AIOrganizations moving from small AI pilots toward broader program strategy About the Guest: Haley Vanness is the Vice President of Water Professionals International (WPI), where she leads strategic initiatives and oversees the development and growth of certification programs serving water and wastewater professionals worldwide. During her tenure, she has played a key role in expanding WPI’s in-house certification programs, enhancing their value, improving operational efficiency, and increasing engagement across the industry. Her work focuses on advancing workforce development, modernizing credentialing practices, and integrating innovative solutions—including artificial intelligence—into certification and program operations. Haley collaborates closely with industry partners, subject matter experts, and organizational leadership to ensure programs remain relevant, data-driven, and aligned with evolving workforce needs. With a background in neuroscience, psychology, and credentialing, she brings a unique, analytical approach to program design and strategic decision-making. Haley is passionate about building sustainable systems, strengthening professional pathways, and supporting the continued growth and recognition of water professionals.

  4. Aug 6

    Taking the Future of Credentialing from Conversation to Practice with Pam Young Brown

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Pam Young Brown, a product strategy consultant working at the intersection of skills assessment, credentialing, and workforce development. Drawing on her experience leading certification and learning products at Amazon Web Services and the Graduate Management Admission Council, Pam shares a practical perspective on where credentialing is headed and what it takes to build programs that remain meaningful as skills, technology, and workforce expectations evolve.  As organizations move from talking about the future of credentialing to actually building it, Pam explains why modernization must start with customer needs, clear outcomes, and a realistic view of organizational risk. The conversation covers shorter skill shelf lives, lifelong learning, microcredentials and badges, employer trust, technology-enabled assessment experiences, the role of AI in exam development and security, and how credentialing organizations can balance innovation, speed, rigor, and credibility.  What you’ll learn: Why the pace of change is forcing credentialing organizations to rethink how quickly programs evolve How shorter skill shelf lives are reshaping certification, microcredentials, and lifelong learning Why credentialing should tell a broader story about a person’s skills, experience, and growth What learners and employers need in order to understand and trust newer credentialing models How technology can improve exam development, security, and candidate experience when tied to a clear strategy Why speed and efficiency should not come at the expense of quality, validity, or reliability How organizations can balance incremental improvements with more disruptive innovation Where to start when moving from future-of-credentialing conversations to practical action Who should listen: Credentialing and certification leaders modernizing their programs Assessment professionals balancing innovation, rigor, and trustProduct leaders building skills assessment or workforce learning solutions Workforce development teams focused on upskilling and future-ready talent Organizations exploring microcredentials, badges, or new skill recognition models Employers and talent leaders evaluating how credentials signal capability Teams trying to move from strategy discussions to practical implementation About the guest: Pam Young Brown is a product strategy consultant working at the intersection of skills assessment, credentialing, and workforce development. She was previously the product leader for the certification program at Amazon Web Services and director of product management at the Graduate Management Admission Council.  At AWS, Pam revamped the AWS Certification portfolio, expanding into AI certifications, accelerating time to market, and introducing new microcredentials to meet the evolving needs of tech learners. At GMAC, she led the digital transformation of the test prep product portfolio, forging new partnerships and launching digital learning offerings to support candidates preparing for graduate management education.  With over a decade of experience shaping credentialing products at two of the most recognized names in assessment, Pam brings a practitioner's perspective on where the industry is headed and what it takes to build credentials that are meaningful and future-ready.

  5. Jul 23

    AI and the New Challenges Facing Educational Testing with UMass Amherst’s Stephen Sireci

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Stephen G. Sireci, Ph.D., Distinguished Professor and Executive Director of the Center for Educational Assessment at the University of Massachusetts Amherst, about AI and the new challenges facing educational testing. Drawing on his work in psychometrics, validity, fairness, educational measurement, and test development, Stephen explores how AI is reshaping what assessment professionals can do, and what they must continue to scrutinize carefully. As generative AI becomes part of test development, scoring, translation, accessibility, reporting, and candidate preparation, this conversation examines what should change and what must remain foundational. Stephen discusses how assessment can better support learning, why AI outputs still require human interrogation, and what personalization means for long-standing ideas of standardization. He also explores validity evidence in AI-supported workflows, cultural and linguistic fairness, micro-credentials, and why validity research remains essential to the future of the testing profession. What you’ll learn: How AI is expanding what assessment professionals can do across the testing lifecycleWhy assessments are increasingly being used to support learning, not only measure itWhat personalized assessment models could mean for validity, fairness, and traditional ideas of standardizationWhy AI outputs need to be interrogated, evaluated, and supported by evidenceHow AI may affect test development, scoring, alignment, translation, and accessibilityWhat candidate use of AI means for defining the construct being assessedWhere cultural and linguistic context matters when applying AI in assessmentWhy validity research remains central as testing programs adopt new technologiesWho should listen: Educational testing and assessment leaders evaluating AI-enabled changePsychometricians and measurement professionals focused on validity and fairnessTest developers exploring AI-supported item development, scoring, or alignmentCredentialing and certification leaders considering AI’s impact on workforce skillsLanguage assessment and multilingual testing professionalsResearchers and graduate students working in educational measurementOrganizations balancing innovation, defensibility, and public trust in testing About the guest:Stephen G. Sireci, Ph.D. is Distinguished Professor and Executive Director of the Center for Educational Assessment in the College of Education, University of Massachusetts Amherst. He earned his Ph.D. in psychometrics from Fordham University and his master and bachelor degrees in psychology from Loyola College Maryland. Before UMass, he was Senior Psychometrician at GED Testing Service, Psychometrician for the CPA Exam and Research Supervisor of Testing for the Newark NJ Board of Education. He is known for his research in validity and fairness of educational tests, and for innovations in test development. He currently serves/has served on several advisory boards including the National Board of Professional Teaching Standards, Duolingo English Test, and technical advisory committees for Florida, Maryland, New Hampshire, New York, Montana, Puerto Rico, and Texas. He is a Fellow of American Educational Research Association and of Division 5 of American Psychological Association, and a lifetime member of the National Academy of Education. He is a past President of International Test Commission, Northeastern Educational Research Association, and National Council on Measurement in Education. His UMass honors include School of Education’s Outstanding Teacher Award, Conti Faculty Fellowship, Public Engagement Fellowship, Outstanding Accomplishments in Research and Creative Activity Award, and the Chancellor’s Medal. He also received the Messick Memorial Lecture Award from Educational Testing Service/International Language Testing Association.

  6. Jul 9

    Global Learning, AI, and the Future of Workforce Readiness with Maria Spies of HolonIQ and QS

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Maria Spies, Co-Founder of HolonIQ and Chief Innovation Officer at QS, about global learning, AI, and the future of workforce readiness. Drawing on more than 25 years in post-secondary education, workforce learning, and education technology, Maria explores how demographic change, technology, and shifting workforce needs are reshaping the way learners build skills and how organizations recognize them. As governments, employers, and education providers respond to rapid change, Maria explains why assessment and credentialing leaders need to think beyond traditional models of learning and proof. The conversation covers micro-credentials, alternative pathways, AI literacy, learning analytics, embedded learning in the flow of work, English language learning for global mobility, and why trusted evidence of skills will become increasingly important across the lifelong learning ecosystem. What you’ll learn: How global education and workforce trends are reshaping assessment and credentialingWhy demographic shifts are creating different learning and skills needs across regionsWhat is driving demand for micro-credentials, short courses, and alternative pathwaysWhy proof of skills is becoming more important, and more complex, for learners and employersHow technology and data can help make learning more observable without losing sight of design and trustWhat embedded learning in the flow of work could mean for future assessment modelsWhy English language learning is a useful signal for broader workforce learning trendsHow leaders can focus innovation by building from their organization’s existing strengthsWho should listen: Assessment and credentialing leaders planning for workforce changeEducation and training organizations building flexible learning pathwaysWorkforce development leaders focused on upskilling and lifelong learningEmployers and talent leaders thinking about proof of skills and workforce readinessEdtech, learning science, and product teams designing digital learning experiencesLanguage assessment and English learning professionals tracking global mobility trendsOrganizations exploring how AI, data, and credentials can support trusted skill recognition

  7. Jun 25

    From Point-in-Time Testing to Continuous Certification: Insights with NBCRNA’s Tim Muckle

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Tim Muckle, PhD, ICE-CCP, Chief Assessment Officer at the National Board of Certification and Recertification for Nurse Anesthetists, about longitudinal assessment and the future of continued professional certification. Drawing on his background in mathematics, psychometrics, healthcare certification, and assessment leadership, Tim explains how NBCRNA is rethinking recertification in a way that supports patient safety, lifelong learning, and trust with certificants. As certification programs look for models that are more continuous, flexible, and relevant, Tim shares how NBCRNA moved from a traditional point-in-time assessment toward the MAC Check, a longitudinal assessment model built around smaller quarterly question sets, immediate feedback, spaced repetition, and ongoing evidence of competence. The conversation also explores stakeholder engagement, change management, the balance between rigor and accessibility, how AI may influence clinical practice and assessment, and why mission alignment is essential when changing maintenance of certification programs. What you’ll learn: How longitudinal assessment differs from traditional point-in-time testingWhy continuous certification can better support lifelong learning and professional growthHow smaller, periodic question sets can reduce burden while still accumulating evidence of competenceWhat immediate feedback, spaced repetition, and related retake questions add to the assessment experienceWhy psychometric defensibility alone is not enough to build stakeholder trustHow NBCRNA used research, communication, and certificant feedback to support program changeWhere AI, evolving clinical practice, and expectations for relevance may shape future certification modelsWhy assessment leaders should start with mission before redesigning recertification or maintenance programsWho should listen: Certification and recertification leaders exploring longitudinal assessmentAssessment and credentialing professionals responsible for maintenance of certification programsPsychometricians and test developers balancing rigor, feedback, and learner supportLicensure and healthcare certification organizations focused on public safety and continuing competenceProgram owners managing stakeholder trust, communication, and changeOrganizations rethinking how certification can better support lifelong professional learningAbout the guest:Dr. Muckle is the Chief Assessment Officer with the National Board of Certification and Recertification for Nurse Anesthetists (NBCRNA), based in Chicago, IL. In his career, Dr. Muckle has been responsible for overseeing the test development and psychometric quality of a variety of credentialing examinations. His work has included the development of innovative assessment formats (such as longitudinal assessment), consultation and steering of testing policy and strategy, and spearheading an assessment-focused research agenda. He brings 25+ years of experience in certification, test development and research to his present role. Tim has published numerous articles in testing-related scientific journals and publications and has been a regular presenter at meetings of the Association of Test Publishers (ATP), and the Institute for Credentialing Excellence, among others. Among his skills and qualifications are: strategic thinking and planning, organizational leadership, statistical analysis, research and publications, team building, innovative assessment formats, and volunteer service to the credentialing industry.

  8. Jun 11

    What AI Changes About Assessment Evidence: Insights with Khan Academy’s Kristen DiCerbo

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Dr. Kristen DiCerbo, Chief Learning Officer at Khan Academy and one of Time’s top 100 people influencing the future of AI in 2024. Drawing on her background in school psychology, learning science, edtech, and assessment design, Kristen explores how AI is changing what assessment professionals can observe, interpret, and use as evidence of what learners know and can do. As assessment programs look for more authentic ways to measure real-world skills, Kristen explains why better tasks are only part of the equation. The conversation covers task models versus evidence models, the importance of closing the inferential distance, lessons from simulation and game-based assessment, Khan Academy’s “Explain Your Thinking” work, and why new measurement approaches should often begin in lower-stakes formative environments before moving into higher-stakes use. What you’ll learn: How AI can surface evidence of learner thinking beyond a single answerWhy valid assessment starts with separating tasks from evidenceWhat “closing the inferential distance” means for assessment designWhere simulations, games, and open-ended tasks can create noise instead of signalWhy new AI measurement approaches should start in low-stakes settingsHow to balance innovation with structure, validity, and defensibilityWhat multimodal AI and on-device models could mean for future assessmentWho should listen: Assessment and credentialing leaders exploring AIPsychometricians and test developersCertification and licensure program ownersEdtech and learning science teamsProduct leaders building digital assessment experiencesEducators working with formative or performance-based assessmentAbout the guest:Dr. Kristen DiCerbo is the Chief Learning Officer at Khan Academy, where she leads the content, assessment, design, product management, and community support teams. Time magazine named her one of the top 100 people influencing the future of AI in 2024. Dr. DiCerbo’s career has focused on embedding insights from education research into digital learning experiences. Prior to her role at Khan Academy, she was Vice-President of Learning Research and Design at Pearson, served as a research scientist supporting the Cisco Networking Academies, and worked as a school psychologist. Kristen has a Ph.D. in Educational Psychology from Arizona State University.

See All (61)

Ratings & Reviews

5
out of 5
4 Ratings

About

Welcome to PSI’s Tried and Tested Podcast, hosted by Isabelle Gonthier. Tune in every other Thursday for expert conversations on testing, credentialing, and assessment. Each episode explores industry trends, practical insights, and the real work behind high stakes testing, featuring leaders and practitioners shaping the future of the assessment industry.

Information

  • Creator
    PSI Services
  • Years Active
    2023 - 2026
  • Episodes
    61
  • Rating
    Clean
  • Copyright
    © PSI Services
  • Show Website
    Tried and Tested Podcast

You Might Also Like