The Smarter Assessment Podcast

Assessment Systems
  • 0.0 (0)
  • Science
  • Updated Monthly

The Smarter Assessment Podcast is dedicated to modern technology in the world of Psychometrics, like AI, machine learning, remote proctoring, and item response theory. Learn how these advancements make tests smarter and more accurate in fields across Education, Credentialing, and Workforce Skills. Assessment is a critical aspect of EdTech, HRTech, Medicine, and more - but often does not get the attention that it deserves!

  1. Apr 16

    AI Conversational Testing: A Deeper Dive, with Wallace Judd, PhD (E15)

    A few weeks ago, we introduced the topic of AI-driven conversational testing. This webinar will dive deeper into the details. Test definition & designItem developmentHow scoring worksReportingUse in interviewsQuality AssuranceLMS IntegrationWe then see a demo of the platform in action. Want to try it yourself? Head to https://dotell.netlify.app. This week's guest: Wallace Judd, PhDDr. Judd is the founder and Chief Scientist at Authentic Testing, where he is one of the industry thought leaders in psychometrics and educational assessment. Originally an elementary teacher, where he wrote 13 educational books and kits as well as patented the Overhead Demonstration Calculator, Dr. Judd then received his PhD from Stanford with a dissertation in IRT under Lee Chronbach. He then worked in testing and training for Xerox PARC, Apple, Kelly Services and Netscape. Dr. Judd started Mentrix Corporation, where he developed the Judd Test Series, the first commercially available hands-on performance tests for personal computers. He later sold Mentrix to Kelly Services where he became a Research Fellow and V.P. of Research and Development. He consulted on the Construction Hazards ID program which was the first Virtual Reality certification to be accredited by ANAB under ISO/IEC 17024. Dr. Judd was an ANSI Assessor for 9 years, and authored the 17024 Compliance Handbook to help more organizations achieve this milestone.

  2. Apr 16

    Human vs Artificial Intelligence in Online Proctoring (E14)

    As remote-proctored online testing becomes more and more common, we are often provided with a choice during implementation: when is human proctoring a better fit, and when should you use AI? Join two CEOs from the front lines of online assessment for an unscripted, in-depth webinar that cuts through the marketing noise and gives you the real framework for making smarter proctoring decisions.In this session, we'll break down exactly how both AI and human proctoring work, then give you practical guidelines for choosing the right approach for your specific context, whether that is the exam stakes, test volume, accessibility requirements, or data privacy concerns.From there, we'll share concrete best practices for getting the most out of human proctoring — including proctor recruitment, training, supervision, and environmental controls — followed by a broader toolkit of security strategies that go beyond proctoring itself, from lockdown browsers and audit tracking to item isomorphs, adaptive testing, and automated item generation. We'll also address the elephant in the room: AI-assisted cheating.This webinar is for you if you are: A testing program manager or psychometrician evaluating proctoring vendorsA credentialing or certification professional responsible for exam integrityAn HR or L&D leader deploying high-stakes assessments at scaleAnyone making decisions about remote vs. in-person exam deliveryHOST: Nathan Thompson, PhD, is the CEO and cofounder of Assessment Systems, home of the powerful assessment ecosystem, FastTest. Originally a psychometrician, Nate’s focus is the development of software to make assessment professionals more effective and efficient.GUEST: Don Kassner is the CEO and founder of MonitorEDU, an industry visionary that also founded ProctorU when online proctoring was still a new idea. He’s served as the VP of Sales at an online testing platform and the president of a university, which gives him a perspective from multiple angles in the world of learning and assessment.

  3. Feb 2

    E13: Novel Item Types in Assessment: A Guide to Design and Development

    Traditional items like multiple choice, essay, and short answer can only measure so much. Today’s candidates—and the roles they’re preparing for—demand more authentic, skills-based assessment. In this live webinar, a leading certification exam development expert will explore how novel item types such as simulations, performance-based tasks, and interactive scenarios can dramatically improve the validity, fidelity, and defensibility of your exams. You’ll learn when and why to move beyond traditional items, how simulations and performance assessments can better reflect real-world job tasks, and what practical considerations matter most when designing and scoring these item types. The session will also address common challenges—such as cost, scalability, and psychometric rigor—and share proven strategies to overcome them. Whether you manage high-stakes exam programs, design assessments, are a subject matter expert, or are exploring ways to modernize your exams, this webinar will provide actionable insights you can apply immediately. Join us to see how innovative item types can elevate candidate experience, strengthen stakeholder confidence, and improve the validity of your assessments. Sign up for a free account in our industry-leading assessment authoring and delivery platform, FastTest: https://assess.com/fasttest/ABOUT THE PRESENTER Belinda Brunner has over twenty years of experience in high-stakes assessment, both in the US and internationally. She has worked with assessment programs in a wide range of industry sectors, from construction to healthcare to higher education admissions. She is a co-author of the “Technology-Enhanced Items” chapter of the International Testing Commission/Association of Test Publishers’ Guidelines for Technology-Based Assessment (2023).

  4. Feb 2

    E12: Leveraging Bloom's Taxonomy in Test Development

    Bloom's Taxonomy is a common approach to classifying the cognitive demands of a test question. In this practical webinar, we will discuss how this framework can help you design assessments more effectively and write better items to drive validity in assessment. We'll talk about how to conceptualize questions that go beyond simple recall, align with learning objectives, and avoid common pitfalls. Whether you're new to test development or looking to refine your approach, you'll leave with actionable strategies to elevate your testing practices. ABOUT THE PRESENTER Belinda Brunner has over twenty years of experience in high-stakes assessment, both in the US and internationally. She has worked with assessment programs in a wide range of industry sectors, from construction to healthcare to higher education admissions. She is a co-author of the “Technology-Enhanced Items” chapter of the International Testing Commission/Association of Test Publishers’ Guidelines for Technology-Based Assessment (2023).

  5. 10/09/2025

    E11: Best Practices for Remote Oral and Practical Assessments - Patrick Ochoa and Kaiti Hofer

    Oral and practical assessments have long been a part of the educational process, especially for complex or hands-on professions. This video discusses best practices to deliver such assessments online, while maintaining security and validity. Presenters: Patrick Ochoa - VP of Partnerships at Assessment Systems https://assess.com/ Kaiti Hofer - Director of High-Stakes Assessments at MonitorEDU https://monitoredu.com/

  6. 07/17/2025

    E10: Protecting Test Integrity, with Kranthi Bathula of Proctor360

    The integrity and security of assessment is essential, both to protect the investment you made in your exams, as well as to trust the scores that are the result. Remote proctoring, aka online or virtual proctoring, is a cost-effective yet high-quality way to provide this safeguard. Of course, the effectiveness can be improved by following some best practices! Join us for a conversation on this topic with Kranthi Bathula, CTO and Co-Founder of Proctor360. Proctor360 is a leading remote proctoring company that's transforming how educational institutions and credentialing/employment organizations conduct secure online assessments. In this webinar, we discuss some of those best practices, but also the exciting journey of building a SaaS company in the EdTech industry. Key points include: Kranthi’s journey in the assessment world Building a Saas platform with an international team How to effectively implement remote proctoring while balancing important considerations like accessibility and student experience Common ways that students cheat, and how to deter or catch them Target Audience: Educational administrators and instructors Certification managers HR professionals that oversee remote assessments EdTech enthusiasts and entrepreneurs Anyone interested in the future of secure online testing About This Episode's Guest : Kranthi Bathula is the Co-Founder and CTO of Proctor360, an EdTech company specializing in secure online proctoring for high-stakes exams. With an extensive background in engineering, he leads the design of multi-camera and AI-enabled solutions that help institutions uphold exam integrity in remote environments.

  7. 07/17/2025

    E9: Market and Grow your Credentialing Program, with Amanda Crowley of ACMC

    A credentialing exam is a product that needs to be marketed and sold, as is the case for ancillary products like practice tests or study guides, but most credentialing organizations need some help! In this webinar, discover why many credentialing organizations are leaving money on the table with outdated marketing approaches and learn the game-changing strategies that industry leaders use to drive stronger growth. Industry expert Amanda Crowley discusses how to revolutionize your candidate communications, develop a results-driven marketing plan, and master social media engagement to build a thriving certification community. We will discuss a mindset shift that separates successful organizations from struggling ones: treating your certification as the valuable product it truly is, complete with strategic positioning, targeted messaging, and customer-centric marketing. Don't let your credentialing program get lost in the noise; join us to learn proven tactics for increasing enrollment, boosting candidate satisfaction, and establishing your certification as the gold standard in your industry. Walk away with actionable strategies you can implement immediately to transform your organization's growth trajectory, increase ROI, and better serve your profession. This Episode's Guest: Amanda Crowley Amanda is one of the key marketing experts in the assessment industry, including serving as Director of Marketing for ITS. She recently launched her own consultancy (http://www.helloacmc.com/) and is available for engagements to help grow your credentialing and assessment programs.

  8. 07/17/2025

    E8: Resilience in the Workplace, with Alina Oshyna of PsyLab

    In this webinar, we discuss non-cognitive pre-employment testing, specifically the assessment of resilience, with Alina Oshyna, the founder of PsyLab (https://en.psylab.dp.ua/). Psylab is a factory of behavior modelling assessments that has come out with the industry-leading resilience assessment but is developing a wider range based on market requirements. Alina has an extensive background in psychometrics and human resources, including experience from Silicon Valley startups to governmental organizations, such as the UK National Foundation for Educational Research, Moody’s Analytics, Gyfted, and JobTestPrep. She is Israeli-Ukrainian, and currently lives in Dnipro, Ukraine. Alina has researched all existing personality tests on the market and worked on a wide variety of tests: personality, integrity, cognitive ability, certification exams, and continuous performance tests used for ADHD diagnostics. Some of the topics we will be discussing What is stress resilience? How is it useful in predicting job performance? How do we assess it, and how is it different than traditional assessment? Why do we need assessments that are not self-report? How do we detect and prevent careless responding? What is it like to found and run your own assessment company?

See All (15)

About

The Smarter Assessment Podcast is dedicated to modern technology in the world of Psychometrics, like AI, machine learning, remote proctoring, and item response theory. Learn how these advancements make tests smarter and more accurate in fields across Education, Credentialing, and Workforce Skills. Assessment is a critical aspect of EdTech, HRTech, Medicine, and more - but often does not get the attention that it deserves!

Information