Testing, Testing 1-2-3

TestGenius

0.0 (0)
Management

A podcast about all things testing for HR and Employee Selection by TestGenius

Oct 20

Predicting 911 Dispatcher Success with Multifaceted Testing

Hosts Jenny Arnez and Mike Callen of TestGenius interview Dr. Dan Biddle, CEO of Biddle Consulting Group and TestGenius, about building and validating CritiCall 3D for 911 dispatcher selection. Biddle outlines his PhD in I/O psychology, decades of testing and validation work, and experience as a testifying expert and Department of Labor consultant. The discussion explains why multifaceted “3D” testing (operational, situational, and behavioral/personality) outperforms single-method selection, clarifies cognitive ability (fluid vs. crystallized), and defines adverse impact, test validation, and essential functions under the Uniform Guidelines. Biddle summarizes a major CritiCall 3D validity project combining three divergent assessments to achieve an operational validity coefficient of 0.634, explaining about 40% of job performance, and compares this to the lower predictiveness of unstructured interviews. They also cover practical implications for agencies, including reducing uncertainty, training costs, and qualification-related turnover, plus guidance on cutoffs, banding, and adverse-impact considerations. 00:00 Welcome and Introductions00:41 Dan Biddle Background02:35 CritiCall Origins03:46 Why 3D Testing07:03 Cognitive Ability Explained08:42 Benefits for Applicants10:53 Adverse Impact Basics12:50 Essential Functions and Guidelines15:19 CritiCall 3D Validity Study20:32 Interviews Versus Testing23:34 Sponsor Break24:22 Validity Charts Walkthrough32:00 Stacking Tests and Overlap36:11 Practical Impact for Agencies39:17 Cutoffs Banding and Rank Order49:11 Wrap Up Key Benefits55:08 Closing and Resources Resources mentioned: www.criticall911.comwww.testgenius.comwww.uniformguidelines.comCritiCall 3D Job Performance and Turnover CalculatorCritiCall 3D Validation Executive SummaryCritiCall 3D Validation Report
Aug 19

A Guide Through HR Compliance - Talking with Jocelyn King, VirgilHR

VirgilHR’s Jocelyn King on being a guide for HR Compliance, Multi-State Laws, and Confident HR Decisions TestGenius hosts Jenny Arnez and Mike Callen return from a hiatus to launch a new podcast season with guest Jocelyn King, CEO and founder of Virgil HR. King explains the company’s Dante-inspired name and shares how multi-state and local employment-law complexity in high-growth roles led her to build a HR compliance platform. She highlights common compliance pitfalls including overlooking stricter state and city rules, outdated job descriptions, worker misclassification, and inconsistencies in applying policies. King describes how Virgil HR tracks changes using legal databases and direct outreach to state offices, covering about 8,000 localities, and supports industries like healthcare, construction, manufacturing, staffing, and professional services. The episode explores Virgil’s chatbot workflows, attorney-built content with citations, HRIS integration, guidance on ADA accommodations and EEO changes, and a focus on proactive, standardized compliance. Resources:VirgilHR: https://virgilhr.comTestGenius: https://testgenius.com Legal notice: This podcast is a presentation of Biddle Consulting Group, Inc., the publishers of TestGenius. The topics covered in this podcast are sometimes controversial, and pertain to an often-changing landscape. The opinions expressed of the hosts and guests are their own, and may not align with those of the organization for which they work. None of the conversation or resources shared on this podcast should be construed to be legal advice. As a best practice, if you have concerns over these issues or opinions expressed, you should explore them with an attorney or other expert.
05/06/2025

So, You Don’t Test? A Closer Look at Why You Should Consider It

In this episode, hosts Mike Callen and Jenny Arnez of Biddle Consulting Group's TestGenius podcast, address common concerns and misconceptions about testing in recruitment. They explain that many elements of the hiring process are inherently tests, distinguish between subjective and objective measures, and discuss the importance of ensuring tests' validity and consistency with business necessity. The hosts highlight the benefits of using skill and ability tests, personality tests and situational judgment tests to improve hiring effectiveness, employee engagement, and defensibility. Real-world examples and detailed explanations reinforce the crucial role of testing in creating a fair and efficient recruitment process. Notice:This podcast is a presentation of Biddle Consulting Group, Inc., the publishers of TestGenius. The topics covered in this podcast are sometimes controversial, and pertain to an often-changing landscape. The opinions expressed of the hosts and guests are their own, and may not align with those of the organization for which they work. None of the conversation or resources shared on this podcast should be construed to be legal advice. As a best practice, if you have concerns over these issues or opinions expressed, you should explore them with an attorney or other expert. 00:00 Introduction and Disclaimers 00:55 Meet the Hosts 01:13 Today's Topic: You Say You Don't Test 02:21 Understanding TestGenius and Testing 03:39 The Importance of Skill and Ability Testing 04:16 Real-Life Conversations and Misconceptions 05:00 Point 1: Everything in Recruitment is a Test 05:45 Historical Context: Griggs vs. Duke Power 10:13 Job Postings and Adverse Impact 16:52 Job Applications and Adverse Impact 19:50 Various Types of Tests in Recruitment 26:15 Adverse Impact vs. Disparate Impact 28:45 Subjective vs. Objective Measures 31:42 Ensuring Fairness in the Hiring Process 32:08 The Role of Subjective Measures in Recruitment 34:15 The Importance of Optics in Recruitment 36:29 Work Sample Tests: Benefits and Realistic Job Previews 40:30 Ensuring Validity in Testing 44:15 The Critical Role of Paper Trails 50:21 Addressing Concerns About Testing 56:28 Conclusion and Final Thoughts Resources:- TestGenius: www.testgenius.com- Biddle Consulting Group: www.biddle.com- CritiCall: www.criticall911.com
01/29/2025

Best Practices in the Hiring Process

In this episode of 'Testing, Testing 1-2-3' by TestGenius and Biddle Consulting Group, hosts Jenny Arnez and Mike Callen discuss pre-employment testing and hiring best practices. They discuss a specific client case about Acme County's concerns regarding adverse impact in their hiring process, and explore essential concepts such as job analysis, validation processes, and the Uniform Guidelines on Employee Selection Procedures. They also shed light on content and criterion validation, and the importance of face validity in recruitment. Emphasizing the need for defensible and job-related cutoff scores, the episode provides actionable insights to create a fair, effective, and legally sound hiring process. Resources mentioned: ioPredict: www.iopredict.comUniform Guidelines: www.uniformguidelines.comTestGenius: www.TestGenius.comChapters:00:00 Introduction to Testing, Testing 1-2-300:43 Today's Unique Episode Format01:32 Client Scenario: Acme County's Hiring Concerns02:26 Mike's Advice on Recruitment Consistency05:19 The Importance of Job Analysis09:05 Understanding Tests in the Recruitment Process12:17 Addressing Adverse Impact in Hiring18:37 Legal Guidelines and Validation Processes20:33 TestGenius Validation Wizard Explained28:02 Performance Differentiation in Testing31:25 Sponsor Message32:01 Holistic Recruitment Strategy33:09 Defensibility and Utility in Recruitment35:33 Validation Process and Its Importance35:53 Technological Changes in Job Roles37:26 Content Validity and Criterion Validity40:34 Personality Tests and Criterion Validation46:56 Face Validity in Testing53:27 Multifaceted Testing Strategy59:51 Final Thoughts and Recommendations
08/07/2024

Exploring Pay Equity: More Insights from Dr. Brian Marentette

Exploring Pay Equity: More Insights from Dr. Brian Marentette - Testing Testing 123 Podcast In this episode of Testing, Testing 123, sponsored by TestGenius, hosts Jenny Arnez and Mike Callen are joined again by Dr. Brian Marentette from Berkshire Associates to delve into pay equity. The discussion covers the differences between software-driven and consultant-led pay equity analyses, potential pitfalls of each approach, and best practices for employers. The conversation also touches on job architecture, employee groupings, and legal considerations in pay equity. Brian provides valuable insights and practical advice on navigating the complexities of pay equity, making this episode a must-listen for anyone interested in fair compensation practices. Resources Mentioned: Berkshire Associates: www.berkshireassociates.comBiddle Consulting Group: www.biddle.comBiddle Blog - Pay Equity Posts: www.biddle.com/blog/BCGi: www.bcginstitute.orgTestGenius: www.TestGenius.comDr. Brian Marentette's LinkedIn: www.linkedin.com/in/brianmarentetteSHRM: www.shrm.orgWorld at Work: www.worldatwork.orgUS Equal Employment Opportunity Commission: www.eeoc.gov 00:00 Introduction and Guest Introduction 00:33 Diving into Pay Equity Analysis 00:54 Software vs. Consultant for Pay Equity 01:58 Challenges and Complexities in Pay Equity 06:43 Legal Considerations in Pay Equity 12:17 Best Practices for Pay Equity Analysis 19:16 Job Architecture and Grouping Employees 23:38 Resources and Final Thoughts
07/12/2024

Understanding Pay Equity: Insights from Dr. Brian Marentette

Understanding Pay Equity: Insights from Dr. Brian Marentette | Testing, Testing 123 Podcast Welcome to the Testing, Testing 123 podcast by TestGenius! In this episode, hosts Jenny Arnez and Mike Callen sit down with Dr. Brian Marentette, Director of People Insights at Berkshire Associates. Dr. Marentette educates us on the basics of pay equity, explaining its importance, methodologies, and common misconceptions. The conversation delves into issues like performance ratings, market availability, and the influence of pay equity analyses on organizational DE&I practices. Perfect for HR professionals, business leaders, and anyone interested in fair compensation practices. Join us for an informative session filled with expert insights and practical advice! Resources: Berkshire Associates: www.berkshireassociates.comBiddle Consulting Group: www.biddle.comBCGi: www.bcginstitute.orgTestGenius: www.TestGenius.comDr. Brian Marentette's LinkedIn: www.linkedin.com/in/brianmarentette 00:00 Introduction and Welcome 00:47 Meet Dr. Brian Marentette 01:58 Understanding Pay Equity 04:20 Factors Influencing Pay Equity 10:05 Legal and DEI Perspectives 20:03 Proactive vs. Reactive Pay Equity Analysis 27:10 Pay Transparency and Market Trends 31:25 Conclusion and Contact Information
06/18/2024

Explaining the CritiCall Personality Test with Dr. Clinton Kelly

Personality Testing in 911 Dispatch Environments | Testing, Testing 1-2-3 In this episode of Testing, Testing 1-2-3, host Jenny Arnez from TestGenius welcomes Mike Callen, VP of Products at TestGenius, and Dr. Clinton Kelly from ioPredict to discuss personality testing in the high-stress environment of 911 dispatch. They delve into the CritiCall dispatch assessment tool, explaining its role in evaluating technical skills crucial for dispatch work. The conversation highlights the job-specific personality test developed in collaboration with ioPredict, exploring the significance of adaptability, composure, resilience, and other traits necessary for success in dispatch roles. The episode also covers the test's validation process, its utility, and legal defensibility, providing insights for hiring managers on making informed hiring decisions. Resources mentioned: ioPredict: www.iopredict.comUniform Guidelines: www.uniformguidelines.comUniform Guidelines Section 7bUniform Guidelines Section 15bTestGenius: www.TestGenius.comCritiCall Dispatcher Testing Software: www.criticall911.com00:00 Introduction to the Podcast00:43 Overview of CritiCall and Its Importance02:54 Personality Testing in Dispatch Environments07:43 Developing the Dispatcher Personality Test10:26 Analyzing Job Performance and Test Validity19:41 Sample Score Report and Interpretation24:24 Understanding Predictive Power in Hiring25:24 Introduction to Subscales and Their Importance25:52 Using Subscales in Interviews26:43 Balancing Strengths and Weaknesses31:37 Criterion Validation and Its Benefits33:02 Transporting Validity Across Organizations44:57 Standardization in Hiring Processes46:17 Conclusion and Final Thoughts
05/16/2024

Understanding Personality Testing in the Workplace with Dr. Clinton Kelly

Understanding Personality Testing in the Workplace with Dr. Clinton Kelly This podcast episode from 'Testing, Testing 1, 2, 3' explores the intricacies of personality testing in the workplace, featuring Jenny Arnez from TestGenius, Mike Callen, VP of Products at TestGenius, and Dr. Clinton Kelly from ioPredict. They discuss the differences between popular personality tests like Myers-Briggs and those used for employment selection, emphasizing the critical nature of using scientifically validated tests. Dr. Kelly explains the role of industrial and organizational psychology in hiring and promotion, detailing the development, validity, and application of workplace personality assessments. The episode also covers legal and practical considerations for employers, including the Uniform Guidelines on employee selection procedures and the concept of validity transportability. Listeners gain insights into selecting appropriate tests and utilizing test results responsibly in hiring decisions. Resources mentioned: ioPredict: www.iopredict.comUniform Guidelines: www.uniformguidelines.comUniform Guidelines Section 7bTestGenius: www.TestGenius.comCritiCall Dispatcher Testing Software: www.criticall911.comEpisode Chapters: 00:00 Introduction to the Podcast and Guests 00:26 Dr. Clinton Kelly's Background and Expertise 01:29 Mike Callen's Role and TestGenius Overview 02:32 Diving into Personality Testing in the Workplace 09:53 Understanding Validity in Personality Testing 14:38 Designing and Validating Effective Personality Tests 19:36 Post-Hire Uses of Personality Tests and Final Thoughts 22:35 Debunking Myths Around Test Taking 23:13 The Importance of Objective Selection Processes 23:57 Exploring Personality Assessments for Employers 24:14 Custom vs. Off-the-Shelf Personality Tests 25:34 Understanding Different Types of Personality Tests 26:47 Ensuring Test Validity and Applicant Satisfaction 32:29 The Role of Subscale Scores in Personality Testing 39:11 Navigating Legal and Defensibility Aspects of Personality Testing 41:36 Leveraging Uniform Guidelines for Test Validity 47:42 Concluding Remarks and Future Discussions
04/01/2024

Exploring Behavioral Testing with Logi-Serve

Exploring Behavioral Testing with Logi-Serve (for Pre-hire Selection and Post-hire Development) In this comprehensive podcast episode, Jenny Arnez hosts a discussion with Mike Callen, the VP of Products at TestGenius, and Dr. Chris Cunningham, the Chief Science Officer at Logi-Serve. The focus is on the intersection of hard skills testing traditionally done by TestGenius and the behavioral or competency-based testing spearheaded by Logi-Serve. They delve into the science behind testing for competencies, emphasizing traits versus states, and how Logi-Serve's assessments are designed to enhance hiring processes by integrating a novel approach to evaluating service-oriented competencies. The conversation covers the development of these assessments, their applicability in pre and post-hire contexts, and their potential to foster better talent management. Additionally, the speakers discuss the importance of candidate experience in assessments, the principle of leveling the playing field to avoid bias, and the flexibility of the Logi-Serve assessment system in catering to various industries and job functions. The episode rounds off with a discussion on the practical application of these tests in HR processes and future prospects for leveraging assessments in employee development and organizational planning. 00:00 Welcome to the Podcast: Introducing the Experts 00:26 Deep Dive into Logi-Serve: Revolutionizing Skills Assessment 03:45 Exploring the Nuances of Traits vs. States in Behavioral Testing 08:58 The Logi-Serve Assessment Experience: A New Approach to Evaluating Competencies 26:40 Enhancing HR Strategies with Logi-Serve's Innovative Assessments 34:59 Leveraging Assessments for Talent Management and Leadership Development 50:12 Closing Thoughts Watch the episode on YouTube! https://www.youtube.com/watch?v=SScW3PxaLQo&t=17s Creators & Guests Mike Callen - Host Jenny Arnez - Host Christopher J. L. Cunningham, PhD - Guest To learn more about Logi-Serve, visit https://logi-serve.com/. For more information about TestGenius, visit https://testgenius.com/

9 Episodes

A podcast about all things testing for HR and Employee Selection by TestGenius

Creator

TestGenius
Years Active

2024 - 2026
Episodes

9
Rating

Clean
Copyright

© 2026 TestGenius & Biddle Consulting Group
Show Website

Testing, Testing 1-2-3