An examination of psychometric bias due to retesting on cognitive ability tests in selection settings.

Filip Lievens, Charlie L Reeve, Eric D Heggestad
Author Information
  1. Filip Lievens: Department of Personnel Management and Work and Organizational Psychology, Ghent University, Ghent, Belgium. filip.lievens@ugent.be

Abstract

Using a latent variable approach, the authors examined whether retesting on a cognitive ability measure resulted in measurement and predictive bias. A sample of 941 candidates completed a cognitive ability test in a high-stakes context. Results of both the within-group between-occasions comparison and the between-groups within-occasion comparison indicated that no measurement bias existed during the initial testing but that retesting induced both measurement and predictive bias. Specifically, the results suggest that the factor underlying the retest scores was less saturated with g and more associated with memory than the latent factor underlying initial test scores and that these changes eliminated the test's criterion-related validity. This study's implications for retesting theory, practice, and research are discussed.

MeSH Term

Achievement
Adult
Bias
Cognition
Female
Humans
Male
Psychological Tests
Psychometrics

Word Cloud

Created with Highcharts 10.0.0retestingbiascognitiveabilitymeasurementlatentpredictivetestcomparisoninitialfactorunderlyingscoresUsingvariableapproachauthorsexaminedwhethermeasureresultedsample941candidatescompletedhigh-stakescontextResultswithin-groupbetween-occasionsbetween-groupswithin-occasionindicatedexistedtestinginducedSpecificallyresultssuggestretestlesssaturatedgassociatedmemorychangeseliminatedtest'scriterion-relatedvaliditystudy'simplicationstheorypracticeresearchdiscussedexaminationpsychometricduetestsselectionsettings

Similar Articles

Cited By (18)