Measurement and structural invariance of cognitive ability tests after computer-based training

Michael Hermes (Lead / Corresponding author), Frank Albers, Jan Böhnke, Gerrit Huelmann, Julia Maier, Dirk Stelling

    Research output: Contribution to journalArticlepeer-review

    1 Citation (Scopus)
    1 Downloads (Pure)

    Abstract

    Ability tests are core elements in performance research as well as in applied contexts and are increasingly carried out using computer-based versions. In the last few decades a whole training and coaching industry has developed to prepare individuals for computer-based assessments. Evidence suggests that such commercial training programs can result in score gains in ability tests, thereby creating an advantage for those who can afford it and challenging the fairness of ability assessment. As a consequence, several authors recommended freely offering training software to all participants to increase measurement fairness. However, it is still an open question whether the unsupervised use of training software could have an impact on the measurement properties of ability tests. The goal of the present study is to fill this gap by examining the subjects’ ability scores for measurement and structural invariance across different amounts of computer-based training. Structural equation modeling was employed in a sample of 15,752 applicants who participated in high-stakes assessments with computer-based ability tests. Across different training amounts, our analyses supported measurement and structural invariance of ability scores. In conclusion, free training software is a means that provides fair preparation opportunities without changing the measurement properties of the tests.
    Original languageEnglish
    Pages (from-to)370-378
    Number of pages9
    JournalComputers in Human Behavior
    Volume93
    Early online date21 Nov 2018
    DOIs
    Publication statusPublished - Apr 2019

    Keywords

    • Cognitive ability
    • Computer-based testing
    • Computer-based training
    • Measurement invariance
    • Test fairness

    Fingerprint Dive into the research topics of 'Measurement and structural invariance of cognitive ability tests after computer-based training'. Together they form a unique fingerprint.

    Cite this