An evaluation of computerized adaptive testing for general psychological distress

combining GHQ-12 and Affectometer-2 in an item bank for public mental health research

Jan Stochl (Lead / Corresponding author), Jan Boehnke, Kate E. Pickett, Tim J. Croudace

Research output: Contribution to journalArticle

5 Citations (Scopus)
73 Downloads (Pure)

Abstract

Background: Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD).

Methods: Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of “general happiness”). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration.

Results: A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank.

Conclusions: Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.
Original languageEnglish
Article number58
Pages (from-to)1-15
Number of pages15
JournalBMC Medical Research Methodology
Volume16
DOIs
Publication statusPublished - 20 May 2016

Fingerprint

Mental Health
Public Health
Psychology
Psychometrics
Research
Population
Happiness
Health Surveys
Health Education
Mental Disorders
Computer Simulation
Artifacts
Calibration
Joints
Research Personnel
Technology
Surveys and Questionnaires

Keywords

  • Computerized adaptive testing
  • General Health Questionnaire
  • Affectometer
  • Item Response Theory

Cite this

@article{a4526f44cbc7488fb15d5bf33f0b6e48,
title = "An evaluation of computerized adaptive testing for general psychological distress: combining GHQ-12 and Affectometer-2 in an item bank for public mental health research",
abstract = "Background: Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD).Methods: Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of “general happiness”). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration.Results: A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank.Conclusions: Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.",
keywords = "Computerized adaptive testing, General Health Questionnaire, Affectometer, Item Response Theory",
author = "Jan Stochl and Jan Boehnke and Pickett, {Kate E.} and Croudace, {Tim J.}",
year = "2016",
month = "5",
day = "20",
doi = "10.1186/s12874-016-0158-7",
language = "English",
volume = "16",
pages = "1--15",
journal = "BMC Medical Research Methodology",
issn = "1471-2288",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - An evaluation of computerized adaptive testing for general psychological distress

T2 - combining GHQ-12 and Affectometer-2 in an item bank for public mental health research

AU - Stochl, Jan

AU - Boehnke, Jan

AU - Pickett, Kate E.

AU - Croudace, Tim J.

PY - 2016/5/20

Y1 - 2016/5/20

N2 - Background: Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD).Methods: Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of “general happiness”). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration.Results: A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank.Conclusions: Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.

AB - Background: Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD).Methods: Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of “general happiness”). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration.Results: A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank.Conclusions: Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.

KW - Computerized adaptive testing

KW - General Health Questionnaire

KW - Affectometer

KW - Item Response Theory

U2 - 10.1186/s12874-016-0158-7

DO - 10.1186/s12874-016-0158-7

M3 - Article

VL - 16

SP - 1

EP - 15

JO - BMC Medical Research Methodology

JF - BMC Medical Research Methodology

SN - 1471-2288

M1 - 58

ER -