Measuring Patient-Reported Outcomes Adaptively: Multidimensionality Matters!

Muirne C.S. Paap* (Corresponding Author), Karel A. Kroeze, Cees A.W. Glas, Caroline B. Terwee, Job van der Palen, Bernard P. Veldkamp

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

4 Citations (Scopus)
47 Downloads (Pure)

Abstract

As there is currently a marked increase in the use of both unidimensional (UCAT) and multidimensional computerized adaptive testing (MCAT) in psychological and health measurement, the main aim of the present study is to assess the incremental value of using MCAT rather than separate UCATs for each dimension. Simulations are based on empirical data that could be considered typical for health measurement: a large number of dimensions (4), strong correlations among dimensions (.77-.87), and polytomously scored response data. Both variable- (SE <.316, SE <.387) and fixed-length conditions (total test length of 12, 20, or 32 items) are studied. The item parameters and variance–covariance matrix Φ are estimated with the multidimensional graded response model (GRM). Outcome variables include computerized adaptive test (CAT) length, root mean square error (RMSE), and bias. Both simulated and empirical latent trait distributions are used to sample vectors of true scores. MCATs were generally more efficient (in terms of test length) and more accurate (in terms of RMSE) than their UCAT counterparts. Absolute average bias was highest for variable-length UCATs with termination rule SE <.387. Test length of variable-length MCATs was on average 20% to 25% shorter than test length across separate UCATs. This study showed that there are clear advantages of using MCAT rather than UCAT in a setting typical for health measurement.

Original languageEnglish
Pages (from-to)327-342
JournalApplied psychological measurement
Volume42
Issue number5
DOIs
Publication statusPublished - 1 Jul 2018

Keywords

  • UT-Hybrid-D
  • Graded response model
  • Item response theory
  • Computerized adaptive testing
  • MCAT
  • MIRT
  • Multidimensional computerized adaptive testing
  • UCAT
  • M-CAT

Fingerprint Dive into the research topics of 'Measuring Patient-Reported Outcomes Adaptively: Multidimensionality Matters!'. Together they form a unique fingerprint.

  • Cite this