Optimal Bayesian Adaptive Design for Test-Item Calibration

Research output: Contribution to journalArticleAcademicpeer-review

21 Citations (Scopus)

Abstract

An optimal adaptive design for test-item calibration based on Bayesian optimality criteria is presented. The design adapts the choice of field-test items to the examinees taking an operational adaptive test using both the information in the posterior distributions of their ability parameters and the current posterior distributions of the field-test parameters. Different criteria of optimality based on the two types of posterior distributions are possible. The design can be implemented using an MCMC scheme with alternating stages of sampling from the posterior distributions of the test takers’ ability parameters and the parameters of the field-test items while reusing samples from earlier posterior distributions of the other parameters. Results from a simulation study demonstrated the feasibility of the proposed MCMC implementation for operational item calibration. A comparison of performances for different optimality criteria showed faster calibration of substantial numbers of items for the criterion of D-optimality relative to A-optimality, a special case of c-optimality, and random assignment of items to the test takers.
Original languageEnglish
Pages (from-to)263-288
JournalPsychometrika
Volume80
Issue number2
DOIs
Publication statusPublished - 20 Jan 2015

Keywords

  • METIS-301152
  • IR-88745

Fingerprint Dive into the research topics of 'Optimal Bayesian Adaptive Design for Test-Item Calibration'. Together they form a unique fingerprint.

Cite this