Bayesian item selection in constrained adaptive testing using shadow tests

Research output: Contribution to journalArticleAcademicpeer-review

15 Downloads (Pure)

Abstract

Application of Bayesian item selection criteria in computerized adaptive testing might result in improvement of bias and MSE of the ability estimates. The question remains how to apply Bayesian item selection criteria in the context of constrained adaptive testing, where large numbers of specifications have to be taken into account in the item selection process. The Shadow Test Approach is a general purpose algorithm for administering constrained CAT. In this paper it is shown how the approach can be slightly modified to handle Bayesian item selection criteria. No differences in performance were found between the shadow test approach and the modified approach. In a simulation study of the LSAT, the effects of Bayesian item selection criteria are illustrated. The results are compared to item selection based on Fisher Information. General recommendations about the use of Bayesian item selection criteria are provided.
Original languageEnglish
Pages (from-to)149-169
Number of pages21
JournalPsicologica
Volume31
Issue number1
Publication statusPublished - 2010

Keywords

  • IR-98564
  • METIS-272462

Fingerprint Dive into the research topics of 'Bayesian item selection in constrained adaptive testing using shadow tests'. Together they form a unique fingerprint.

Cite this