Conditional item-exposure control in adaptive testing using item-ineligibility probabilities

Research output: Contribution to journalArticleAcademicpeer-review

27 Citations (Scopus)

Abstract

Two conditional versions of the exposure-control method with item-ineligibility constraints for adaptive testing in van der Linden and Veldkamp (2004) are presented. The first version is for unconstrained item selection, the second for item selection with content constraints imposed by the shadow-test approach. In both versions, the exposure rates of the items are controlled using probabilities of item ineligibility given θ that adapt the exposure rates automatically to a goal value for the items in the pool. In an extensive empirical study with an adaptive version of the Law School Admission Test, the authors show how the method can be used to drive conditional exposure rates below goal values as low as 0.025. Obviously, the price to be paid for minimal exposure rates is a decrease in the accuracy of the ability estimates. This trend is illustrated with empirical data.
Original languageUndefined
Pages (from-to)398-417
Number of pages19
JournalJournal of educational and behavioral statistics
Volume32
Issue number4
DOIs
Publication statusPublished - 2007

Keywords

  • IR-98549
  • METIS-244363

Cite this

@article{48d348bb596f45b6aa53237130f462a6,
title = "Conditional item-exposure control in adaptive testing using item-ineligibility probabilities",
abstract = "Two conditional versions of the exposure-control method with item-ineligibility constraints for adaptive testing in van der Linden and Veldkamp (2004) are presented. The first version is for unconstrained item selection, the second for item selection with content constraints imposed by the shadow-test approach. In both versions, the exposure rates of the items are controlled using probabilities of item ineligibility given θ that adapt the exposure rates automatically to a goal value for the items in the pool. In an extensive empirical study with an adaptive version of the Law School Admission Test, the authors show how the method can be used to drive conditional exposure rates below goal values as low as 0.025. Obviously, the price to be paid for minimal exposure rates is a decrease in the accuracy of the ability estimates. This trend is illustrated with empirical data.",
keywords = "IR-98549, METIS-244363",
author = "{van der Linden}, {Willem J.} and Veldkamp, {Bernard P.}",
year = "2007",
doi = "10.3102/1076998606298044",
language = "Undefined",
volume = "32",
pages = "398--417",
journal = "Journal of educational and behavioral statistics",
issn = "1076-9986",
publisher = "SAGE Publications",
number = "4",

}

TY - JOUR

T1 - Conditional item-exposure control in adaptive testing using item-ineligibility probabilities

AU - van der Linden, Willem J.

AU - Veldkamp, Bernard P.

PY - 2007

Y1 - 2007

N2 - Two conditional versions of the exposure-control method with item-ineligibility constraints for adaptive testing in van der Linden and Veldkamp (2004) are presented. The first version is for unconstrained item selection, the second for item selection with content constraints imposed by the shadow-test approach. In both versions, the exposure rates of the items are controlled using probabilities of item ineligibility given θ that adapt the exposure rates automatically to a goal value for the items in the pool. In an extensive empirical study with an adaptive version of the Law School Admission Test, the authors show how the method can be used to drive conditional exposure rates below goal values as low as 0.025. Obviously, the price to be paid for minimal exposure rates is a decrease in the accuracy of the ability estimates. This trend is illustrated with empirical data.

AB - Two conditional versions of the exposure-control method with item-ineligibility constraints for adaptive testing in van der Linden and Veldkamp (2004) are presented. The first version is for unconstrained item selection, the second for item selection with content constraints imposed by the shadow-test approach. In both versions, the exposure rates of the items are controlled using probabilities of item ineligibility given θ that adapt the exposure rates automatically to a goal value for the items in the pool. In an extensive empirical study with an adaptive version of the Law School Admission Test, the authors show how the method can be used to drive conditional exposure rates below goal values as low as 0.025. Obviously, the price to be paid for minimal exposure rates is a decrease in the accuracy of the ability estimates. This trend is illustrated with empirical data.

KW - IR-98549

KW - METIS-244363

U2 - 10.3102/1076998606298044

DO - 10.3102/1076998606298044

M3 - Article

VL - 32

SP - 398

EP - 417

JO - Journal of educational and behavioral statistics

JF - Journal of educational and behavioral statistics

SN - 1076-9986

IS - 4

ER -