TY - CHAP
T1 - Ensuring the future of computerized adaptive testing
AU - Veldkamp, Bernard P.
PY - 2012
Y1 - 2012
N2 - Capitalization on chance is a huge problem in computerized adaptive testing (CAT) when Fisher information is used to select the items. Maximizing Fisher information tends to favor items with positive estimation errors in the discrimination parameter and negative estimation errors in the guessing parameter. As a result, information in the resulting tests is overestimated and measurement precision is lower than expected. Since reduction of test length is one of the most important selling points of CAT, this is a serious threat to both the validity and viability of this test administration mode. In this chapter, robust test assembly is presented as an alternative method that accounts for uncertainty in the item parameters during test assembly
AB - Capitalization on chance is a huge problem in computerized adaptive testing (CAT) when Fisher information is used to select the items. Maximizing Fisher information tends to favor items with positive estimation errors in the discrimination parameter and negative estimation errors in the guessing parameter. As a result, information in the resulting tests is overestimated and measurement precision is lower than expected. Since reduction of test length is one of the most important selling points of CAT, this is a serious threat to both the validity and viability of this test administration mode. In this chapter, robust test assembly is presented as an alternative method that accounts for uncertainty in the item parameters during test assembly
KW - Automated test assembly
KW - Computerized Adaptive Testing
KW - capitalization on chance
KW - item parameter uncertainty
KW - robust test assembly
KW - 0-1 LP
U2 - 10.3990/3.9789036533744.ch4
DO - 10.3990/3.9789036533744.ch4
M3 - Chapter
SN - 9789036533744
SP - 39
EP - 50
BT - Psychometrics in Practice at RCEC
A2 - Eggen, Theo J.H.M.
A2 - Veldkamp, Bernard P.
PB - RCEC
ER -