TY - JOUR
T1 - Capitalization on item calibration error in adaptive testing
AU - van der Linden, Willem J.
AU - Glas, Cornelis A.W.
PY - 2000
Y1 - 2000
N2 - In adaptive testing, item selection is sequentially optimized during the test. Because the optimization takes place over a pool of items calibrated with estimation error, capitalization on chance is likely to occur.Howserious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or the conditional ratio of the test length to the pool size given ability, but may also depend on the structure of the item selection criterion used. A simulation study demonstrated a dramatic impact of capitalization on estimation errors on ability estimation. Four different strategies to minimize the likelihood of capitalization on error in computerized adaptive testing are discussed.
AB - In adaptive testing, item selection is sequentially optimized during the test. Because the optimization takes place over a pool of items calibrated with estimation error, capitalization on chance is likely to occur.Howserious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or the conditional ratio of the test length to the pool size given ability, but may also depend on the structure of the item selection criterion used. A simulation study demonstrated a dramatic impact of capitalization on estimation errors on ability estimation. Four different strategies to minimize the likelihood of capitalization on error in computerized adaptive testing are discussed.
U2 - 10.1207/s15324818ame1301_2
DO - 10.1207/s15324818ame1301_2
M3 - Article
SN - 0895-7347
VL - 13
SP - 35
EP - 53
JO - Applied measurement in education
JF - Applied measurement in education
IS - 1
ER -