Capitalization on item calibration error in adaptive testing

Research output: Book/ReportReportProfessional

51 Downloads (Pure)

Abstract

In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or the ratio of the test length to the pool size, but also on the structure of the item selection criterion used. A simulation study demonstrated the existence of the phenomenon empirically. It also showed that its effect on the errors in the ability estimates interacts strongly with the distribution of the items in the pool.
Original languageEnglish
Place of PublicationEnschede
PublisherUniversity of Twente, Faculty Educational Science and Technology
Publication statusPublished - 1998

Publication series

NameOMD Research Report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.98-07

Fingerprint

simulation
ability

Keywords

  • Error of Measurement
  • Estimation (Mathematics)
  • Test Items
  • Ability
  • METIS-136547
  • Adaptive Testing
  • Foreign Countries
  • IR-103735
  • Computer Assisted Testing

Cite this

van der Linden, W. J., & Glas, C. A. W. (1998). Capitalization on item calibration error in adaptive testing. (OMD Research Report; No. 98-07). Enschede: University of Twente, Faculty Educational Science and Technology.
van der Linden, Willem J. ; Glas, Cornelis A.W. / Capitalization on item calibration error in adaptive testing. Enschede : University of Twente, Faculty Educational Science and Technology, 1998. (OMD Research Report; 98-07).
@book{f1017044e1e54837b53c6d1a42a1e18d,
title = "Capitalization on item calibration error in adaptive testing",
abstract = "In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or the ratio of the test length to the pool size, but also on the structure of the item selection criterion used. A simulation study demonstrated the existence of the phenomenon empirically. It also showed that its effect on the errors in the ability estimates interacts strongly with the distribution of the items in the pool.",
keywords = "Error of Measurement, Estimation (Mathematics), Test Items, Ability, METIS-136547, Adaptive Testing, Foreign Countries, IR-103735, Computer Assisted Testing",
author = "{van der Linden}, {Willem J.} and Glas, {Cornelis A.W.}",
year = "1998",
language = "English",
series = "OMD Research Report",
publisher = "University of Twente, Faculty Educational Science and Technology",
number = "98-07",

}

van der Linden, WJ & Glas, CAW 1998, Capitalization on item calibration error in adaptive testing. OMD Research Report, no. 98-07, University of Twente, Faculty Educational Science and Technology, Enschede.

Capitalization on item calibration error in adaptive testing. / van der Linden, Willem J.; Glas, Cornelis A.W.

Enschede : University of Twente, Faculty Educational Science and Technology, 1998. (OMD Research Report; No. 98-07).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - Capitalization on item calibration error in adaptive testing

AU - van der Linden, Willem J.

AU - Glas, Cornelis A.W.

PY - 1998

Y1 - 1998

N2 - In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or the ratio of the test length to the pool size, but also on the structure of the item selection criterion used. A simulation study demonstrated the existence of the phenomenon empirically. It also showed that its effect on the errors in the ability estimates interacts strongly with the distribution of the items in the pool.

AB - In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or the ratio of the test length to the pool size, but also on the structure of the item selection criterion used. A simulation study demonstrated the existence of the phenomenon empirically. It also showed that its effect on the errors in the ability estimates interacts strongly with the distribution of the items in the pool.

KW - Error of Measurement

KW - Estimation (Mathematics)

KW - Test Items

KW - Ability

KW - METIS-136547

KW - Adaptive Testing

KW - Foreign Countries

KW - IR-103735

KW - Computer Assisted Testing

M3 - Report

T3 - OMD Research Report

BT - Capitalization on item calibration error in adaptive testing

PB - University of Twente, Faculty Educational Science and Technology

CY - Enschede

ER -

van der Linden WJ, Glas CAW. Capitalization on item calibration error in adaptive testing. Enschede: University of Twente, Faculty Educational Science and Technology, 1998. (OMD Research Report; 98-07).