Constraining item exposure in computerized adaptive testing with shadow tests

Research output: Book/ReportReportProfessional

79 Downloads (Pure)

Abstract

Item-exposure control in computerized adaptive testing is implemented by imposing item-ineligibility constraints on the assembly process of the shadow tests. The method resembles Sympson and Hetter's (1985) method of item-exposure control in that the decisions to impose the constraints are probabilistic. However, the method does not require time-consuming simulation studies to set values for control parameters prior to the operational use of the test. Instead, the probabilities of item ineligibility can be set "on the fly" using an adaptive procedure based on the actual item-exposure rates. An empirical study using an item pool from the Law School Admission Test (LSAT) showed that application of the method yielded perfect control of the item exposure rates and had negligible impact on the bias and MSE functions of the ability estimator.
Original languageEnglish
Place of PublicationEnschede
PublisherOnderwijskundige Meetmethoden en Data-analyse
Number of pages29
Publication statusPublished - 2002

Publication series

NameOMD Research Report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.02-06

Keywords

  • METIS-209504
  • item exposure control
  • IR-103564
  • Computerized Adaptive Testing
  • item-selection constraints
  • shadow test approach
  • randomized control

Fingerprint Dive into the research topics of 'Constraining item exposure in computerized adaptive testing with shadow tests'. Together they form a unique fingerprint.

  • Cite this

    van der Linden, W. J., & Veldkamp, B. P. (2002). Constraining item exposure in computerized adaptive testing with shadow tests. (OMD Research Report; No. 02-06). Enschede: Onderwijskundige Meetmethoden en Data-analyse.