Using response-time Constraints in item selection to control for differential speededness in computerized adaptive testing

Willem J. van der Linden, David J. Scrams, Deborah L. Schnipke

Research output: Book/ReportReportProfessional

14 Downloads (Pure)

Abstract

An item-selection algorithm to neutralize the differential effects of time limits on scores on computerized adaptive tests is proposed. The method is based on a statistical model for the response-time distributions of the examinees on items in the pool that is updated each time a new item has been administered. Predictions from the model are used as constraints in a 0-1 linear programming (LP) model for constrained adaptive testing that maximizes the accuracy of the ability estimator. The method is demonstrated empirically using an item pool from the Armed Services Vocational Aptitude Battery and the responses of 38,357 examinees. The empirical example suggests that the algorithm is able to reduce the speededness of the test for the examinees who otherwise would have suffered from the time limit. Also, the algorithm did not seem to introduce any differential effects on the statistical properties of the theta estimator.
Original languageEnglish
Place of PublicationEnschede
PublisherUniversity of Twente, Faculty Educational Science and Technology
Publication statusPublished - 1998

Publication series

NameOMD Research Report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.98-06

Keywords

  • Linear Programming
  • Selection
  • Test Items
  • Responses
  • Testing Problems
  • Time
  • METIS-136546
  • Adaptive Testing
  • Models
  • Foreign Countries
  • Algorithms
  • IR-103752
  • Computer Assisted Testing

Fingerprint Dive into the research topics of 'Using response-time Constraints in item selection to control for differential speededness in computerized adaptive testing'. Together they form a unique fingerprint.

Cite this