Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing

Willem J. van der Linden, David J. Scrams, Deborah L. Schnipke

Research output: Book/ReportReportOther research output

Abstract

This paper proposes an item selection algorithm that can be used to neutralize the effect of time limits in computer adaptive testing. The method is based on a statistical model for the response-time distributions of the test takers on the items in the pool that is updated each time a new item has been administered. Predictions from the model are used as constraints in a 0-1 linear programming model for constrained adaptive testing that maximizes the accuracy of the ability estimator. The method is demonstrated empirically using an item pool from an operational, large-scale computer adaptive test.
Original languageUndefined
Place of PublicationNewton, PA, USA
PublisherLaw School Admission Council
Publication statusPublished - 2003

Publication series

NameLSAC research report series
PublisherLaw School Admission Council
No.98-03

Keywords

  • Computer Assisted Testing
  • Test Items
  • Responses
  • Selection
  • Linear Programming
  • Timed Tests
  • Algorithms
  • Adaptive Testing
  • IR-103566

Cite this

van der Linden, W. J., Scrams, D. J., & Schnipke, D. L. (2003). Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing. (LSAC research report series; No. 98-03). Newton, PA, USA: Law School Admission Council.
van der Linden, Willem J. ; Scrams, David J. ; Schnipke, Deborah L. / Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing. Newton, PA, USA : Law School Admission Council, 2003. (LSAC research report series; 98-03).
@book{1c062d2b23a64b25b53ea4ce21f9d0e5,
title = "Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing",
abstract = "This paper proposes an item selection algorithm that can be used to neutralize the effect of time limits in computer adaptive testing. The method is based on a statistical model for the response-time distributions of the test takers on the items in the pool that is updated each time a new item has been administered. Predictions from the model are used as constraints in a 0-1 linear programming model for constrained adaptive testing that maximizes the accuracy of the ability estimator. The method is demonstrated empirically using an item pool from an operational, large-scale computer adaptive test.",
keywords = "Computer Assisted Testing, Test Items, Responses, Selection, Linear Programming, Timed Tests, Algorithms, Adaptive Testing, IR-103566",
author = "{van der Linden}, {Willem J.} and Scrams, {David J.} and Schnipke, {Deborah L.}",
year = "2003",
language = "Undefined",
series = "LSAC research report series",
publisher = "Law School Admission Council",
number = "98-03",

}

van der Linden, WJ, Scrams, DJ & Schnipke, DL 2003, Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing. LSAC research report series, no. 98-03, Law School Admission Council, Newton, PA, USA.

Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing. / van der Linden, Willem J.; Scrams, David J.; Schnipke, Deborah L.

Newton, PA, USA : Law School Admission Council, 2003. (LSAC research report series; No. 98-03).

Research output: Book/ReportReportOther research output

TY - BOOK

T1 - Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing

AU - van der Linden, Willem J.

AU - Scrams, David J.

AU - Schnipke, Deborah L.

PY - 2003

Y1 - 2003

N2 - This paper proposes an item selection algorithm that can be used to neutralize the effect of time limits in computer adaptive testing. The method is based on a statistical model for the response-time distributions of the test takers on the items in the pool that is updated each time a new item has been administered. Predictions from the model are used as constraints in a 0-1 linear programming model for constrained adaptive testing that maximizes the accuracy of the ability estimator. The method is demonstrated empirically using an item pool from an operational, large-scale computer adaptive test.

AB - This paper proposes an item selection algorithm that can be used to neutralize the effect of time limits in computer adaptive testing. The method is based on a statistical model for the response-time distributions of the test takers on the items in the pool that is updated each time a new item has been administered. Predictions from the model are used as constraints in a 0-1 linear programming model for constrained adaptive testing that maximizes the accuracy of the ability estimator. The method is demonstrated empirically using an item pool from an operational, large-scale computer adaptive test.

KW - Computer Assisted Testing

KW - Test Items

KW - Responses

KW - Selection

KW - Linear Programming

KW - Timed Tests

KW - Algorithms

KW - Adaptive Testing

KW - IR-103566

M3 - Report

T3 - LSAC research report series

BT - Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing

PB - Law School Admission Council

CY - Newton, PA, USA

ER -

van der Linden WJ, Scrams DJ, Schnipke DL. Using response-time constraints in item selection to control for differential speededness in computerized adaptive testing. Newton, PA, USA: Law School Admission Council, 2003. (LSAC research report series; 98-03).