A model for optimal constrained adaptive testing

Willem J. van der Linden, Lynda M. Reese

Research output: Book/ReportReportOther research output

24 Downloads (Pure)

Abstract

A model for constrained computerized adaptive testing is proposed in which the information on the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing the items previously administered. Then the item with maximum information is selected from the test. All test assembly is optimal due to the use of a linear programming model that is automatically updated to allow for the attributes of the items already administered as well as the new value of the ability estimator. A simulation study using a pool of 753 items from the Law School Admission Test (LSAT) shows that for adaptive tests of realistic lengths the ability estimator did not suffer any loss of efficiency from the presence of 433 constraints on the item selection process.
Original languageUndefined
Place of PublicationNewton, PA, USA
PublisherLaw School Admission Council
Publication statusPublished - 2001

Publication series

NameLSAC research report series
PublisherLaw School Admission Council
No.97-07

Keywords

  • Computer Assisted Testing
  • IR-103570
  • Adaptive Testing
  • Ability
  • College Entrance Examinations
  • Simulation
  • Models
  • Estimation (Mathematics)
  • Law Schools

Cite this

van der Linden, W. J., & Reese, L. M. (2001). A model for optimal constrained adaptive testing. (LSAC research report series; No. 97-07). Newton, PA, USA: Law School Admission Council.
van der Linden, Willem J. ; Reese, Lynda M. / A model for optimal constrained adaptive testing. Newton, PA, USA : Law School Admission Council, 2001. (LSAC research report series; 97-07).
@book{865e592d14eb4c548914c158cc3b719d,
title = "A model for optimal constrained adaptive testing",
abstract = "A model for constrained computerized adaptive testing is proposed in which the information on the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing the items previously administered. Then the item with maximum information is selected from the test. All test assembly is optimal due to the use of a linear programming model that is automatically updated to allow for the attributes of the items already administered as well as the new value of the ability estimator. A simulation study using a pool of 753 items from the Law School Admission Test (LSAT) shows that for adaptive tests of realistic lengths the ability estimator did not suffer any loss of efficiency from the presence of 433 constraints on the item selection process.",
keywords = "Computer Assisted Testing, IR-103570, Adaptive Testing, Ability, College Entrance Examinations, Simulation, Models, Estimation (Mathematics), Law Schools",
author = "{van der Linden}, {Willem J.} and Reese, {Lynda M.}",
year = "2001",
language = "Undefined",
series = "LSAC research report series",
publisher = "Law School Admission Council",
number = "97-07",

}

van der Linden, WJ & Reese, LM 2001, A model for optimal constrained adaptive testing. LSAC research report series, no. 97-07, Law School Admission Council, Newton, PA, USA.

A model for optimal constrained adaptive testing. / van der Linden, Willem J.; Reese, Lynda M.

Newton, PA, USA : Law School Admission Council, 2001. (LSAC research report series; No. 97-07).

Research output: Book/ReportReportOther research output

TY - BOOK

T1 - A model for optimal constrained adaptive testing

AU - van der Linden, Willem J.

AU - Reese, Lynda M.

PY - 2001

Y1 - 2001

N2 - A model for constrained computerized adaptive testing is proposed in which the information on the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing the items previously administered. Then the item with maximum information is selected from the test. All test assembly is optimal due to the use of a linear programming model that is automatically updated to allow for the attributes of the items already administered as well as the new value of the ability estimator. A simulation study using a pool of 753 items from the Law School Admission Test (LSAT) shows that for adaptive tests of realistic lengths the ability estimator did not suffer any loss of efficiency from the presence of 433 constraints on the item selection process.

AB - A model for constrained computerized adaptive testing is proposed in which the information on the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing the items previously administered. Then the item with maximum information is selected from the test. All test assembly is optimal due to the use of a linear programming model that is automatically updated to allow for the attributes of the items already administered as well as the new value of the ability estimator. A simulation study using a pool of 753 items from the Law School Admission Test (LSAT) shows that for adaptive tests of realistic lengths the ability estimator did not suffer any loss of efficiency from the presence of 433 constraints on the item selection process.

KW - Computer Assisted Testing

KW - IR-103570

KW - Adaptive Testing

KW - Ability

KW - College Entrance Examinations

KW - Simulation

KW - Models

KW - Estimation (Mathematics)

KW - Law Schools

M3 - Report

T3 - LSAC research report series

BT - A model for optimal constrained adaptive testing

PB - Law School Admission Council

CY - Newton, PA, USA

ER -

van der Linden WJ, Reese LM. A model for optimal constrained adaptive testing. Newton, PA, USA: Law School Admission Council, 2001. (LSAC research report series; 97-07).