A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing

Research output: Book/ReportReportProfessional

6 Downloads (Pure)

Abstract

The Sympson and Hetter (SH) (1985) method is the accepted method of probabilistic item-exposure control in computerized adaptive testing. However, setting its control parameters to admissible values requires an iterative process of computer simulations that has been found to be time consuming, particularly if the parameters have to be set conditional on a realistic set of values for the examinees’ ability parameter. Several formal properties of the method are given that help us explain why this iterative process can be slow and does not guarantee admissibility. In addition, some alternatives to the SH method are introduced. The behavior of these alternatives was estimated for an adaptive test from an item pool from the Law School Admission Test (LSAT). One of the alternatives showed particularly attractive behavior and converged smoothly to admissibility for all items in a relatively small number of iteration steps.
Original languageEnglish
PublisherLaw School Admission Council
Number of pages12
Publication statusPublished - 2006

Publication series

NameLSAC research report series - Computerized testing report
PublisherLaw School Admission Council
No.02-05

Fingerprint

Exposure controls
Computer simulation
Testing

Keywords

  • IR-98566
  • METIS-313732

Cite this

van der Linden, W. J. (2006). A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. (LSAC research report series - Computerized testing report; No. 02-05). Law School Admission Council.
van der Linden, Willem J. / A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. Law School Admission Council, 2006. 12 p. (LSAC research report series - Computerized testing report; 02-05).
@book{b59d29c1189c43c1868c81a2da5dc72c,
title = "A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing",
abstract = "The Sympson and Hetter (SH) (1985) method is the accepted method of probabilistic item-exposure control in computerized adaptive testing. However, setting its control parameters to admissible values requires an iterative process of computer simulations that has been found to be time consuming, particularly if the parameters have to be set conditional on a realistic set of values for the examinees’ ability parameter. Several formal properties of the method are given that help us explain why this iterative process can be slow and does not guarantee admissibility. In addition, some alternatives to the SH method are introduced. The behavior of these alternatives was estimated for an adaptive test from an item pool from the Law School Admission Test (LSAT). One of the alternatives showed particularly attractive behavior and converged smoothly to admissibility for all items in a relatively small number of iteration steps.",
keywords = "IR-98566, METIS-313732",
author = "{van der Linden}, {Willem J.}",
year = "2006",
language = "English",
series = "LSAC research report series - Computerized testing report",
publisher = "Law School Admission Council",
number = "02-05",

}

van der Linden, WJ 2006, A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. LSAC research report series - Computerized testing report, no. 02-05, Law School Admission Council.

A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. / van der Linden, Willem J.

Law School Admission Council, 2006. 12 p. (LSAC research report series - Computerized testing report; No. 02-05).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing

AU - van der Linden, Willem J.

PY - 2006

Y1 - 2006

N2 - The Sympson and Hetter (SH) (1985) method is the accepted method of probabilistic item-exposure control in computerized adaptive testing. However, setting its control parameters to admissible values requires an iterative process of computer simulations that has been found to be time consuming, particularly if the parameters have to be set conditional on a realistic set of values for the examinees’ ability parameter. Several formal properties of the method are given that help us explain why this iterative process can be slow and does not guarantee admissibility. In addition, some alternatives to the SH method are introduced. The behavior of these alternatives was estimated for an adaptive test from an item pool from the Law School Admission Test (LSAT). One of the alternatives showed particularly attractive behavior and converged smoothly to admissibility for all items in a relatively small number of iteration steps.

AB - The Sympson and Hetter (SH) (1985) method is the accepted method of probabilistic item-exposure control in computerized adaptive testing. However, setting its control parameters to admissible values requires an iterative process of computer simulations that has been found to be time consuming, particularly if the parameters have to be set conditional on a realistic set of values for the examinees’ ability parameter. Several formal properties of the method are given that help us explain why this iterative process can be slow and does not guarantee admissibility. In addition, some alternatives to the SH method are introduced. The behavior of these alternatives was estimated for an adaptive test from an item pool from the Law School Admission Test (LSAT). One of the alternatives showed particularly attractive behavior and converged smoothly to admissibility for all items in a relatively small number of iteration steps.

KW - IR-98566

KW - METIS-313732

M3 - Report

T3 - LSAC research report series - Computerized testing report

BT - A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing

PB - Law School Admission Council

ER -

van der Linden WJ. A formal characterization of and some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. Law School Admission Council, 2006. 12 p. (LSAC research report series - Computerized testing report; 02-05).