Optimal testlet pool assembly for multistage testing designs

A. Ariel, Bernard P. Veldkamp, Krista Breithaupt

Research output: Contribution to journalArticleProfessional

5 Citations (Scopus)

Abstract

Computerized multistage testing (MST) designs require sets of test questions (testlets) to be assembled to meet strict, often competing criteria. Rules that govern testlet assembly may dictate the number of questions on a particular subject or may describe desirable statistical properties for the test, such as measurement precision. In an MST design, testlets of differing difficulty levels must be created. Statistical properties for assembly of the testlets can be expressed using item response theory (IRT) parameters. The testlet test information function (TIF) value can be maximized at a specific point on the IRT ability scale. In practical MST designs, parallel versions of testlets are needed, so sets of testlets with equivalent properties are built according to equivalent specifications. In this project, the authors study the use of a mathematical programming technique to simultaneously assemble testlets to ensure equivalence and fairness to candidates who may be administered different testlets.
Original languageUndefined
Pages (from-to)204-215
Number of pages11
JournalApplied psychological measurement
Volume30
Issue number3
DOIs
Publication statusPublished - 2006

Keywords

  • testlet assembly problem
  • METIS-234089
  • IR-60074
  • Mathematical Programming
  • Security
  • multi-stage testing
  • testlet

Cite this