Chance-Constrained Automated Test Assembly

Giada Spaccapanico Proietti, Mariagiulia Matteucci, Stefania Mignani, Bernard P. Veldkamp

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Classical automated test assembly (ATA) methods assume fixed and known coefficients for the constraints and the objective function. This hypothesis is not true for the estimates of item response theory parameters, which are crucial elements in test assembly classical models. To account for uncertainty in ATA, we propose a chance-constrained version of the maximin ATA model, which allows maximizing the α-quantile of the sampling distribution of the test information function obtained by applying the bootstrap on the item parameter estimation. A heuristic inspired by the simulated annealing optimization technique is implemented to solve the ATA model. The validity of the proposed approach is empirically demonstrated by a simulation study. The applicability is proven by using the real responses to the Trends in International Mathematics and Science Study (TIMSS) 2015 science test.

Original languageEnglish
JournalJournal of educational and behavioral statistics
DOIs
Publication statusE-pub ahead of print/First online - 9 May 2023

Keywords

  • automated test assembly
  • chance-constrained
  • simulated annealing
  • uncertainty
  • 2023 OA procedure

Fingerprint

Dive into the research topics of 'Chance-Constrained Automated Test Assembly'. Together they form a unique fingerprint.

Cite this