A multiple objective test assembly approach for exposure control problems in computerized adaptive testing

Research output: Contribution to journalArticleAcademicpeer-review

15 Downloads (Pure)

Abstract

Overexposure and underexposure of items in the bank are serious problems in operational computerized adaptive testing (CAT) systems. These exposure problems might result in item compromise, or point at a waste of investments. The exposure control problem can be viewed as a test assembly problem with multiple objectives. Information in the test has to be maximized, item compromise has to be minimized, and pool usage has to be optimized. In this paper, a multiple objectives method is developed to deal with both types of exposure problems. In this method, exposure control parameters based on observed exposure rates are implemented as weights for the information in the item selection procedure. The method does not need time consuming simulation studies, and it can be implemented conditional on ability level. The method is compared with Sympson Hetter method for exposure control, with the Progressive method and with alphastratified testing. The results show that the method is successful in dealing with both kinds of exposure problems.
Original languageEnglish
Pages (from-to)335-355
Number of pages21
JournalPsicologica
Volume31
Issue number2
Publication statusPublished - 2010

Keywords

  • Computerized Adaptive Testing
  • Item Response Theory
  • exposure control
  • IR-98562
  • item selection
  • METIS-272460
  • item bank usage

Fingerprint Dive into the research topics of 'A multiple objective test assembly approach for exposure control problems in computerized adaptive testing'. Together they form a unique fingerprint.

  • Cite this