CUSUM-based person-fit statistics for adaptive testing

Edith M.L.A. van Krimpen-Stoop, Rob R. Meijer

Research output: Contribution to journalArticleAcademic

54 Citations (Scopus)
11 Downloads (Pure)

Abstract

Item scores that do not fit an assumed item response theory model may cause the latent trait value to be inaccurately estimated. Several person-fit statistics for detecting nonfitting score patterns for paper-and-pencil tests have been proposed. In the context of computerized adaptive tests (CAT), the use of person-fit analysis has hardly been explored. Because it has been shown that the distribution of existing person-fit statistics is not applicable in a CAT, in this study new person-fit statistics are proposed and critical values for these statistics are derived from existing statistical theory. Statistics are proposed that are sensitive to runs of correct or incorrect item scores and are based on all items administered in a CAT or based on subsets of items, using observed and expected item scores and using cumulative sum (CUSUM) procedures. The theoretical and empirical distributions of the statistics are compared and detection rates are investigated. Results showed that the nominal and empirical Type I error rates were comparable for CUSUM procedures when the number of items in each subset and the number of measurement points were not too small. Detection rates of CUSUM procedures were superior to other fit statis­tics. Applications of the statistics are discussed.
Original languageEnglish
Pages (from-to)199-218
Number of pages19
JournalJournal of educational and behavioral statistics
Volume26
Issue number2
DOIs
Publication statusPublished - 2001

Fingerprint

Dive into the research topics of 'CUSUM-based person-fit statistics for adaptive testing'. Together they form a unique fingerprint.

Cite this