Detecting differential speededness in multistage testing

Willem J. van der Linden, Krista Breithaupt, Siang Chee Chuah, Yanwei Zhang

Research output: Contribution to journalArticleAcademicpeer-review

43 Citations (Scopus)

Abstract

A potential undesirable effect of multistage testing is differential speededness, which happens if some of the test takers run out of time because they receive subtests with items that are more time intensive than others. This article shows how a probabilistic response-time model can be used for estimating differences in time intensities and speed between subtests and test takers and detecting differential speededness. An empirical data set for a multistage test in the computerized CPA Exam was used to demonstrate the procedures. Although the more difficult subtests appeared to have items that were more time intensive than the easier subtests, an analysis of the residual response times did not reveal any significant differential speededness because the time limit appeared to be appropriate. In a separate analysis, within each of the subtests, we found minor but consistent patterns of residual times that are believed to be due to a warm-up effect, that is, use of more time on the initial items than they actually need.
Original languageUndefined
Pages (from-to)117-130
Number of pages13
JournalJournal of educational measurement
Volume44
Issue number2
DOIs
Publication statusPublished - 2007

Keywords

  • METIS-244355
  • IR-58415

Cite this