A Statistical Test for the Detection of Item Compromise Combining Responses and Response Times

Wim J. van der Linden*, Dmitry I. Belov

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

2 Citations (Scopus)
34 Downloads (Pure)

Abstract

A test of item compromise is presented which combines the test takers' responses and response times (RTs) into a statistic defined as the number of correct responses on the item for test takers with RTs flagged as suspicious. The test has null and alternative distributions belonging to the well-known family of compound binomial distributions, is simple to calculate, and has results that are easy to interpret. It also demonstrated nearly perfect power for the detection of compromise with no more than 10 test takers with preknowledge of the more difficult and discriminating items in a set of empirical examples. For the easier and less discriminating items, the presence of some 20 test takers with preknowledge still sufficed. A test based on the reverse statistic of the total time by test takers with responses flagged as suspicious may seem a natural alternative but misses the property of a monotone likelihood ratio necessary to decide between a test that should be left or right sided.

Original languageEnglish
JournalJournal of educational measurement
DOIs
Publication statusE-pub ahead of print/First online - 28 Oct 2022

Keywords

  • UT-Hybrid-D

Fingerprint

Dive into the research topics of 'A Statistical Test for the Detection of Item Compromise Combining Responses and Response Times'. Together they form a unique fingerprint.

Cite this