Detecting answer copying using the kappa statistic

Leonardo Sotaridona, Willem J. van der Linden, R.R. Meijer

Research output: Contribution to journalArticleProfessional

15 Citations (Scopus)

Abstract

A statistical test for detecting answer copying on multiple-choice tests based on Cohen's kappa is proposed. The test is free of any assumptions on the response processes of the examinees suspected of copying and having served as the source, except for the usual assumption that these processes are probabilistic. Because the asymptotic null and alternative distributions of the kappa statistic are derived under the assumption of common marginal probabilities for all items, a recoding of the item alternatives is proposed to approximate this case. The results from a simulation study in this article show that under this recoding, the test approximates its nominal Type I error rates and has promising power functions.
Original languageUndefined
Pages (from-to)412-431
Number of pages19
JournalApplied psychological measurement
Volume30
Issue number5
DOIs
Publication statusPublished - 2006

Keywords

  • METIS-235080
  • Type I error
  • Kappa statistic
  • power analysis
  • Answer Copying
  • IR-60069

Cite this