Two new statistics to detect answer copying

R.R. Meijer, Leonardo Sotaridona

Research output: Book/ReportReportProfessional

47 Downloads (Pure)

Abstract

Two new indices to detect answer copying on a multiple-choice test, S(1) and S(2) (subscripts), are proposed. The S(1) index is similar to the K-index (P. Holland, 1996) and the K-overscore(2), (K2) index (L. Sotaridona and R. Meijer, in press), but the distribution of the number of matching incorrect answers of the source (examinee s) and the copier (examinee c) is modeled by the Poisson distribution instead of the binomial distribution to improve the detection rate of K and K2. The S(2) index was proposed to overcome a limitation of the K and K2 indexes, namely their insensitiveness to correct answers copying. The S(2) index incorporates the matching correct answers in addition to the matching incorrect answers. A simulation study was conducted to investigate the usefulness of S(1) and S(2) for 40- and 80- item tests, 100 and 500 sample sizes, and 10%, 20%, 30% , and 40% answer copying. The Type I errors and detection rates of S(1) and S(2) were compared with those of the K2 and the w (omega) copying index (J. Wollack, 1997). Results show that all four indexes are able to maintain their Type I errors, with S(1) and K2 being slightly conservative compared to S(2) and w. Furthermore, S(1) had higher detection rates than K2. The S(2) index showed a significant improvement in detection rate compared to K and K2.
Original languageEnglish
Place of PublicationEnschede
PublisherUniversity of Twente, Faculty Educational Science and Technology
Number of pages30
Publication statusPublished - 2001

Publication series

NameOMD research report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.01-07

Fingerprint

index
statistics
detection
rate
simulation
distribution
test

Keywords

  • Responses
  • Cheating
  • IR-104120
  • Statistical Analysis
  • Statistical Distributions
  • METIS-205696
  • Multiple Choice Tests
  • Sample Size
  • Test Items
  • Simulation

Cite this

Meijer, R. R., & Sotaridona, L. (2001). Two new statistics to detect answer copying. (OMD research report; No. 01-07). Enschede: University of Twente, Faculty Educational Science and Technology.
Meijer, R.R. ; Sotaridona, Leonardo. / Two new statistics to detect answer copying. Enschede : University of Twente, Faculty Educational Science and Technology, 2001. 30 p. (OMD research report; 01-07).
@book{e39e9b63970846c2842dae61f1217c14,
title = "Two new statistics to detect answer copying",
abstract = "Two new indices to detect answer copying on a multiple-choice test, S(1) and S(2) (subscripts), are proposed. The S(1) index is similar to the K-index (P. Holland, 1996) and the K-overscore(2), (K2) index (L. Sotaridona and R. Meijer, in press), but the distribution of the number of matching incorrect answers of the source (examinee s) and the copier (examinee c) is modeled by the Poisson distribution instead of the binomial distribution to improve the detection rate of K and K2. The S(2) index was proposed to overcome a limitation of the K and K2 indexes, namely their insensitiveness to correct answers copying. The S(2) index incorporates the matching correct answers in addition to the matching incorrect answers. A simulation study was conducted to investigate the usefulness of S(1) and S(2) for 40- and 80- item tests, 100 and 500 sample sizes, and 10{\%}, 20{\%}, 30{\%} , and 40{\%} answer copying. The Type I errors and detection rates of S(1) and S(2) were compared with those of the K2 and the w (omega) copying index (J. Wollack, 1997). Results show that all four indexes are able to maintain their Type I errors, with S(1) and K2 being slightly conservative compared to S(2) and w. Furthermore, S(1) had higher detection rates than K2. The S(2) index showed a significant improvement in detection rate compared to K and K2.",
keywords = "Responses, Cheating, IR-104120, Statistical Analysis, Statistical Distributions, METIS-205696, Multiple Choice Tests, Sample Size, Test Items, Simulation",
author = "R.R. Meijer and Leonardo Sotaridona",
year = "2001",
language = "English",
series = "OMD research report",
publisher = "University of Twente, Faculty Educational Science and Technology",
number = "01-07",

}

Meijer, RR & Sotaridona, L 2001, Two new statistics to detect answer copying. OMD research report, no. 01-07, University of Twente, Faculty Educational Science and Technology, Enschede.

Two new statistics to detect answer copying. / Meijer, R.R.; Sotaridona, Leonardo.

Enschede : University of Twente, Faculty Educational Science and Technology, 2001. 30 p. (OMD research report; No. 01-07).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - Two new statistics to detect answer copying

AU - Meijer, R.R.

AU - Sotaridona, Leonardo

PY - 2001

Y1 - 2001

N2 - Two new indices to detect answer copying on a multiple-choice test, S(1) and S(2) (subscripts), are proposed. The S(1) index is similar to the K-index (P. Holland, 1996) and the K-overscore(2), (K2) index (L. Sotaridona and R. Meijer, in press), but the distribution of the number of matching incorrect answers of the source (examinee s) and the copier (examinee c) is modeled by the Poisson distribution instead of the binomial distribution to improve the detection rate of K and K2. The S(2) index was proposed to overcome a limitation of the K and K2 indexes, namely their insensitiveness to correct answers copying. The S(2) index incorporates the matching correct answers in addition to the matching incorrect answers. A simulation study was conducted to investigate the usefulness of S(1) and S(2) for 40- and 80- item tests, 100 and 500 sample sizes, and 10%, 20%, 30% , and 40% answer copying. The Type I errors and detection rates of S(1) and S(2) were compared with those of the K2 and the w (omega) copying index (J. Wollack, 1997). Results show that all four indexes are able to maintain their Type I errors, with S(1) and K2 being slightly conservative compared to S(2) and w. Furthermore, S(1) had higher detection rates than K2. The S(2) index showed a significant improvement in detection rate compared to K and K2.

AB - Two new indices to detect answer copying on a multiple-choice test, S(1) and S(2) (subscripts), are proposed. The S(1) index is similar to the K-index (P. Holland, 1996) and the K-overscore(2), (K2) index (L. Sotaridona and R. Meijer, in press), but the distribution of the number of matching incorrect answers of the source (examinee s) and the copier (examinee c) is modeled by the Poisson distribution instead of the binomial distribution to improve the detection rate of K and K2. The S(2) index was proposed to overcome a limitation of the K and K2 indexes, namely their insensitiveness to correct answers copying. The S(2) index incorporates the matching correct answers in addition to the matching incorrect answers. A simulation study was conducted to investigate the usefulness of S(1) and S(2) for 40- and 80- item tests, 100 and 500 sample sizes, and 10%, 20%, 30% , and 40% answer copying. The Type I errors and detection rates of S(1) and S(2) were compared with those of the K2 and the w (omega) copying index (J. Wollack, 1997). Results show that all four indexes are able to maintain their Type I errors, with S(1) and K2 being slightly conservative compared to S(2) and w. Furthermore, S(1) had higher detection rates than K2. The S(2) index showed a significant improvement in detection rate compared to K and K2.

KW - Responses

KW - Cheating

KW - IR-104120

KW - Statistical Analysis

KW - Statistical Distributions

KW - METIS-205696

KW - Multiple Choice Tests

KW - Sample Size

KW - Test Items

KW - Simulation

M3 - Report

T3 - OMD research report

BT - Two new statistics to detect answer copying

PB - University of Twente, Faculty Educational Science and Technology

CY - Enschede

ER -

Meijer RR, Sotaridona L. Two new statistics to detect answer copying. Enschede: University of Twente, Faculty Educational Science and Technology, 2001. 30 p. (OMD research report; 01-07).