Unproctored internet test verification: Using adaptive confirmation testing

Guido Makransky, Cornelis A.W. Glas

Research output: Contribution to journalArticleAcademicpeer-review

17 Citations (Scopus)
13 Downloads (Pure)

Abstract

Unproctored Internet testing (UIT) is commonly used in employment test administration. When the test is high stakes, the International Guidelines on Computer-Based and Internet-Delivered Testing recommend to follow up the results with a confirmation test in a controlled setting. This article proposes and compares two methods for detecting whether a test taker’s original UIT responses are consistent with the responses from a follow-up confirmation test. The first method is a fixed length adaptive confirmation test using the likelihood ratio (LR) test to evaluate cheating and the second method is a variable length adaptive confirmation test using an extension of the stochastic curtailed truncated sequential probability ratio test (SCTSPRT) to evaluate cheating. Simulation studies indicated that the adaptive confirmation test using the SCTSPRT was almost four times shorter while maintaining the same detection power. The study also demonstrated that cheating can have a detrimental effect on the validity of a selection procedure and illustrated that the use of a confirmation test can remedy the negative effect of cheating on validity.
Original languageEnglish
Pages (from-to)608-630
JournalOrganizational research methods
Volume14
Issue number4
DOIs
Publication statusPublished - 2 Jun 2011

Keywords

  • unproctored Internet testing
  • computer adaptive testing
  • METIS-282126
  • Item Response Theory
  • IR-104272

Fingerprint

Dive into the research topics of 'Unproctored internet test verification: Using adaptive confirmation testing'. Together they form a unique fingerprint.

Cite this