Person fit based on statistical process control in an adaptive testing environment

Edith van Krimpen-Stoop, R.R. Meijer

Research output: Book/ReportReportProfessional

11 Downloads (Pure)

Abstract

Person-fit research in the context of paper-and-pencil tests is reviewed, and some specific problems regarding person fit in the context of computerized adaptive testing (CAT) are discussed. Some new methods are proposed to investigate person fit in a CAT environment. These statistics are based on Statistical Process Control (SPC) theory. A technique from SPC that is effective in detecting small shifts in the mean of the variable being measured is the cumulative sum (CUSUM) procedure. How CUSUM is applied to CATs is outlined, and eight statistics are proposed to investigate the sum of consecutive negative or positive residuals. Two simulation studies evaluated the use of these eight statistics. Results show that the detection rates of these statistics are dependent on the type of aberrance simulated. Conditions under which the statistics can be used or should not be used are discussed.
Original languageEnglish
Place of PublicationEnschede
PublisherUniversiteit Twente TO/OMD
Number of pages23
Publication statusPublished - 1998

Publication series

NameOMD Research Report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.98-13

Fingerprint

Adaptive Testing
Statistical Process Control
Person
Statistics
Cumulative Sum
Control Theory
Consecutive
Simulation Study
Dependent

Keywords

  • Simulation
  • Computer Assisted Testing
  • METIS-136531
  • Goodness of Fit
  • IR-103771
  • Adaptive Testing

Cite this

van Krimpen-Stoop, E., & Meijer, R. R. (1998). Person fit based on statistical process control in an adaptive testing environment. (OMD Research Report; No. 98-13). Enschede: Universiteit Twente TO/OMD.
van Krimpen-Stoop, Edith ; Meijer, R.R. / Person fit based on statistical process control in an adaptive testing environment. Enschede : Universiteit Twente TO/OMD, 1998. 23 p. (OMD Research Report; 98-13).
@book{aba518523f874840bc782d8185cdfcd4,
title = "Person fit based on statistical process control in an adaptive testing environment",
abstract = "Person-fit research in the context of paper-and-pencil tests is reviewed, and some specific problems regarding person fit in the context of computerized adaptive testing (CAT) are discussed. Some new methods are proposed to investigate person fit in a CAT environment. These statistics are based on Statistical Process Control (SPC) theory. A technique from SPC that is effective in detecting small shifts in the mean of the variable being measured is the cumulative sum (CUSUM) procedure. How CUSUM is applied to CATs is outlined, and eight statistics are proposed to investigate the sum of consecutive negative or positive residuals. Two simulation studies evaluated the use of these eight statistics. Results show that the detection rates of these statistics are dependent on the type of aberrance simulated. Conditions under which the statistics can be used or should not be used are discussed.",
keywords = "Simulation, Computer Assisted Testing, METIS-136531, Goodness of Fit, IR-103771, Adaptive Testing",
author = "{van Krimpen-Stoop}, Edith and R.R. Meijer",
year = "1998",
language = "English",
series = "OMD Research Report",
publisher = "Universiteit Twente TO/OMD",
number = "98-13",

}

van Krimpen-Stoop, E & Meijer, RR 1998, Person fit based on statistical process control in an adaptive testing environment. OMD Research Report, no. 98-13, Universiteit Twente TO/OMD, Enschede.

Person fit based on statistical process control in an adaptive testing environment. / van Krimpen-Stoop, Edith; Meijer, R.R.

Enschede : Universiteit Twente TO/OMD, 1998. 23 p. (OMD Research Report; No. 98-13).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - Person fit based on statistical process control in an adaptive testing environment

AU - van Krimpen-Stoop, Edith

AU - Meijer, R.R.

PY - 1998

Y1 - 1998

N2 - Person-fit research in the context of paper-and-pencil tests is reviewed, and some specific problems regarding person fit in the context of computerized adaptive testing (CAT) are discussed. Some new methods are proposed to investigate person fit in a CAT environment. These statistics are based on Statistical Process Control (SPC) theory. A technique from SPC that is effective in detecting small shifts in the mean of the variable being measured is the cumulative sum (CUSUM) procedure. How CUSUM is applied to CATs is outlined, and eight statistics are proposed to investigate the sum of consecutive negative or positive residuals. Two simulation studies evaluated the use of these eight statistics. Results show that the detection rates of these statistics are dependent on the type of aberrance simulated. Conditions under which the statistics can be used or should not be used are discussed.

AB - Person-fit research in the context of paper-and-pencil tests is reviewed, and some specific problems regarding person fit in the context of computerized adaptive testing (CAT) are discussed. Some new methods are proposed to investigate person fit in a CAT environment. These statistics are based on Statistical Process Control (SPC) theory. A technique from SPC that is effective in detecting small shifts in the mean of the variable being measured is the cumulative sum (CUSUM) procedure. How CUSUM is applied to CATs is outlined, and eight statistics are proposed to investigate the sum of consecutive negative or positive residuals. Two simulation studies evaluated the use of these eight statistics. Results show that the detection rates of these statistics are dependent on the type of aberrance simulated. Conditions under which the statistics can be used or should not be used are discussed.

KW - Simulation

KW - Computer Assisted Testing

KW - METIS-136531

KW - Goodness of Fit

KW - IR-103771

KW - Adaptive Testing

M3 - Report

T3 - OMD Research Report

BT - Person fit based on statistical process control in an adaptive testing environment

PB - Universiteit Twente TO/OMD

CY - Enschede

ER -

van Krimpen-Stoop E, Meijer RR. Person fit based on statistical process control in an adaptive testing environment. Enschede: Universiteit Twente TO/OMD, 1998. 23 p. (OMD Research Report; 98-13).