Nonparametric and group-based person-fit statistics : a validity study and an empirical example

R.R. Meijer

Research output: Book/ReportReportProfessional

13 Downloads (Pure)

Abstract

In person-fit analysis, the object is to investigate whether an item score pattern is improbable given the item score patterns of the other persons in the group or given what is expected on the basis of a test model. In this study, several existing group-based statistics to detect such improbable score patterns were investigated, along with the cut scores that have been proposed in the literature to classify an item score pattern as aberrant. Through a simulation study and an empirical study, the power of three person-fit statistics was compared, and the practical use of various cut scores was investigated. The empirical study involved 437 Dutch sophomores studying psychology and pedagogics taking an examination on test theory. It was also demonstrated that person-fit statistics can be used to detect persons with a deficiency of knowledge on an achievement test. While one of the statistics was less appropriate in the simulation, the power of the three approaches was approximately the same in the empirical example.
Original languageEnglish
Place of PublicationEnschede
PublisherUniversity of Twente, Faculty Educational Science and Technology
Number of pages38
Publication statusPublished - 1994

Publication series

NameOMD research report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.94-12

Fingerprint

Person
Statistics
Empirical Study
Test Theory
Classify
Simulation Study
Simulation

Keywords

  • Research Methodology
  • Achievement Tests
  • Test Items
  • Cutting Scores
  • Group Membership
  • Higher Education
  • Foreign Countries
  • Identification
  • Simulation
  • Validity
  • Knowledge Level
  • Nonparametric Statistics
  • METIS-140148
  • IR-104202
  • Classification
  • College Students
  • Power (Statistics)

Cite this

Meijer, R. R. (1994). Nonparametric and group-based person-fit statistics : a validity study and an empirical example. (OMD research report; No. 94-12). Enschede: University of Twente, Faculty Educational Science and Technology.
Meijer, R.R. / Nonparametric and group-based person-fit statistics : a validity study and an empirical example. Enschede : University of Twente, Faculty Educational Science and Technology, 1994. 38 p. (OMD research report; 94-12).
@book{292bf044b95c4781b3ad09f855186f5a,
title = "Nonparametric and group-based person-fit statistics : a validity study and an empirical example",
abstract = "In person-fit analysis, the object is to investigate whether an item score pattern is improbable given the item score patterns of the other persons in the group or given what is expected on the basis of a test model. In this study, several existing group-based statistics to detect such improbable score patterns were investigated, along with the cut scores that have been proposed in the literature to classify an item score pattern as aberrant. Through a simulation study and an empirical study, the power of three person-fit statistics was compared, and the practical use of various cut scores was investigated. The empirical study involved 437 Dutch sophomores studying psychology and pedagogics taking an examination on test theory. It was also demonstrated that person-fit statistics can be used to detect persons with a deficiency of knowledge on an achievement test. While one of the statistics was less appropriate in the simulation, the power of the three approaches was approximately the same in the empirical example.",
keywords = "Research Methodology, Achievement Tests, Test Items, Cutting Scores, Group Membership, Higher Education, Foreign Countries, Identification, Simulation, Validity, Knowledge Level, Nonparametric Statistics, METIS-140148, IR-104202, Classification, College Students, Power (Statistics)",
author = "R.R. Meijer",
year = "1994",
language = "English",
series = "OMD research report",
publisher = "University of Twente, Faculty Educational Science and Technology",
number = "94-12",

}

Meijer, RR 1994, Nonparametric and group-based person-fit statistics : a validity study and an empirical example. OMD research report, no. 94-12, University of Twente, Faculty Educational Science and Technology, Enschede.

Nonparametric and group-based person-fit statistics : a validity study and an empirical example. / Meijer, R.R.

Enschede : University of Twente, Faculty Educational Science and Technology, 1994. 38 p. (OMD research report; No. 94-12).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - Nonparametric and group-based person-fit statistics : a validity study and an empirical example

AU - Meijer, R.R.

PY - 1994

Y1 - 1994

N2 - In person-fit analysis, the object is to investigate whether an item score pattern is improbable given the item score patterns of the other persons in the group or given what is expected on the basis of a test model. In this study, several existing group-based statistics to detect such improbable score patterns were investigated, along with the cut scores that have been proposed in the literature to classify an item score pattern as aberrant. Through a simulation study and an empirical study, the power of three person-fit statistics was compared, and the practical use of various cut scores was investigated. The empirical study involved 437 Dutch sophomores studying psychology and pedagogics taking an examination on test theory. It was also demonstrated that person-fit statistics can be used to detect persons with a deficiency of knowledge on an achievement test. While one of the statistics was less appropriate in the simulation, the power of the three approaches was approximately the same in the empirical example.

AB - In person-fit analysis, the object is to investigate whether an item score pattern is improbable given the item score patterns of the other persons in the group or given what is expected on the basis of a test model. In this study, several existing group-based statistics to detect such improbable score patterns were investigated, along with the cut scores that have been proposed in the literature to classify an item score pattern as aberrant. Through a simulation study and an empirical study, the power of three person-fit statistics was compared, and the practical use of various cut scores was investigated. The empirical study involved 437 Dutch sophomores studying psychology and pedagogics taking an examination on test theory. It was also demonstrated that person-fit statistics can be used to detect persons with a deficiency of knowledge on an achievement test. While one of the statistics was less appropriate in the simulation, the power of the three approaches was approximately the same in the empirical example.

KW - Research Methodology

KW - Achievement Tests

KW - Test Items

KW - Cutting Scores

KW - Group Membership

KW - Higher Education

KW - Foreign Countries

KW - Identification

KW - Simulation

KW - Validity

KW - Knowledge Level

KW - Nonparametric Statistics

KW - METIS-140148

KW - IR-104202

KW - Classification

KW - College Students

KW - Power (Statistics)

M3 - Report

T3 - OMD research report

BT - Nonparametric and group-based person-fit statistics : a validity study and an empirical example

PB - University of Twente, Faculty Educational Science and Technology

CY - Enschede

ER -

Meijer RR. Nonparametric and group-based person-fit statistics : a validity study and an empirical example. Enschede: University of Twente, Faculty Educational Science and Technology, 1994. 38 p. (OMD research report; 94-12).