Consistency of test behaviour and individual difference in prescision of prediction

R.R. Meijer

Research output: Contribution to journalArticleAcademic

12 Citations (Scopus)

Abstract

Ghiselli ((1956, 1960) argued that the precision of prediction on the basis of a test may vary for different individuals. To quantify the individual precision of prediction he compared the observed criterion scores with the expected criterion scores estimated on the basis of the total scores on a predictor test. Using these difference scores as a moderator variable, predictor tests were developed to identify persons with large errors of prediction. One of the drawbacks of Ghiselli's methods is that it is very situation specific. As an alternative, Hulin, Drasgow & Parsons (1983) proposed to identify persons with inconsistent or unscalable test responses by means of appropriateness measurement (or person-fit) statistics. In the present study a person-fit statistic is used to identify persons with unexpected test responses on selection data. It is shown that, in general, persons with inconsistent test responses are less predictable than those with consistent test responses. Both persons with lower criterion scores as well as persons with higher criterion scores than predicted could be identified. Because person-fit statistics are relatively easy to calculate, they may be used to improve the precision of measurement in selection settings. Implications for the selection practice are discussed.
Original languageEnglish
Pages (from-to)147-160
Number of pages13
JournalDiabetes care
Volume71
Issue number2
DOIs
Publication statusPublished - 1998

Fingerprint

Individuality
Epidemiologic Effect Modifiers

Keywords

  • METIS-135405
  • IR-104288

Cite this

@article{1331e20e0af14002a26feed86d52ad86,
title = "Consistency of test behaviour and individual difference in prescision of prediction",
abstract = "Ghiselli ((1956, 1960) argued that the precision of prediction on the basis of a test may vary for different individuals. To quantify the individual precision of prediction he compared the observed criterion scores with the expected criterion scores estimated on the basis of the total scores on a predictor test. Using these difference scores as a moderator variable, predictor tests were developed to identify persons with large errors of prediction. One of the drawbacks of Ghiselli's methods is that it is very situation specific. As an alternative, Hulin, Drasgow & Parsons (1983) proposed to identify persons with inconsistent or unscalable test responses by means of appropriateness measurement (or person-fit) statistics. In the present study a person-fit statistic is used to identify persons with unexpected test responses on selection data. It is shown that, in general, persons with inconsistent test responses are less predictable than those with consistent test responses. Both persons with lower criterion scores as well as persons with higher criterion scores than predicted could be identified. Because person-fit statistics are relatively easy to calculate, they may be used to improve the precision of measurement in selection settings. Implications for the selection practice are discussed.",
keywords = "METIS-135405, IR-104288",
author = "R.R. Meijer",
year = "1998",
doi = "10.1111/j.2044-8325.1998.tb00668.x",
language = "English",
volume = "71",
pages = "147--160",
journal = "Diabetes care",
issn = "0149-5992",
publisher = "American Diabetes Association Inc.",
number = "2",

}

Consistency of test behaviour and individual difference in prescision of prediction. / Meijer, R.R.

In: Diabetes care, Vol. 71, No. 2, 1998, p. 147-160.

Research output: Contribution to journalArticleAcademic

TY - JOUR

T1 - Consistency of test behaviour and individual difference in prescision of prediction

AU - Meijer, R.R.

PY - 1998

Y1 - 1998

N2 - Ghiselli ((1956, 1960) argued that the precision of prediction on the basis of a test may vary for different individuals. To quantify the individual precision of prediction he compared the observed criterion scores with the expected criterion scores estimated on the basis of the total scores on a predictor test. Using these difference scores as a moderator variable, predictor tests were developed to identify persons with large errors of prediction. One of the drawbacks of Ghiselli's methods is that it is very situation specific. As an alternative, Hulin, Drasgow & Parsons (1983) proposed to identify persons with inconsistent or unscalable test responses by means of appropriateness measurement (or person-fit) statistics. In the present study a person-fit statistic is used to identify persons with unexpected test responses on selection data. It is shown that, in general, persons with inconsistent test responses are less predictable than those with consistent test responses. Both persons with lower criterion scores as well as persons with higher criterion scores than predicted could be identified. Because person-fit statistics are relatively easy to calculate, they may be used to improve the precision of measurement in selection settings. Implications for the selection practice are discussed.

AB - Ghiselli ((1956, 1960) argued that the precision of prediction on the basis of a test may vary for different individuals. To quantify the individual precision of prediction he compared the observed criterion scores with the expected criterion scores estimated on the basis of the total scores on a predictor test. Using these difference scores as a moderator variable, predictor tests were developed to identify persons with large errors of prediction. One of the drawbacks of Ghiselli's methods is that it is very situation specific. As an alternative, Hulin, Drasgow & Parsons (1983) proposed to identify persons with inconsistent or unscalable test responses by means of appropriateness measurement (or person-fit) statistics. In the present study a person-fit statistic is used to identify persons with unexpected test responses on selection data. It is shown that, in general, persons with inconsistent test responses are less predictable than those with consistent test responses. Both persons with lower criterion scores as well as persons with higher criterion scores than predicted could be identified. Because person-fit statistics are relatively easy to calculate, they may be used to improve the precision of measurement in selection settings. Implications for the selection practice are discussed.

KW - METIS-135405

KW - IR-104288

U2 - 10.1111/j.2044-8325.1998.tb00668.x

DO - 10.1111/j.2044-8325.1998.tb00668.x

M3 - Article

VL - 71

SP - 147

EP - 160

JO - Diabetes care

JF - Diabetes care

SN - 0149-5992

IS - 2

ER -