Detection of person misfit in computerized adaptive tests with polytomous items

R.R. Meijer, Edith van Krimpen-Stoop

Research output: Book/ReportReportOther research output

Abstract

One of the aims of a computerized adaptive test (CAT) is to construct an optimal test for each examinee. This is done by estimating the examinee’s ability-level (θ) after administration of each item and, based on this current ability estimate (�θ), the next item is selected using an item selection procedure. The θ-estimation procedure, the item selection procedure and the stopping rule of the CAT are all based on the assumption that the item scores of the examinee fit the assumed IRT model. It is questionable, however, whether the assumed IRT model gives a good description for each examinee’s test behavior. For those examinees for whom this is not the case, the current ability estimate as a measure of true θmay be inadequate, and as a result the construction of an optimal test may become difficult. There are all sorts of causes that may invalidate � θ; for example: knowledge of the correct answers due to test preview on achievement tests, faking on biodata questionnaires or personality tests, or randomly guessing on all items on the test in order to become familiar with the questions.
Original languageUndefined
Place of PublicationNewton, PA, USA
PublisherLaw School Admission Council
Number of pages10
Publication statusPublished - Apr 2000

Publication series

NameLSAC research report series
PublisherLaw School Admission Council
No.00-03

Keywords

  • IR-104259

Cite this

Meijer, R. R., & van Krimpen-Stoop, E. (2000). Detection of person misfit in computerized adaptive tests with polytomous items. (LSAC research report series; No. 00-03). Newton, PA, USA: Law School Admission Council.
Meijer, R.R. ; van Krimpen-Stoop, Edith. / Detection of person misfit in computerized adaptive tests with polytomous items. Newton, PA, USA : Law School Admission Council, 2000. 10 p. (LSAC research report series; 00-03).
@book{ce3934a8b3c64e64b6942f3530ec6219,
title = "Detection of person misfit in computerized adaptive tests with polytomous items",
abstract = "One of the aims of a computerized adaptive test (CAT) is to construct an optimal test for each examinee. This is done by estimating the examinee’s ability-level (θ) after administration of each item and, based on this current ability estimate (�θ), the next item is selected using an item selection procedure. The θ-estimation procedure, the item selection procedure and the stopping rule of the CAT are all based on the assumption that the item scores of the examinee fit the assumed IRT model. It is questionable, however, whether the assumed IRT model gives a good description for each examinee’s test behavior. For those examinees for whom this is not the case, the current ability estimate as a measure of true θmay be inadequate, and as a result the construction of an optimal test may become difficult. There are all sorts of causes that may invalidate � θ; for example: knowledge of the correct answers due to test preview on achievement tests, faking on biodata questionnaires or personality tests, or randomly guessing on all items on the test in order to become familiar with the questions.",
keywords = "IR-104259",
author = "R.R. Meijer and {van Krimpen-Stoop}, Edith",
year = "2000",
month = "4",
language = "Undefined",
series = "LSAC research report series",
publisher = "Law School Admission Council",
number = "00-03",

}

Meijer, RR & van Krimpen-Stoop, E 2000, Detection of person misfit in computerized adaptive tests with polytomous items. LSAC research report series, no. 00-03, Law School Admission Council, Newton, PA, USA.

Detection of person misfit in computerized adaptive tests with polytomous items. / Meijer, R.R.; van Krimpen-Stoop, Edith.

Newton, PA, USA : Law School Admission Council, 2000. 10 p. (LSAC research report series; No. 00-03).

Research output: Book/ReportReportOther research output

TY - BOOK

T1 - Detection of person misfit in computerized adaptive tests with polytomous items

AU - Meijer, R.R.

AU - van Krimpen-Stoop, Edith

PY - 2000/4

Y1 - 2000/4

N2 - One of the aims of a computerized adaptive test (CAT) is to construct an optimal test for each examinee. This is done by estimating the examinee’s ability-level (θ) after administration of each item and, based on this current ability estimate (�θ), the next item is selected using an item selection procedure. The θ-estimation procedure, the item selection procedure and the stopping rule of the CAT are all based on the assumption that the item scores of the examinee fit the assumed IRT model. It is questionable, however, whether the assumed IRT model gives a good description for each examinee’s test behavior. For those examinees for whom this is not the case, the current ability estimate as a measure of true θmay be inadequate, and as a result the construction of an optimal test may become difficult. There are all sorts of causes that may invalidate � θ; for example: knowledge of the correct answers due to test preview on achievement tests, faking on biodata questionnaires or personality tests, or randomly guessing on all items on the test in order to become familiar with the questions.

AB - One of the aims of a computerized adaptive test (CAT) is to construct an optimal test for each examinee. This is done by estimating the examinee’s ability-level (θ) after administration of each item and, based on this current ability estimate (�θ), the next item is selected using an item selection procedure. The θ-estimation procedure, the item selection procedure and the stopping rule of the CAT are all based on the assumption that the item scores of the examinee fit the assumed IRT model. It is questionable, however, whether the assumed IRT model gives a good description for each examinee’s test behavior. For those examinees for whom this is not the case, the current ability estimate as a measure of true θmay be inadequate, and as a result the construction of an optimal test may become difficult. There are all sorts of causes that may invalidate � θ; for example: knowledge of the correct answers due to test preview on achievement tests, faking on biodata questionnaires or personality tests, or randomly guessing on all items on the test in order to become familiar with the questions.

KW - IR-104259

M3 - Report

T3 - LSAC research report series

BT - Detection of person misfit in computerized adaptive tests with polytomous items

PB - Law School Admission Council

CY - Newton, PA, USA

ER -

Meijer RR, van Krimpen-Stoop E. Detection of person misfit in computerized adaptive tests with polytomous items. Newton, PA, USA: Law School Admission Council, 2000. 10 p. (LSAC research report series; 00-03).