Response model parameter linking

M.L.D. Barrett

Research output: ThesisPhD Thesis - Research external, graduation UT

78 Downloads (Pure)

Abstract

With a few exceptions, the problem of linking item response model parameters from different item calibrations has been conceptualized as an instance of the problem of equating observed scores on different test forms. This thesis argues, however, that the use of item response models does not require any post hoc observed-score equating, but that the necessity of parameter linking is due to a problem inherent in the formal nature of these models---their general lack of identifiability. More specifically, item response model parameters need to be linked to adjust for the different effects of the identifiability restrictions used in different item calibrations. The research first characterizes the formal nature of linking functions for monotone, continuous, dichotomous response models. New definitions emerge for the linking parameters. Derivation of the linking function for the c parameter reveals an identity function, bringing into question response function linking methods that confound estimation error in the c parameter with linking function parameter estimates. Minimal elements for linking function identifiability for both traditional and slope-intercept parameterizations of the 3PL model are presented. Closed-form asymptotic standard errors (ASE) of the linking parameters are derived for single linking elements for the 3PL model and well-known polytomous models and a precision-weighted estimator for the linking function is proposed. The new estimator exhibits the desirable feature of monotone decrease in linking error as linking elements are added to the design. It is shown that the estimator outperforms mean/mean and mean/sigma linking approaches and facilitates optimal linking design. Several examples of optimal linking design are provided. The new estimator also enables exploration of the relationship between the number of response categories of an item and the ASEs of the estimated linking parameters. For the generalized partial credit model, analysis is presented that suggests that ASE of the slope parameter in the linking function will hardly change with the number of response categories of an item, while the ASE of the intercept parameter increases with the number of categories. Empirical examples are provided that concur with analytic results.
Original languageEnglish
Awarding Institution
  • University of Twente
Supervisors/Advisors
  • van der Linden, Willem J., Supervisor
Award date7 Oct 2015
Place of PublicationEnschede
Publisher
Print ISBNs978-90-365-3911-1
DOIs
Publication statusPublished - 7 Oct 2015

Fingerprint

parameter
calibration
parameterization
credit
thesis
method
analysis
test
effect

Keywords

  • METIS-311798
  • IR-97244

Cite this

Barrett, M. L. D. (2015). Response model parameter linking. Enschede: Universiteit Twente. https://doi.org/10.3990/1.9789036539111
Barrett, M.L.D.. / Response model parameter linking. Enschede : Universiteit Twente, 2015. 184 p.
@phdthesis{a606840a34f141fd86fd0707e4770061,
title = "Response model parameter linking",
abstract = "With a few exceptions, the problem of linking item response model parameters from different item calibrations has been conceptualized as an instance of the problem of equating observed scores on different test forms. This thesis argues, however, that the use of item response models does not require any post hoc observed-score equating, but that the necessity of parameter linking is due to a problem inherent in the formal nature of these models---their general lack of identifiability. More specifically, item response model parameters need to be linked to adjust for the different effects of the identifiability restrictions used in different item calibrations. The research first characterizes the formal nature of linking functions for monotone, continuous, dichotomous response models. New definitions emerge for the linking parameters. Derivation of the linking function for the c parameter reveals an identity function, bringing into question response function linking methods that confound estimation error in the c parameter with linking function parameter estimates. Minimal elements for linking function identifiability for both traditional and slope-intercept parameterizations of the 3PL model are presented. Closed-form asymptotic standard errors (ASE) of the linking parameters are derived for single linking elements for the 3PL model and well-known polytomous models and a precision-weighted estimator for the linking function is proposed. The new estimator exhibits the desirable feature of monotone decrease in linking error as linking elements are added to the design. It is shown that the estimator outperforms mean/mean and mean/sigma linking approaches and facilitates optimal linking design. Several examples of optimal linking design are provided. The new estimator also enables exploration of the relationship between the number of response categories of an item and the ASEs of the estimated linking parameters. For the generalized partial credit model, analysis is presented that suggests that ASE of the slope parameter in the linking function will hardly change with the number of response categories of an item, while the ASE of the intercept parameter increases with the number of categories. Empirical examples are provided that concur with analytic results.",
keywords = "METIS-311798, IR-97244",
author = "M.L.D. Barrett",
note = "Title on cover: Linking response model parameters",
year = "2015",
month = "10",
day = "7",
doi = "10.3990/1.9789036539111",
language = "English",
isbn = "978-90-365-3911-1",
publisher = "Universiteit Twente",
school = "University of Twente",

}

Barrett, MLD 2015, 'Response model parameter linking', University of Twente, Enschede. https://doi.org/10.3990/1.9789036539111

Response model parameter linking. / Barrett, M.L.D.

Enschede : Universiteit Twente, 2015. 184 p.

Research output: ThesisPhD Thesis - Research external, graduation UT

TY - THES

T1 - Response model parameter linking

AU - Barrett, M.L.D.

N1 - Title on cover: Linking response model parameters

PY - 2015/10/7

Y1 - 2015/10/7

N2 - With a few exceptions, the problem of linking item response model parameters from different item calibrations has been conceptualized as an instance of the problem of equating observed scores on different test forms. This thesis argues, however, that the use of item response models does not require any post hoc observed-score equating, but that the necessity of parameter linking is due to a problem inherent in the formal nature of these models---their general lack of identifiability. More specifically, item response model parameters need to be linked to adjust for the different effects of the identifiability restrictions used in different item calibrations. The research first characterizes the formal nature of linking functions for monotone, continuous, dichotomous response models. New definitions emerge for the linking parameters. Derivation of the linking function for the c parameter reveals an identity function, bringing into question response function linking methods that confound estimation error in the c parameter with linking function parameter estimates. Minimal elements for linking function identifiability for both traditional and slope-intercept parameterizations of the 3PL model are presented. Closed-form asymptotic standard errors (ASE) of the linking parameters are derived for single linking elements for the 3PL model and well-known polytomous models and a precision-weighted estimator for the linking function is proposed. The new estimator exhibits the desirable feature of monotone decrease in linking error as linking elements are added to the design. It is shown that the estimator outperforms mean/mean and mean/sigma linking approaches and facilitates optimal linking design. Several examples of optimal linking design are provided. The new estimator also enables exploration of the relationship between the number of response categories of an item and the ASEs of the estimated linking parameters. For the generalized partial credit model, analysis is presented that suggests that ASE of the slope parameter in the linking function will hardly change with the number of response categories of an item, while the ASE of the intercept parameter increases with the number of categories. Empirical examples are provided that concur with analytic results.

AB - With a few exceptions, the problem of linking item response model parameters from different item calibrations has been conceptualized as an instance of the problem of equating observed scores on different test forms. This thesis argues, however, that the use of item response models does not require any post hoc observed-score equating, but that the necessity of parameter linking is due to a problem inherent in the formal nature of these models---their general lack of identifiability. More specifically, item response model parameters need to be linked to adjust for the different effects of the identifiability restrictions used in different item calibrations. The research first characterizes the formal nature of linking functions for monotone, continuous, dichotomous response models. New definitions emerge for the linking parameters. Derivation of the linking function for the c parameter reveals an identity function, bringing into question response function linking methods that confound estimation error in the c parameter with linking function parameter estimates. Minimal elements for linking function identifiability for both traditional and slope-intercept parameterizations of the 3PL model are presented. Closed-form asymptotic standard errors (ASE) of the linking parameters are derived for single linking elements for the 3PL model and well-known polytomous models and a precision-weighted estimator for the linking function is proposed. The new estimator exhibits the desirable feature of monotone decrease in linking error as linking elements are added to the design. It is shown that the estimator outperforms mean/mean and mean/sigma linking approaches and facilitates optimal linking design. Several examples of optimal linking design are provided. The new estimator also enables exploration of the relationship between the number of response categories of an item and the ASEs of the estimated linking parameters. For the generalized partial credit model, analysis is presented that suggests that ASE of the slope parameter in the linking function will hardly change with the number of response categories of an item, while the ASE of the intercept parameter increases with the number of categories. Empirical examples are provided that concur with analytic results.

KW - METIS-311798

KW - IR-97244

U2 - 10.3990/1.9789036539111

DO - 10.3990/1.9789036539111

M3 - PhD Thesis - Research external, graduation UT

SN - 978-90-365-3911-1

PB - Universiteit Twente

CY - Enschede

ER -

Barrett MLD. Response model parameter linking. Enschede: Universiteit Twente, 2015. 184 p. https://doi.org/10.3990/1.9789036539111