### Abstract

Original language | Undefined |
---|---|

Place of Publication | Newton, PA, USA |

Publisher | Law School Admission Council |

Publication status | Published - Sep 2001 |

### Publication series

Name | LSAC research report series |
---|---|

Publisher | Law School Admission Council |

No. | 98-11 |

### Keywords

- Goodness of Fit
- Computer Assisted Testing
- Adaptive Testing
- IR-103755
- Test Items
- Online Systems
- Simulation
- Item Response Theory
- Item Banks
- Error of Measurement
- Estimation (Mathematics)

### Cite this

*CUSUM statistics for large item banks: computation of standard errors*. (LSAC research report series; No. 98-11). Newton, PA, USA: Law School Admission Council.

}

*CUSUM statistics for large item banks: computation of standard errors*. LSAC research report series, no. 98-11, Law School Admission Council, Newton, PA, USA.

**CUSUM statistics for large item banks: computation of standard errors.** / Glas, Cornelis A.W.

Research output: Book/Report › Report › Other research output

TY - BOOK

T1 - CUSUM statistics for large item banks: computation of standard errors

AU - Glas, Cornelis A.W.

PY - 2001/9

Y1 - 2001/9

N2 - In a previous study (1998), how to evaluate whether adaptive testing data used for online calibration sufficiently fit the item response model used by C. Glas was studied. Three approaches were suggested, based on a Lagrange multiplier (LM) statistic, a Wald statistic, and a cumulative sum (CUMSUM) statistic respectively. For all these methods, the asymptotic variance of the parameter estimates has to be approximated. In the previous study, standard errors were computed using an observed Fisher information matrix. However, when the number of items in each bank becomes very large, manipulating complete information matrices becomes quite difficult. This study investigates the extent to which standard errors can be computed using the diagonal of information matrices only, and how the CUMSUM procedure must be tuned to this alternative approach. Simulation studies showed that the asymptotic standard errors are underestimated by the block-diagonal approach but that the magnitude of the bias in the standard errors was relatively small. It was also shown that the power of the statistical test based on a CUMSUM statistic using these approximated standard errors is well under control.

AB - In a previous study (1998), how to evaluate whether adaptive testing data used for online calibration sufficiently fit the item response model used by C. Glas was studied. Three approaches were suggested, based on a Lagrange multiplier (LM) statistic, a Wald statistic, and a cumulative sum (CUMSUM) statistic respectively. For all these methods, the asymptotic variance of the parameter estimates has to be approximated. In the previous study, standard errors were computed using an observed Fisher information matrix. However, when the number of items in each bank becomes very large, manipulating complete information matrices becomes quite difficult. This study investigates the extent to which standard errors can be computed using the diagonal of information matrices only, and how the CUMSUM procedure must be tuned to this alternative approach. Simulation studies showed that the asymptotic standard errors are underestimated by the block-diagonal approach but that the magnitude of the bias in the standard errors was relatively small. It was also shown that the power of the statistical test based on a CUMSUM statistic using these approximated standard errors is well under control.

KW - Goodness of Fit

KW - Computer Assisted Testing

KW - Adaptive Testing

KW - IR-103755

KW - Test Items

KW - Online Systems

KW - Simulation

KW - Item Response Theory

KW - Item Banks

KW - Error of Measurement

KW - Estimation (Mathematics)

M3 - Report

T3 - LSAC research report series

BT - CUSUM statistics for large item banks: computation of standard errors

PB - Law School Admission Council

CY - Newton, PA, USA

ER -