Computerized adaptive testing in industrial and organizational psychology

Guido Makransky

Research output: ThesisPhD Thesis - Research UT, graduation UTAcademic

106 Downloads (Pure)

Abstract

The overarching goal of this dissertation is to increase the precision and efficiency of the measurement tools that are used to make selection decisions in industrial/organizational psychology, by introducing psychometric innovations in the framework of computerized adaptive testing (CAT). Chapter 1 presents a general introduction to CAT and item response theory (IRT). Chapter 2 illustrates an automatic online calibration design that can be used in adaptive testing. The method makes it more attractive for respondents to participate during calibration, and increases the speed with which a CAT item bank can be calibrated. Chapter 3 demonstrates a straightforward method for conducting a test of measurement invariance and illustrates a method for modeling differential item functioning by assigning group-specific item parameters in the framework of IRT. Chapter 4 illustrates a method for verifying the results of an unproctored Internet test by using an extension of the stochastic curtailed truncated sequential probability ratio test (SCTSPRT). Simulation studies indicated that the SCTSPRT was almost four times shorter than a linear testing method while maintaining the same power of detection. Chapters 5 and 6 investigate the possibility of increasing the precision and shortening the test length of typical employment tests by efficiently administering and scoring items with multidimensional computerized adaptive testing (MCAT). Chapter 5 explores the possibility of using MCAT for administering and scoring the Adjustable Competence Evaluation; a computer adaptive cognitive ability test used in organizational selection. Chapter 6 explores the potential of administering and scoring items with MCAT for the NEO PI-R; a widely used personality test.
Original languageEnglish
Awarding Institution
  • University of Twente
Supervisors/Advisors
  • Glas, Cees A.W., Supervisor
  • Kreiner, S., Advisor
Award date30 Mar 2012
Place of PublicationEnschede
Publisher
Print ISBNs978-90-365-3316-4
DOIs
Publication statusPublished - 30 Mar 2012

Fingerprint

Testing
Calibration
Invariance
Innovation
Internet

Keywords

  • METIS-290442
  • IR-80025

Cite this

Makransky, Guido. / Computerized adaptive testing in industrial and organizational psychology. Enschede : Universiteit Twente, 2012. 136 p.
@phdthesis{53c59bf2a6824e9888a99c122e28b512,
title = "Computerized adaptive testing in industrial and organizational psychology",
abstract = "The overarching goal of this dissertation is to increase the precision and efficiency of the measurement tools that are used to make selection decisions in industrial/organizational psychology, by introducing psychometric innovations in the framework of computerized adaptive testing (CAT). Chapter 1 presents a general introduction to CAT and item response theory (IRT). Chapter 2 illustrates an automatic online calibration design that can be used in adaptive testing. The method makes it more attractive for respondents to participate during calibration, and increases the speed with which a CAT item bank can be calibrated. Chapter 3 demonstrates a straightforward method for conducting a test of measurement invariance and illustrates a method for modeling differential item functioning by assigning group-specific item parameters in the framework of IRT. Chapter 4 illustrates a method for verifying the results of an unproctored Internet test by using an extension of the stochastic curtailed truncated sequential probability ratio test (SCTSPRT). Simulation studies indicated that the SCTSPRT was almost four times shorter than a linear testing method while maintaining the same power of detection. Chapters 5 and 6 investigate the possibility of increasing the precision and shortening the test length of typical employment tests by efficiently administering and scoring items with multidimensional computerized adaptive testing (MCAT). Chapter 5 explores the possibility of using MCAT for administering and scoring the Adjustable Competence Evaluation; a computer adaptive cognitive ability test used in organizational selection. Chapter 6 explores the potential of administering and scoring items with MCAT for the NEO PI-R; a widely used personality test.",
keywords = "METIS-290442, IR-80025",
author = "Guido Makransky",
year = "2012",
month = "3",
day = "30",
doi = "10.3990/1.9789036533164",
language = "English",
isbn = "978-90-365-3316-4",
publisher = "Universiteit Twente",
school = "University of Twente",

}

Computerized adaptive testing in industrial and organizational psychology. / Makransky, Guido.

Enschede : Universiteit Twente, 2012. 136 p.

Research output: ThesisPhD Thesis - Research UT, graduation UTAcademic

TY - THES

T1 - Computerized adaptive testing in industrial and organizational psychology

AU - Makransky, Guido

PY - 2012/3/30

Y1 - 2012/3/30

N2 - The overarching goal of this dissertation is to increase the precision and efficiency of the measurement tools that are used to make selection decisions in industrial/organizational psychology, by introducing psychometric innovations in the framework of computerized adaptive testing (CAT). Chapter 1 presents a general introduction to CAT and item response theory (IRT). Chapter 2 illustrates an automatic online calibration design that can be used in adaptive testing. The method makes it more attractive for respondents to participate during calibration, and increases the speed with which a CAT item bank can be calibrated. Chapter 3 demonstrates a straightforward method for conducting a test of measurement invariance and illustrates a method for modeling differential item functioning by assigning group-specific item parameters in the framework of IRT. Chapter 4 illustrates a method for verifying the results of an unproctored Internet test by using an extension of the stochastic curtailed truncated sequential probability ratio test (SCTSPRT). Simulation studies indicated that the SCTSPRT was almost four times shorter than a linear testing method while maintaining the same power of detection. Chapters 5 and 6 investigate the possibility of increasing the precision and shortening the test length of typical employment tests by efficiently administering and scoring items with multidimensional computerized adaptive testing (MCAT). Chapter 5 explores the possibility of using MCAT for administering and scoring the Adjustable Competence Evaluation; a computer adaptive cognitive ability test used in organizational selection. Chapter 6 explores the potential of administering and scoring items with MCAT for the NEO PI-R; a widely used personality test.

AB - The overarching goal of this dissertation is to increase the precision and efficiency of the measurement tools that are used to make selection decisions in industrial/organizational psychology, by introducing psychometric innovations in the framework of computerized adaptive testing (CAT). Chapter 1 presents a general introduction to CAT and item response theory (IRT). Chapter 2 illustrates an automatic online calibration design that can be used in adaptive testing. The method makes it more attractive for respondents to participate during calibration, and increases the speed with which a CAT item bank can be calibrated. Chapter 3 demonstrates a straightforward method for conducting a test of measurement invariance and illustrates a method for modeling differential item functioning by assigning group-specific item parameters in the framework of IRT. Chapter 4 illustrates a method for verifying the results of an unproctored Internet test by using an extension of the stochastic curtailed truncated sequential probability ratio test (SCTSPRT). Simulation studies indicated that the SCTSPRT was almost four times shorter than a linear testing method while maintaining the same power of detection. Chapters 5 and 6 investigate the possibility of increasing the precision and shortening the test length of typical employment tests by efficiently administering and scoring items with multidimensional computerized adaptive testing (MCAT). Chapter 5 explores the possibility of using MCAT for administering and scoring the Adjustable Competence Evaluation; a computer adaptive cognitive ability test used in organizational selection. Chapter 6 explores the potential of administering and scoring items with MCAT for the NEO PI-R; a widely used personality test.

KW - METIS-290442

KW - IR-80025

U2 - 10.3990/1.9789036533164

DO - 10.3990/1.9789036533164

M3 - PhD Thesis - Research UT, graduation UT

SN - 978-90-365-3316-4

PB - Universiteit Twente

CY - Enschede

ER -