Automated simultaneous assembly of multi-stage testing for the uniform CPA examination

Krista Breithaupt, A. Ariel, Bernard P. Veldkamp

Research output: Contribution to conferencePaperAcademic

16 Downloads (Pure)

Abstract

Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1© ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns. 2Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1© ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns.
Original languageUndefined
Number of pages15
Publication statusPublished - 2004
EventAnnual Meeting of the National Council on Measurement in Education (NCME) 2004 - San Diego, United States
Duration: 13 Apr 200415 Apr 2004

Conference

ConferenceAnnual Meeting of the National Council on Measurement in Education (NCME) 2004
CountryUnited States
CitySan Diego
Period13/04/0415/04/04

Keywords

  • IR-104244

Cite this

Breithaupt, K., Ariel, A., & Veldkamp, B. P. (2004). Automated simultaneous assembly of multi-stage testing for the uniform CPA examination. Paper presented at Annual Meeting of the National Council on Measurement in Education (NCME) 2004, San Diego, United States.
Breithaupt, Krista ; Ariel, A. ; Veldkamp, Bernard P. / Automated simultaneous assembly of multi-stage testing for the uniform CPA examination. Paper presented at Annual Meeting of the National Council on Measurement in Education (NCME) 2004, San Diego, United States.15 p.
@conference{c1dc0d1757cb47e29ea49952c93ce462,
title = "Automated simultaneous assembly of multi-stage testing for the uniform CPA examination",
abstract = "Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1{\circledC} ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns. 2Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1{\circledC} ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns.",
keywords = "IR-104244",
author = "Krista Breithaupt and A. Ariel and Veldkamp, {Bernard P.}",
year = "2004",
language = "Undefined",
note = "null ; Conference date: 13-04-2004 Through 15-04-2004",

}

Breithaupt, K, Ariel, A & Veldkamp, BP 2004, 'Automated simultaneous assembly of multi-stage testing for the uniform CPA examination' Paper presented at Annual Meeting of the National Council on Measurement in Education (NCME) 2004, San Diego, United States, 13/04/04 - 15/04/04, .

Automated simultaneous assembly of multi-stage testing for the uniform CPA examination. / Breithaupt, Krista; Ariel, A.; Veldkamp, Bernard P.

2004. Paper presented at Annual Meeting of the National Council on Measurement in Education (NCME) 2004, San Diego, United States.

Research output: Contribution to conferencePaperAcademic

TY - CONF

T1 - Automated simultaneous assembly of multi-stage testing for the uniform CPA examination

AU - Breithaupt, Krista

AU - Ariel, A.

AU - Veldkamp, Bernard P.

PY - 2004

Y1 - 2004

N2 - Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1© ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns. 2Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1© ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns.

AB - Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1© ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns. 2Some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination are offered as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination will be offered as an adaptive multi-stage test (MST) beginning in April of 2004. Examples of automated assembly using mixed integer programming solutions in Optimization Programming Language software (OPL Studio 3.6.1© ILOG Inc.) illustrate MST design features and implementation strategies that can be generalized to other automated assembly problems. A compromise between the best possible combination of test content, and sustainability and security over time is afforded by linear programming techniques that make use of mixed integer optimization algorithms. This method of formulating relative optimization functions to ensure a variety of constraints are always met for testlets of differing difficulties is also analyzed to evaluate the exposure of testlets and panels that is associated with the MST design. Technical information is also shared to assist other practitioners and researchers to emphasize feasibility and efficiency in their test construction problems. Some practical consequences from the selection of statistical targets on testlet exposure are illustrated. These results are described with respect to the fundamental principles of automated continuous test assembly and administration based on MST where testlet or item exposure projections and inventory rotation are critical concerns.

KW - IR-104244

M3 - Paper

ER -

Breithaupt K, Ariel A, Veldkamp BP. Automated simultaneous assembly of multi-stage testing for the uniform CPA examination. 2004. Paper presented at Annual Meeting of the National Council on Measurement in Education (NCME) 2004, San Diego, United States.