A minimax sequential procedure in the context of computerized adaptive mastery testing

Hendrik J. Vos

Research output: Book/ReportReportProfessional

8 Downloads (Pure)

Abstract

The purpose of this paper is to derive optimal rules for variable-length mastery tests in case three mastery classification decisions (nonmastery, partial mastery, and mastery) are distinguished. In a variable-length or adaptive mastery test, the decision is to classify a subject as a master, a partial master, a nonmaster, or continuing sampling and administering another test item. The framework of minimax sequential decision theory is used; that is, optimal sequential rules minimizing the maximum expected losses associated with all possible decision rules. The binomial model is assumed for the conditional probability of a correct response given the true level of functioning, whereas the threshold loss is adopted for the loss function involved. Monotonicity conditions are derived, that is, conditions sufficient for optimal sequential rules to be in the form of cutting scores. The paper concludes with an empirical example of a computerized adaptive mastery test for concept-learning in medicine.
Original languageEnglish
Place of PublicationEnschede
PublisherUniversiteit Twente, Faculteit Toegepaste Onderwijskunde
Publication statusPublished - 1997

Publication series

NameOMD Research report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.97-07

Fingerprint

Testing
Decision theory
Medicine
Sampling
Statistical Models

Keywords

  • Test Length
  • Classification
  • Computer Assisted Testing
  • Adaptive Testing
  • Mastery Tests
  • METIS-136534
  • Cutting Scores
  • Foreign Countries
  • Medical Education
  • Higher Education
  • IR-104222
  • Concept Formation

Cite this

Vos, H. J. (1997). A minimax sequential procedure in the context of computerized adaptive mastery testing. (OMD Research report; No. 97-07). Enschede: Universiteit Twente, Faculteit Toegepaste Onderwijskunde.
Vos, Hendrik J. / A minimax sequential procedure in the context of computerized adaptive mastery testing. Enschede : Universiteit Twente, Faculteit Toegepaste Onderwijskunde, 1997. (OMD Research report; 97-07).
@book{06a883000e834d5387f1e80fddf71108,
title = "A minimax sequential procedure in the context of computerized adaptive mastery testing",
abstract = "The purpose of this paper is to derive optimal rules for variable-length mastery tests in case three mastery classification decisions (nonmastery, partial mastery, and mastery) are distinguished. In a variable-length or adaptive mastery test, the decision is to classify a subject as a master, a partial master, a nonmaster, or continuing sampling and administering another test item. The framework of minimax sequential decision theory is used; that is, optimal sequential rules minimizing the maximum expected losses associated with all possible decision rules. The binomial model is assumed for the conditional probability of a correct response given the true level of functioning, whereas the threshold loss is adopted for the loss function involved. Monotonicity conditions are derived, that is, conditions sufficient for optimal sequential rules to be in the form of cutting scores. The paper concludes with an empirical example of a computerized adaptive mastery test for concept-learning in medicine.",
keywords = "Test Length, Classification, Computer Assisted Testing, Adaptive Testing, Mastery Tests, METIS-136534, Cutting Scores, Foreign Countries, Medical Education, Higher Education, IR-104222, Concept Formation",
author = "Vos, {Hendrik J.}",
year = "1997",
language = "English",
series = "OMD Research report",
publisher = "Universiteit Twente, Faculteit Toegepaste Onderwijskunde",
number = "97-07",

}

Vos, HJ 1997, A minimax sequential procedure in the context of computerized adaptive mastery testing. OMD Research report, no. 97-07, Universiteit Twente, Faculteit Toegepaste Onderwijskunde, Enschede.

A minimax sequential procedure in the context of computerized adaptive mastery testing. / Vos, Hendrik J.

Enschede : Universiteit Twente, Faculteit Toegepaste Onderwijskunde, 1997. (OMD Research report; No. 97-07).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - A minimax sequential procedure in the context of computerized adaptive mastery testing

AU - Vos, Hendrik J.

PY - 1997

Y1 - 1997

N2 - The purpose of this paper is to derive optimal rules for variable-length mastery tests in case three mastery classification decisions (nonmastery, partial mastery, and mastery) are distinguished. In a variable-length or adaptive mastery test, the decision is to classify a subject as a master, a partial master, a nonmaster, or continuing sampling and administering another test item. The framework of minimax sequential decision theory is used; that is, optimal sequential rules minimizing the maximum expected losses associated with all possible decision rules. The binomial model is assumed for the conditional probability of a correct response given the true level of functioning, whereas the threshold loss is adopted for the loss function involved. Monotonicity conditions are derived, that is, conditions sufficient for optimal sequential rules to be in the form of cutting scores. The paper concludes with an empirical example of a computerized adaptive mastery test for concept-learning in medicine.

AB - The purpose of this paper is to derive optimal rules for variable-length mastery tests in case three mastery classification decisions (nonmastery, partial mastery, and mastery) are distinguished. In a variable-length or adaptive mastery test, the decision is to classify a subject as a master, a partial master, a nonmaster, or continuing sampling and administering another test item. The framework of minimax sequential decision theory is used; that is, optimal sequential rules minimizing the maximum expected losses associated with all possible decision rules. The binomial model is assumed for the conditional probability of a correct response given the true level of functioning, whereas the threshold loss is adopted for the loss function involved. Monotonicity conditions are derived, that is, conditions sufficient for optimal sequential rules to be in the form of cutting scores. The paper concludes with an empirical example of a computerized adaptive mastery test for concept-learning in medicine.

KW - Test Length

KW - Classification

KW - Computer Assisted Testing

KW - Adaptive Testing

KW - Mastery Tests

KW - METIS-136534

KW - Cutting Scores

KW - Foreign Countries

KW - Medical Education

KW - Higher Education

KW - IR-104222

KW - Concept Formation

M3 - Report

T3 - OMD Research report

BT - A minimax sequential procedure in the context of computerized adaptive mastery testing

PB - Universiteit Twente, Faculteit Toegepaste Onderwijskunde

CY - Enschede

ER -

Vos HJ. A minimax sequential procedure in the context of computerized adaptive mastery testing. Enschede: Universiteit Twente, Faculteit Toegepaste Onderwijskunde, 1997. (OMD Research report; 97-07).