Abstract
This paper derives optimal rules for sequential mastery tests. In a sequential mastery test, the decision is to classify a subject as a master or a nonmaster or to continue sampling and administering another random item. The framework of minimax sequential decision theory (minimum information approach) is used; that is, optimal rules are obtained by minimizing the maximum expected losses associated with all possible decision rules at each stage of sampling. The main advantage of this approach is that costs of sampling can be explicitly taken into account. The binomial model is assumed for the probability of a correct response given the true level of functioning, and threshold loss is adopted for the loss function involved. Monotonicity conditions are derived, conditions sufficient for optimal rules to be in the form of sequential cutting scores. The paper concludes with the description of a simulation study in which the minimax sequential strategy is compared with other procedures that exist for similar classification decision problems in the literature.
Original language | English |
---|---|
Place of Publication | Enschede |
Publisher | University of Twente, Faculty Educational Science and Technology |
Number of pages | 35 |
Publication status | Published - 2002 |
Publication series
Name | OMD Research Report |
---|---|
Publisher | University of Twente, Faculty of Educational Science and Technology |
No. | 02-10 |
Keywords
- Test construction
- Mastery tests
- Sampling