Applications of decision theory to test-based decision making

Research output: Book/ReportReportProfessional

56 Downloads (Pure)

Abstract

The use of Bayesian decision theory to solve problems in test-based decision making is discussed. Four basic decision problems are distinguished: (1) selection; (2) mastery; (3) placement; and (4) classification, the situation where each treatment has its own criterion. Each type of decision can be identified as a specific configuration of one or more of the following elements: a test that provides the scores on which the decisions are based; one or more treatments with respect to which decisions are made; and one or more criteria by which the successes of treatments are measured. For each type of decision, further restrictions or generalizations may hold, such as multivariate test scores, sequential testing, multiple criteria, multiple populations, and quota restrictions. In some applications, combinations of the basic types of decisions may occur. Samples of decision problems illustrate the optimization of the Bayes utility for each possible decision. Examples are given for selection decisions with linear utility, mastery decisions with threshold utility, placement decisions with normal-ogive utility, classification decisions with threshold utility, and combinations of basic decisions. Nine figures illustrate decision systems, and one table gives data for an application.
Original languageEnglish
Place of PublicationEnschede
PublisherUniversity of Twente, Faculty Educational Science and Technology
Number of pages63
Publication statusPublished - 1987

Publication series

NameOMD research report
PublisherUniversity of Twente, Faculty of Educational Science and Technology
No.87-09

Fingerprint

Decision theory
Decision making
Mastery
Placement
Testing
Linear utility
Test scores
Bayesian decision theory
Multiple criteria
Multivariate tests

Keywords

  • METIS-136016
  • Placement
  • Bayesian Statistics
  • Classification
  • Mastery Tests
  • Mathematical Models
  • Foreign Countries
  • Decision Making
  • Problem Solving
  • Scores
  • Selection
  • Statistical Analysis
  • Item Banks
  • Test Results
  • Test Theory
  • Predictive Measurement
  • IR-103606

Cite this

van der Linden, W. J. (1987). Applications of decision theory to test-based decision making. (OMD research report; No. 87-09). Enschede: University of Twente, Faculty Educational Science and Technology.
van der Linden, Willem J. / Applications of decision theory to test-based decision making. Enschede : University of Twente, Faculty Educational Science and Technology, 1987. 63 p. (OMD research report; 87-09).
@book{e88f1855ee3549539a12e75002fef629,
title = "Applications of decision theory to test-based decision making",
abstract = "The use of Bayesian decision theory to solve problems in test-based decision making is discussed. Four basic decision problems are distinguished: (1) selection; (2) mastery; (3) placement; and (4) classification, the situation where each treatment has its own criterion. Each type of decision can be identified as a specific configuration of one or more of the following elements: a test that provides the scores on which the decisions are based; one or more treatments with respect to which decisions are made; and one or more criteria by which the successes of treatments are measured. For each type of decision, further restrictions or generalizations may hold, such as multivariate test scores, sequential testing, multiple criteria, multiple populations, and quota restrictions. In some applications, combinations of the basic types of decisions may occur. Samples of decision problems illustrate the optimization of the Bayes utility for each possible decision. Examples are given for selection decisions with linear utility, mastery decisions with threshold utility, placement decisions with normal-ogive utility, classification decisions with threshold utility, and combinations of basic decisions. Nine figures illustrate decision systems, and one table gives data for an application.",
keywords = "METIS-136016, Placement, Bayesian Statistics, Classification, Mastery Tests, Mathematical Models, Foreign Countries, Decision Making, Problem Solving, Scores, Selection, Statistical Analysis, Item Banks, Test Results, Test Theory, Predictive Measurement, IR-103606",
author = "{van der Linden}, {Willem J.}",
note = "Project Psychometric Aspects of Item Banking No. 23",
year = "1987",
language = "English",
series = "OMD research report",
publisher = "University of Twente, Faculty Educational Science and Technology",
number = "87-09",

}

van der Linden, WJ 1987, Applications of decision theory to test-based decision making. OMD research report, no. 87-09, University of Twente, Faculty Educational Science and Technology, Enschede.

Applications of decision theory to test-based decision making. / van der Linden, Willem J.

Enschede : University of Twente, Faculty Educational Science and Technology, 1987. 63 p. (OMD research report; No. 87-09).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - Applications of decision theory to test-based decision making

AU - van der Linden, Willem J.

N1 - Project Psychometric Aspects of Item Banking No. 23

PY - 1987

Y1 - 1987

N2 - The use of Bayesian decision theory to solve problems in test-based decision making is discussed. Four basic decision problems are distinguished: (1) selection; (2) mastery; (3) placement; and (4) classification, the situation where each treatment has its own criterion. Each type of decision can be identified as a specific configuration of one or more of the following elements: a test that provides the scores on which the decisions are based; one or more treatments with respect to which decisions are made; and one or more criteria by which the successes of treatments are measured. For each type of decision, further restrictions or generalizations may hold, such as multivariate test scores, sequential testing, multiple criteria, multiple populations, and quota restrictions. In some applications, combinations of the basic types of decisions may occur. Samples of decision problems illustrate the optimization of the Bayes utility for each possible decision. Examples are given for selection decisions with linear utility, mastery decisions with threshold utility, placement decisions with normal-ogive utility, classification decisions with threshold utility, and combinations of basic decisions. Nine figures illustrate decision systems, and one table gives data for an application.

AB - The use of Bayesian decision theory to solve problems in test-based decision making is discussed. Four basic decision problems are distinguished: (1) selection; (2) mastery; (3) placement; and (4) classification, the situation where each treatment has its own criterion. Each type of decision can be identified as a specific configuration of one or more of the following elements: a test that provides the scores on which the decisions are based; one or more treatments with respect to which decisions are made; and one or more criteria by which the successes of treatments are measured. For each type of decision, further restrictions or generalizations may hold, such as multivariate test scores, sequential testing, multiple criteria, multiple populations, and quota restrictions. In some applications, combinations of the basic types of decisions may occur. Samples of decision problems illustrate the optimization of the Bayes utility for each possible decision. Examples are given for selection decisions with linear utility, mastery decisions with threshold utility, placement decisions with normal-ogive utility, classification decisions with threshold utility, and combinations of basic decisions. Nine figures illustrate decision systems, and one table gives data for an application.

KW - METIS-136016

KW - Placement

KW - Bayesian Statistics

KW - Classification

KW - Mastery Tests

KW - Mathematical Models

KW - Foreign Countries

KW - Decision Making

KW - Problem Solving

KW - Scores

KW - Selection

KW - Statistical Analysis

KW - Item Banks

KW - Test Results

KW - Test Theory

KW - Predictive Measurement

KW - IR-103606

M3 - Report

T3 - OMD research report

BT - Applications of decision theory to test-based decision making

PB - University of Twente, Faculty Educational Science and Technology

CY - Enschede

ER -

van der Linden WJ. Applications of decision theory to test-based decision making. Enschede: University of Twente, Faculty Educational Science and Technology, 1987. 63 p. (OMD research report; 87-09).