Choice Defines Value: A Predictive Modeling Competition in Health Preference Research

Michał Jakubczyk, Benjamin M. Craig (Corresponding Author), Mathias Barra, Catharina G.M. Groothuis-Oudshoorn, John D. Hartman, Elisabeth Huynh, Juan M. Ramos-Goñi, Elly A. Stolk, Kim Rand

Research output: Contribution to journalArticleAcademicpeer-review

11 Citations (Scopus)
6 Downloads (Pure)

Abstract

Objective: To identify which specifications and approaches to model selection better predict health preferences, the International Academy of Health Preference Research (IAHPR) hosted a predictive modeling competition including 18 teams from around the world. Methods: In April 2016, an exploratory survey was fielded: 4074 US respondents completed 20 out of 1560 paired comparisons by choosing between two health descriptions (e.g., longer life span vs. better health). The exploratory data were distributed to all teams. By July, eight teams had submitted their predictions for 1600 additional pairs and described their analytical approach. After these predictions had been posted online, a confirmatory survey was fielded (4148 additional respondents). Results: The victorious team, "Discreetly Charming Econometricians," led by Michał Jakubczyk, achieved the smallest χ 2, 4391.54 (a predefined criterion). Its primary scientific findings were that different models performed better with different pairs, that the value of life span is not constant proportional, and that logit models have poor predictive validity in health valuation. Conclusions: The results demonstrated the diversity and potential of new analytical approaches in health preference research and highlighted the importance of predictive validity in health valuation.

Original languageEnglish
Pages (from-to)229-238
Number of pages10
JournalValue in health
Volume21
Issue number2
DOIs
Publication statusPublished - Feb 2018

Fingerprint

Health
Research
Value of Life
Matched-Pair Analysis
Logistic Models
Surveys and Questionnaires

Keywords

  • EQ-5D
  • Health preference research
  • QALY
  • Discrete choice experiments

Cite this

Jakubczyk, Michał ; Craig, Benjamin M. ; Barra, Mathias ; Groothuis-Oudshoorn, Catharina G.M. ; Hartman, John D. ; Huynh, Elisabeth ; Ramos-Goñi, Juan M. ; Stolk, Elly A. ; Rand, Kim. / Choice Defines Value : A Predictive Modeling Competition in Health Preference Research. In: Value in health. 2018 ; Vol. 21, No. 2. pp. 229-238.
@article{aa4546a1117146c180bc6c1a8eadeb45,
title = "Choice Defines Value: A Predictive Modeling Competition in Health Preference Research",
abstract = "Objective: To identify which specifications and approaches to model selection better predict health preferences, the International Academy of Health Preference Research (IAHPR) hosted a predictive modeling competition including 18 teams from around the world. Methods: In April 2016, an exploratory survey was fielded: 4074 US respondents completed 20 out of 1560 paired comparisons by choosing between two health descriptions (e.g., longer life span vs. better health). The exploratory data were distributed to all teams. By July, eight teams had submitted their predictions for 1600 additional pairs and described their analytical approach. After these predictions had been posted online, a confirmatory survey was fielded (4148 additional respondents). Results: The victorious team, {"}Discreetly Charming Econometricians,{"} led by Michał Jakubczyk, achieved the smallest χ 2, 4391.54 (a predefined criterion). Its primary scientific findings were that different models performed better with different pairs, that the value of life span is not constant proportional, and that logit models have poor predictive validity in health valuation. Conclusions: The results demonstrated the diversity and potential of new analytical approaches in health preference research and highlighted the importance of predictive validity in health valuation.",
keywords = "EQ-5D, Health preference research, QALY, Discrete choice experiments",
author = "Michał Jakubczyk and Craig, {Benjamin M.} and Mathias Barra and Groothuis-Oudshoorn, {Catharina G.M.} and Hartman, {John D.} and Elisabeth Huynh and Ramos-Go{\~n}i, {Juan M.} and Stolk, {Elly A.} and Kim Rand",
year = "2018",
month = "2",
doi = "10.1016/j.jval.2017.09.016",
language = "English",
volume = "21",
pages = "229--238",
journal = "Value in health",
issn = "1098-3015",
publisher = "Elsevier",
number = "2",

}

Jakubczyk, M, Craig, BM, Barra, M, Groothuis-Oudshoorn, CGM, Hartman, JD, Huynh, E, Ramos-Goñi, JM, Stolk, EA & Rand, K 2018, 'Choice Defines Value: A Predictive Modeling Competition in Health Preference Research' Value in health, vol. 21, no. 2, pp. 229-238. https://doi.org/10.1016/j.jval.2017.09.016

Choice Defines Value : A Predictive Modeling Competition in Health Preference Research. / Jakubczyk, Michał; Craig, Benjamin M. (Corresponding Author); Barra, Mathias; Groothuis-Oudshoorn, Catharina G.M.; Hartman, John D.; Huynh, Elisabeth; Ramos-Goñi, Juan M.; Stolk, Elly A.; Rand, Kim.

In: Value in health, Vol. 21, No. 2, 02.2018, p. 229-238.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Choice Defines Value

T2 - A Predictive Modeling Competition in Health Preference Research

AU - Jakubczyk, Michał

AU - Craig, Benjamin M.

AU - Barra, Mathias

AU - Groothuis-Oudshoorn, Catharina G.M.

AU - Hartman, John D.

AU - Huynh, Elisabeth

AU - Ramos-Goñi, Juan M.

AU - Stolk, Elly A.

AU - Rand, Kim

PY - 2018/2

Y1 - 2018/2

N2 - Objective: To identify which specifications and approaches to model selection better predict health preferences, the International Academy of Health Preference Research (IAHPR) hosted a predictive modeling competition including 18 teams from around the world. Methods: In April 2016, an exploratory survey was fielded: 4074 US respondents completed 20 out of 1560 paired comparisons by choosing between two health descriptions (e.g., longer life span vs. better health). The exploratory data were distributed to all teams. By July, eight teams had submitted their predictions for 1600 additional pairs and described their analytical approach. After these predictions had been posted online, a confirmatory survey was fielded (4148 additional respondents). Results: The victorious team, "Discreetly Charming Econometricians," led by Michał Jakubczyk, achieved the smallest χ 2, 4391.54 (a predefined criterion). Its primary scientific findings were that different models performed better with different pairs, that the value of life span is not constant proportional, and that logit models have poor predictive validity in health valuation. Conclusions: The results demonstrated the diversity and potential of new analytical approaches in health preference research and highlighted the importance of predictive validity in health valuation.

AB - Objective: To identify which specifications and approaches to model selection better predict health preferences, the International Academy of Health Preference Research (IAHPR) hosted a predictive modeling competition including 18 teams from around the world. Methods: In April 2016, an exploratory survey was fielded: 4074 US respondents completed 20 out of 1560 paired comparisons by choosing between two health descriptions (e.g., longer life span vs. better health). The exploratory data were distributed to all teams. By July, eight teams had submitted their predictions for 1600 additional pairs and described their analytical approach. After these predictions had been posted online, a confirmatory survey was fielded (4148 additional respondents). Results: The victorious team, "Discreetly Charming Econometricians," led by Michał Jakubczyk, achieved the smallest χ 2, 4391.54 (a predefined criterion). Its primary scientific findings were that different models performed better with different pairs, that the value of life span is not constant proportional, and that logit models have poor predictive validity in health valuation. Conclusions: The results demonstrated the diversity and potential of new analytical approaches in health preference research and highlighted the importance of predictive validity in health valuation.

KW - EQ-5D

KW - Health preference research

KW - QALY

KW - Discrete choice experiments

UR - http://www.scopus.com/inward/record.url?scp=85034424289&partnerID=8YFLogxK

U2 - 10.1016/j.jval.2017.09.016

DO - 10.1016/j.jval.2017.09.016

M3 - Article

VL - 21

SP - 229

EP - 238

JO - Value in health

JF - Value in health

SN - 1098-3015

IS - 2

ER -