TY - JOUR
T1 - Choice Defines Value
T2 - A Predictive Modeling Competition in Health Preference Research
AU - Jakubczyk, Michał
AU - Craig, Benjamin M.
AU - Barra, Mathias
AU - Groothuis-Oudshoorn, Catharina G.M.
AU - Hartman, John D.
AU - Huynh, Elisabeth
AU - Ramos-Goñi, Juan M.
AU - Stolk, Elly A.
AU - Rand, Kim
PY - 2018/2
Y1 - 2018/2
N2 - Objective: To identify which specifications and approaches to model selection better predict health preferences, the International Academy of Health Preference Research (IAHPR) hosted a predictive modeling competition including 18 teams from around the world. Methods: In April 2016, an exploratory survey was fielded: 4074 US respondents completed 20 out of 1560 paired comparisons by choosing between two health descriptions (e.g., longer life span vs. better health). The exploratory data were distributed to all teams. By July, eight teams had submitted their predictions for 1600 additional pairs and described their analytical approach. After these predictions had been posted online, a confirmatory survey was fielded (4148 additional respondents). Results: The victorious team, "Discreetly Charming Econometricians," led by Michał Jakubczyk, achieved the smallest χ 2, 4391.54 (a predefined criterion). Its primary scientific findings were that different models performed better with different pairs, that the value of life span is not constant proportional, and that logit models have poor predictive validity in health valuation. Conclusions: The results demonstrated the diversity and potential of new analytical approaches in health preference research and highlighted the importance of predictive validity in health valuation.
AB - Objective: To identify which specifications and approaches to model selection better predict health preferences, the International Academy of Health Preference Research (IAHPR) hosted a predictive modeling competition including 18 teams from around the world. Methods: In April 2016, an exploratory survey was fielded: 4074 US respondents completed 20 out of 1560 paired comparisons by choosing between two health descriptions (e.g., longer life span vs. better health). The exploratory data were distributed to all teams. By July, eight teams had submitted their predictions for 1600 additional pairs and described their analytical approach. After these predictions had been posted online, a confirmatory survey was fielded (4148 additional respondents). Results: The victorious team, "Discreetly Charming Econometricians," led by Michał Jakubczyk, achieved the smallest χ 2, 4391.54 (a predefined criterion). Its primary scientific findings were that different models performed better with different pairs, that the value of life span is not constant proportional, and that logit models have poor predictive validity in health valuation. Conclusions: The results demonstrated the diversity and potential of new analytical approaches in health preference research and highlighted the importance of predictive validity in health valuation.
KW - EQ-5D
KW - Health preference research
KW - QALY
KW - Discrete choice experiments
UR - http://www.scopus.com/inward/record.url?scp=85034424289&partnerID=8YFLogxK
U2 - 10.1016/j.jval.2017.09.016
DO - 10.1016/j.jval.2017.09.016
M3 - Article
AN - SCOPUS:85034424289
VL - 21
SP - 229
EP - 238
JO - Value in health
JF - Value in health
SN - 1098-3015
IS - 2
ER -