An Empirical Comparison of Discrete Choice Experiment and Best-Worst Scaling to Estimate Stakeholders’ Risk Tolerance for Hip Replacement Surgery

Joris David van Dijk, Catharina Gerarda Maria Groothuis-Oudshoorn, Deborah A. Marshall, Maarten Joost IJzerman

Research output: Contribution to journalArticleAcademicpeer-review

9 Citations (Scopus)
52 Downloads (Pure)

Abstract

Background Previous studies have been inconclusive regarding the validity and reliability of preference elicitation methods. Objective The aim of this study was to compare the metrics obtained from a discrete choice experiment (DCE) and profile-case best-worst scaling (BWS) with respect to hip replacement. Methods We surveyed the general US population of men aged 45 to 65 years, and potentially eligible for hip replacement surgery. The survey included sociodemographic questions, eight DCE questions, and twelve BWS questions. Attributes were the probability of a first and second revision, pain relief, ability to participate in sports and perform daily activities, and length of hospital stay. Conditional logit analysis was used to estimate attribute weights, level preferences, and the maximum acceptable risk (MAR) for undergoing revision surgery in six hypothetical treatment scenarios with different attribute levels. Results A total of 429 (96%) respondents were included. Comparable attribute weights and level preferences were found for both BWS and DCE. Preferences were greatest for hip replacement surgery with high pain relief and the ability to participate in sports and perform daily activities. Although the estimated MARs for revision surgery followed the same trend, the MARs were systematically higher in five of the six scenarios using DCE. Conclusions This study confirms previous findings that BWS or DCEs are comparable in estimating attribute weights and level preferences. However, the risk tolerance threshold based on the estimation of MAR differs between these methods, possibly leading to inconsistency in comparing treatment scenarios.
Original languageUndefined
Pages (from-to)316-322
JournalValue in health
Volume19
Issue number4
DOIs
Publication statusPublished - 23 Mar 2016

Keywords

  • IR-100324
  • METIS-316393

Cite this

@article{e170b7801f0e4f35be3e0c485abfca77,
title = "An Empirical Comparison of Discrete Choice Experiment and Best-Worst Scaling to Estimate Stakeholders’ Risk Tolerance for Hip Replacement Surgery",
abstract = "Background Previous studies have been inconclusive regarding the validity and reliability of preference elicitation methods. Objective The aim of this study was to compare the metrics obtained from a discrete choice experiment (DCE) and profile-case best-worst scaling (BWS) with respect to hip replacement. Methods We surveyed the general US population of men aged 45 to 65 years, and potentially eligible for hip replacement surgery. The survey included sociodemographic questions, eight DCE questions, and twelve BWS questions. Attributes were the probability of a first and second revision, pain relief, ability to participate in sports and perform daily activities, and length of hospital stay. Conditional logit analysis was used to estimate attribute weights, level preferences, and the maximum acceptable risk (MAR) for undergoing revision surgery in six hypothetical treatment scenarios with different attribute levels. Results A total of 429 (96{\%}) respondents were included. Comparable attribute weights and level preferences were found for both BWS and DCE. Preferences were greatest for hip replacement surgery with high pain relief and the ability to participate in sports and perform daily activities. Although the estimated MARs for revision surgery followed the same trend, the MARs were systematically higher in five of the six scenarios using DCE. Conclusions This study confirms previous findings that BWS or DCEs are comparable in estimating attribute weights and level preferences. However, the risk tolerance threshold based on the estimation of MAR differs between these methods, possibly leading to inconsistency in comparing treatment scenarios.",
keywords = "IR-100324, METIS-316393",
author = "{van Dijk}, {Joris David} and Groothuis-Oudshoorn, {Catharina Gerarda Maria} and Marshall, {Deborah A.} and IJzerman, {Maarten Joost}",
year = "2016",
month = "3",
day = "23",
doi = "10.1016/j.jval.2015.12.020",
language = "Undefined",
volume = "19",
pages = "316--322",
journal = "Value in health",
issn = "1098-3015",
publisher = "Elsevier",
number = "4",

}

An Empirical Comparison of Discrete Choice Experiment and Best-Worst Scaling to Estimate Stakeholders’ Risk Tolerance for Hip Replacement Surgery. / van Dijk, Joris David; Groothuis-Oudshoorn, Catharina Gerarda Maria; Marshall, Deborah A.; IJzerman, Maarten Joost.

In: Value in health, Vol. 19, No. 4, 23.03.2016, p. 316-322.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - An Empirical Comparison of Discrete Choice Experiment and Best-Worst Scaling to Estimate Stakeholders’ Risk Tolerance for Hip Replacement Surgery

AU - van Dijk, Joris David

AU - Groothuis-Oudshoorn, Catharina Gerarda Maria

AU - Marshall, Deborah A.

AU - IJzerman, Maarten Joost

PY - 2016/3/23

Y1 - 2016/3/23

N2 - Background Previous studies have been inconclusive regarding the validity and reliability of preference elicitation methods. Objective The aim of this study was to compare the metrics obtained from a discrete choice experiment (DCE) and profile-case best-worst scaling (BWS) with respect to hip replacement. Methods We surveyed the general US population of men aged 45 to 65 years, and potentially eligible for hip replacement surgery. The survey included sociodemographic questions, eight DCE questions, and twelve BWS questions. Attributes were the probability of a first and second revision, pain relief, ability to participate in sports and perform daily activities, and length of hospital stay. Conditional logit analysis was used to estimate attribute weights, level preferences, and the maximum acceptable risk (MAR) for undergoing revision surgery in six hypothetical treatment scenarios with different attribute levels. Results A total of 429 (96%) respondents were included. Comparable attribute weights and level preferences were found for both BWS and DCE. Preferences were greatest for hip replacement surgery with high pain relief and the ability to participate in sports and perform daily activities. Although the estimated MARs for revision surgery followed the same trend, the MARs were systematically higher in five of the six scenarios using DCE. Conclusions This study confirms previous findings that BWS or DCEs are comparable in estimating attribute weights and level preferences. However, the risk tolerance threshold based on the estimation of MAR differs between these methods, possibly leading to inconsistency in comparing treatment scenarios.

AB - Background Previous studies have been inconclusive regarding the validity and reliability of preference elicitation methods. Objective The aim of this study was to compare the metrics obtained from a discrete choice experiment (DCE) and profile-case best-worst scaling (BWS) with respect to hip replacement. Methods We surveyed the general US population of men aged 45 to 65 years, and potentially eligible for hip replacement surgery. The survey included sociodemographic questions, eight DCE questions, and twelve BWS questions. Attributes were the probability of a first and second revision, pain relief, ability to participate in sports and perform daily activities, and length of hospital stay. Conditional logit analysis was used to estimate attribute weights, level preferences, and the maximum acceptable risk (MAR) for undergoing revision surgery in six hypothetical treatment scenarios with different attribute levels. Results A total of 429 (96%) respondents were included. Comparable attribute weights and level preferences were found for both BWS and DCE. Preferences were greatest for hip replacement surgery with high pain relief and the ability to participate in sports and perform daily activities. Although the estimated MARs for revision surgery followed the same trend, the MARs were systematically higher in five of the six scenarios using DCE. Conclusions This study confirms previous findings that BWS or DCEs are comparable in estimating attribute weights and level preferences. However, the risk tolerance threshold based on the estimation of MAR differs between these methods, possibly leading to inconsistency in comparing treatment scenarios.

KW - IR-100324

KW - METIS-316393

U2 - 10.1016/j.jval.2015.12.020

DO - 10.1016/j.jval.2015.12.020

M3 - Article

VL - 19

SP - 316

EP - 322

JO - Value in health

JF - Value in health

SN - 1098-3015

IS - 4

ER -