Discrete choice experiments (DCEs) are increasingly advocated as a way to quantify preferences for health. However, increasing support does not necessarily result in increasing quality. Although specific reviews have been conducted in certain contexts, there exists no recent description of the general state of the science of health-related DCEs. The aim of this paper was to update prior reviews (1990–2012), to identify all health-related DCEs and to provide a description of trends, current practice and future challenges.
A systematic literature review was conducted to identify health-related empirical DCEs published between 2013 and 2017. The search strategy and data extraction replicated prior reviews to allow the reporting of trends, although additional extraction fields were incorporated.
Of the 7877 abstracts generated, 301 studies met the inclusion criteria and underwent data extraction. In general, the total number of DCEs per year continued to increase, with broader areas of application and increased geographic scope. Studies reported using more sophisticated designs (e.g. D-efficient) with associated software (e.g. Ngene). The trend towards using more sophisticated econometric models also continued. However, many studies presented sophisticated methods with insufficient detail. Qualitative research methods continued to be a popular approach for identifying attributes and levels.
The use of empirical DCEs in health economics continues to grow. However, inadequate reporting of methodological details inhibits quality assessment. This may reduce decision-makers’ confidence in results and their ability to act on the findings. How and when to integrate health-related DCE outcomes into decision-making remains an important area for future research.
|Quantifying preferences for healthcare is becoming increasingly popular; however, there exists no recent description of how health-related discrete choice experiments (DCEs) are being employed.|
|This study identified changes in experimental design, analytical methods, validity tests, qualitative methods and outcome measures over the last 5 years.|
|To facilitate quality assessment and better integration into health decision-making, future DCE reports should include more complete information, which might be achieved by developing reporting guidelines specifically for DCEs.|
In recent years, there have been increased calls for patient and public involvement in healthcare decision-making [1, 2]. Patient or public involvement can support decision-making at multiple levels: individual (shared decision-making), policy (patient experts on panels) and commissioning (incorporating patient preferences in technology evaluations or health state valuation). Views can be elicited qualitatively, quantitively or using mixed-methods approaches . Example methods include interviews, focus groups and stated preference techniques such as the standard gamble or time trade-off. Studies by the Medical Device Innovation Consortium (MDIC)  and Mahieu et al.  highlighted a wide variety of methods to measure both stated and revealed preferences in healthcare.
Among the quantitative methods for eliciting stated health preferences, discrete choice experiments (DCEs) are increasingly advocated . In a DCE individuals are asked to select their preferred (and/or least preferred) alternative from a set of alternatives. DCEs are grounded in theories which assume that (1) alternatives can be described by their attributes, (2) an individual’s valuation depends upon the levels of these attributes, and (3) choices are based on a latent utility function [7,8,9,10]. The theoretical foundations have implications for the experimental design (principles to construct alternatives and choice sets) and the probabilistic models used to analyse the choice data .
Previously conducted broad reviews by Ryan and Gerard (1990–2000) , de Bekker-Grob et al. (2001–2008)  and Clark et al. (2009–2012)  identified a number of methodological challenges of DCEs (e.g. how to choose among orthogonal, D-efficient and other designs or how to account for preference heterogeneity when analysing choice data). These reviews, as well as published checklists  and best-practice guidelines [13,14,15,16,17], have been developed to provide specific guidance and potentially improve quality [12, 18]. However, it is unknown whether the challenges identified in prior reviews are still relevant or whether there has been a response to the published suggestions and guidelines. Furthermore, although health-related DCEs are increasingly advocated by organisations such as the MDIC , their use for actual decision-making in health remains limited [7, 13]. Key barriers to their wider use in policy include concerns about the robustness and validity of the method and the quality of applied studies [19, 20].
This paper seeks to provide a current overview of the applications and methods used by DCEs in health economics. This overview will be created by systematically reviewing DCE literature and extracting data from the period 2013–2017. In addition, historical trends in experimental design, analytical methods, validation procedures and outcome measures will be described by comparing the results to those of prior reviews. For the sake of generality and to allow examination of trends based on consistent data extraction methods, this comparison will focus on the broad reviews cited above, rather than on narrower reviews of DCEs covering specific study designs or disease areas [21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,41]. Recent developments in DCE methods will be incorporated by including new data elements not reported in previous reviews. Potential challenges and recommendations for future research will also be identified.
The current systematic review continued the work conducted in the prior broad DCE reviews [6, 7, 11] by focusing on DCEFootnote 1 applications published between 2013 and 2017. The methodology for this systematic review built on that of the prior reviews to allow comparison of results across review periods and identification of trends. The search was initiated in May 2015 and updated in February 2016 and January 2018. We used the same search engine (PubMed) that was used in the latest review by Clark et al.  and generally used the same search terms. We decided to exclude the search terms ‘conjoint’ and ‘dce’, since these yielded too many irrelevant results (particularly due to the rise of dynamic contrast-enhanced imaging in gene expression profiling) and would have substantially increased the number of abstracts to be reviewed. The final search terms included ‘discrete choice experiment’, ‘discrete choice experiments’, ‘discrete choice modeling’, ‘discrete choice modelling’, ‘discrete choice conjoint experiment’, ‘stated preference’, ‘part-worth utilities’, ‘functional measurement’, ‘paired comparisons’, ‘pairwise choices’, ‘conjoint analysis’, ‘conjoint measurement’, ‘conjoint studies’, ‘conjoint choice experiment’ and ‘conjoint choice experiments’. A study was included if it was applied to health, included a discrete choice exercise (rather than rating or ranking), focused on human beings and was published as a full-text article in English between January 2013 and December 2017. Consistent with prior reviews, DCEs without empirical data (e.g. methodological studies) and studies of samples already included in our review were excluded.
To ensure consistency of data extraction and assist with synthesis of results, the authors used an extraction tool, available in Appendix A of the Electronic Supplementary Material, initially developed using the criteria of Clark et al. . We first considered areas of application (e.g. patient consumer experience, valuing health outcomes) and background information (country of origin, number and type of attributes, number of choice sets, survey administration method), followed by more detailed information about the experimental design (type, plan, use of blocking, design software, design source, method used to create choice sets, number of alternatives, presence of an opt-out or status quo option, sample size and type), data analysis (model, analysis software, model details), validity checks (external and internal), use of qualitative methods (type and rationale) and presented outcome measures. The authors tested the extraction tool and discussed initial results. To fully capture current DCE design methods, the following data elements were added to the original data extraction tool: number of alternatives, presence of an opt-out or status quo, sample size, use of blocking, use of a Bayesian design approach, software for econometric analyses and the type of qualitative research methods reported. With regard to analysis methods, this review also extracted additional information on the use of scale-adjusted latent class, heteroskedastic conditional logit and generalised multinomial models. Studies were also categorised by journal type.
Each author extracted data from a group of articles, checking online appendices and supplementary materials where relevant. A subsample of studies (20%) was double-checked by V.S. for quality control. We categorised the extracted data and reported the results as percentages. Results for the econometric analysis models were categorised based on the three key characteristics of the multinomial logit model (Fig. 1): (1) the assumption that error terms are independent and identically distributed (IID) according to the extreme value type I distribution, (2) independence of irrelevant alternatives (IIA) (resulting from the first characteristic) and (3) the presence or absence of preference heterogeneity . The IID characteristic limits flexibility in estimating the error variance, whereas IIA is about the flexibility of the substitution pattern (how flexible respondents are to substitute between choices), and assumptions about preference heterogeneity determine whether preferences are allowed to vary across respondents.
Areas of Application
Prior reviews mentioned that although DCEs were originally introduced in health economics to value patient or consumer experience, the use of DCEs has broadened considerably [6, 344]. Table 1 summarises information about the different areas of application of DCEs for each review period (Appendix B of the Electronic Supplementary Material contains figures based on the tables in this review). Compared to the latest review period, the largest overall shifts occurred in the areas of patient consumer experience (category A), trade-offs between health outcomes and patient or consumer experience factors (category C), and health professionals’ preferences for treatment or screening (category G). In the current review period, 8% of studies valued health outcomes such as ‘heart attacks avoided’ (category B, 23 studies, e.g. studies [148, 152, 153, 162, 170]), 4% estimated utility weights within the quality-adjusted life year (QALY) framework (category D, 13 studies, e.g. [218, 226,227,228, 230]), 6% focused on job choices (category E, 17 studies, e.g. [231, 236, 238, 242, 247]), and 9% developed priority-setting frameworks (category F, 27 studies, e.g. [248, 253, 270, 272, 274]).
Among the DCEs reviewed, the most common journal focus was health services research (n = 139; 46%). About a third (n = 102; 34%) of articles were published in specialty-focused medical journals such as Vaccine (five studies [66, 131, 146, 311, 313]) or the British Journal of Cancer (three studies [47, 70, 171]). Fifty-one (17%) were published in general medical journals such as PLoS One (20 studies, e.g. [44, 64, 81, 91, 99]) and BMJ Open (five studies [100, 102, 109, 169, 264]). More details can be found in Appendix C of the Electronic Supplementary Material.
Background Information About DCEs
The reviews from Ryan and Gerard , de Bekker-Grob et al.  and Clark et al.  provided detailed information about study characteristics. Information for the current review period is described in the sections below. Table 2 parts (a) and (b) report the current information alongside data from the prior reviews.
Country of Origin
Table 2a shows that UK-based studies made up a relatively high proportion of published DCEs (17%, 50 studies), as did studies from the US (17%, 50 studies), Australia (10%, 30 studies), the Netherlands (15%, 44 studies), Germany (9%, 28 studies) and Canada (8%, 25 studies). DCEs were also popular in other European countries, for example, Italy (3%, eight studies) and Sweden (2%, six studies) (not shown). We also observed an increase in studies coming from ‘other’ countries, from 0% to 34% across the four review periods, which reflects an upwards trend towards applying DCEs in middle- and low-income countries (e.g. Cameroon , Ghana , Laos , Malawi  and Vietnam ).
Attributes, Choices and Survey
In the current review period, the number of attributes per alternative in DCEs ranged from two to 21, with a median of five. We observed a slight decrease in number of attributes; the modal category was 4–5 (39%, 117 studies). In line with prior reviews, most studies (82%, 247 studies) included four to nine attributes. For the period 2013–2017, most studies included a monetary (50%, 150 studies), time-related (39%, 117 studies), or risk-related (44%, 133 studies) attribute. The proportion of studies including time-related and health status (24%, 71 studies) attributes decreased.
Most DCEs in the current period included nine to 16 choices per individual (54%, 162 studies), with a median of 12 (minimum 1, maximum 32). Prior reviews mentioned increases in online administration of DCEs. This trend continued in the current review period, with 57% of the DCEs conducted online (172 studies), whereas the number of DCEs which used pencil and paper dropped to 23% (69 studies). These self-completed DCEs remained the main source of survey administration.
Alternatives and Sample
Prior reviews did not collect data about the number of alternatives included in each DCE or whether an opt-out or status quo option was included. For the current period, most of the studies (83%, 251 studies) included two alternatives (not including any opt-out or status quo option), with 8% (23 studies) not clearly reporting the number of included alternatives (Table 2b). The majority of the studies (64%, 194 studies) did not include an opt-out or status quo option.
The prior reviews covering the period 1990–2012 did not extract data about the sample size. In the current period, the mean and median sample size were 728 and 401, respectively. Sample size ranged from a minimum of 35  to a maximum of 30,600 respondents . Most of the samples included patients (37%, 110 studies) or the general public (27%, 81 studies). A large number of DCEs sampled ‘other’ populations (31%, 93 studies) such as healthcare workers, healthcare students or a mixture of these.
Experimental design (planning of the alternatives and choice sets) is crucial to the conduct of a DCE. The review from de Bekker-Grob et al.  describes DCE design in detail. For more information about the choices researchers have to make when designing the experimental part of a DCE, we also refer to a key checklist and best practice example [14, 15].
Design Type, Design Plan and Blocking
As in prior review periods, most DCEs made use of a fractional design (89%, 269 studies) (Table 3). Additionally, we observed that for the current review period, the design plan of DCEs most frequently focused on main effects only (29%, 86 studies). This is a decrease compared to the periods 1990–2000, 2001–2008 and 2009–2012, with 74%, 89% and 55%, respectively. The percentage of DCEs not clearly reporting design plan information increased to 49% (147 studies) for 2013–2017. When generating the experimental design, blocking, creating different versions of the experiment for different respondent groups, can be used to reduce the cognitive burden of respondents by reducing the total number of choices per respondent . Reviews for the period 1990–2012 did not collect information about blocking. Data for the current period showed that 50% (150 studies) reported using blocking when generating the experimental design. On average, studies with blocking had 709 participants, each of whom completed 11 choice sets, whereas studies with unblocked designs had 439 participants, each of whom completed 13 choice sets.
Ngene became the most popular software tool in the current period for generating experimental designs (21%, 62 studies, e.g. [53, 63, 139, 268, 319]). SAS (18%, 54 studies, e.g. [262, 290, 296, 300, 316]) and Sawtooth (16%, 47 studies, e.g. [46, 141, 207, 276, 323]) remained popular tools. Compared to prior review periods, we observed an increase in the percentage of studies not clearly indicating what software was used to generate the experimental design (33%, 99 studies, e.g. [44, 144, 177, 204, 299]).
Methods to Create Choice Sets
The upwards trend in the use of D-efficient (35%, 105 studies) experimental designs continued in the current review period. Correspondingly, fewer DCEs used orthogonal arrays through methods such as single profiles, random pairing or the foldover technique (Table 3). As with the experimental design characteristics mentioned in the previous sections, we observed that an increasing number of studies (33%, 100 studies in 2013–2017) did not clearly report the methods used to create choice sets.
Econometric Analysis Methods
Information about the different econometric analysis methods and the appropriateness of these methods for different DCE applications is described in great detail in the prior reviews [6, 7, 11]. More information can be found in papers by Louviere and Lancsar , Bridges et al.  and Hauber et al. . Table 4 parts (a) and (b) summarise information about econometric analyses from the current and prior review periods.
Econometric Analysis Model, Software and Preference Heterogeneity
We present information about econometric analysis models according to the taxonomy described in the “Methods” section and visualised in Fig. 1. Reviews for the periods 1990–2000 and 2001–2008 reported that most DCEs used random-effects (random-intercept) probit models to analyse preference data (53% and 41%, respectively). The review for the period 2009–2012 showed a shift to the use of other methods like multinomial logit models (45%) and mixed (random-parameter) logit models (25%). For the current review period, this trend continued (see Table 4a). Most DCEs in 2013–2017 reported the use of mixed logit models (39%, 118 studies, e.g. [47, 271, 301, 314, 318]) or multinomial logit models (39%, 116 studies, e.g. [92, 110, 166, 294, 339]) to analyse preference data. The current review period also showed an increase in the use of latent class models (12%, 36 studies, e.g. [38, 91, 139, 165, 269]) and other econometric analysis models. Examples include generalised multinomial logit (4%, 12 studies, e.g. [97, 124, 157, 174, 240]) and heteroskedastic multinomial logit (4%, 11 studies, e.g. [134, 139, 184, 256, 309]).
Prior reviews did not collect data about the software used for econometric analysis. For the current review period, Table 4b shows that most DCEs made use of Stata (31%, 94 studies, e.g. [91, 110, 138, 149, 213]) or Nlogit (22%, 65 studies, e.g. [94, 171, 204, 282, 346]) to conduct econometric analysis. However, 26% (79 studies, e.g. [101, 184, 211, 231, 330]) did not clearly report information about the software used.
Among the studies that used mixed logit models to account for preference heterogeneity in the period 2013–2017, 22% (65 studies) included additional information about the distributional assumptions used to conduct the mixed logit analysis and the number of distributional draws (e.g. Halton draws) used to simulate preference heterogeneity. This percentage is similar to the percentage for the period 2009–2012, which was 21%. The mean number of draws for the current review period was 1354 (median 1000, minimum 50, maximum 10,000), and 18% of the DCEs (53 studies) assumed that parameters followed the normal distribution.
Validity Checks and Qualitative Methods
DCEs are based on responses to hypothetical choices (stated preferences), so internal and external validity checks provide a crucial opportunity to assess data quality or to compare stated preferences from DCEs with revealed preferences. As Clark et al.  observed in their review, there is often little reported about the tests for external validity, possibly because validating hypothetical choice scenarios is difficult . Perhaps for this reason, the review covering the period 1990–2000 did not extract specific information about external validity tests. In the reviews from 2001–2012, only a very small proportion (1%) of the DCEs reported any details about their investigations into external validity. The current review period showed that 2% (seven studies [55, 93, 147, 184, 185, 195, 248]) reported using external validity tests (Table 5).
For detailed information about the different internal validity tests, we refer to the prior review papers [6, 7, 11]. In the current review period, the percentage of studies that included internal validity checks ranged from a maximum of 17% (50 studies) for non-satiation checks to 6% (18 studies) for internal compensatory checks. Internal compensatory checks were reported less frequently than in earlier review periods. For the current review period, ‘other’ validity checks such as tests for theoretical and face validity and consistency were used frequently (34%, 102 studies).
Another way to enhance quality in a DCE is to complement the quantitative study with qualitative methods . For the current review period, 86% (258) of the DCEs used qualitative methods to enhance the process and/or results. Most DCEs used interviews (50%, 151 studies) or focus group techniques (18%, 54 studies). Qualitative methods were usually used to inform attribute (53%, 160 studies) and/or level (44%, 134 studies) selection, which follows the overall upwards trend reported in prior reviews. The proportion of DCEs using qualitative methods for questionnaire pre-testing (38%, 113 studies) was similar to the level in the previous review period. Overall, just as in the previous review periods, few studies in the current review period (4%, 12 studies) used qualitative methods to improve the understanding of results/responses.
Information about the trends regarding the presented outcome measures is presented in Table 6.
As mentioned in prior reviews, DCEs often presented their outcomes in terms of willingness to pay (WTP), a monetary welfare measure or a utility score [6, 7, 11]. Use of these methods has declined over the past two review periods (2001–2012), and use of utility scores decreased from 24% to 8% over the past three periods (1990–2012). Relative to the previous period, we observed increases in the use of utility scores (17%, 50 studies, e.g. [61, 128, 141, 164, 317]), odds ratios (10%, 30 studies, e.g. [80, 146, 200, 234, 280]) and probability scores (13%, 38 studies, e.g. [122, 154, 198, 272, 277]). We also collected information about willingness-to-accept (WTA) measures (4%, 13 studies, e.g. [53, 94, 250, 322, 338]) and regression coefficients (56%, 169 studies, e.g. [44, 57, 231, 244, 276]), which were not collected in previous reviews. The proportion of studies with ‘other’ outcome measures remained near one half (49%, 147 studies, e.g. [48, 87, 114, 207, 273]). Examples from this category include (predicted) choice shares, maximum acceptable risk, relative importance and ranking.
In this study, we reviewed DCEs published between 2013 and 2017. We followed the methods of prior reviews and compared our extraction results to those reviews to identify trends. We identified that DCEs have continued to increase in number and have been undertaken in more and more countries. Studies reported using more sophisticated designs with associated software, for example, D-efficient designs generated using Ngene. The trend towards the use of more sophisticated econometric models has also continued. However, many studies presented sophisticated methods with insufficient detail. For example, we were not able to check whether the results had the correct interpretation or whether the authors had conducted the appropriate diagnostics (e.g. checked that the data possessed the IIA characteristic). Qualitative methods have continued to be popular as an approach to select attributes and levels, which might improve validity. In this study, we also extracted data in several new categories, for example, sample size and type, the use of blocking, software used for econometric analysis and type of qualitative method used. We observed that the mean and median sample size were 728 and 401, respectively, with most samples including patients. We also observed that half of the studies used blocking and most studies used Stata for econometric analysis. Interviewing was the most popular qualitative research method used alongside DCEs.
The observed increase in the total number of DCEs in health economics was similar to the trend reported in prior reviews [6, 7, 11], but less consistent from year to year (Fig. 3). This less consistent increase might be explained by the presence of many competing stated preference methods [4, 5, 347]. We hypothesise that other methods may be increasing in popularity or becoming more useful in health settings . Examples of such methods may include BWS case 1 and case 2 [349,350,351], which were not included in this review. Additionally, in this review, we excluded a significant number of studies (n = 31) making methodological considerations about DCEs rather than conducting empirical research. The presence of such studies may indicate that knowledge about DCEs in health has increased and there is more focus on studies to develop the method. Examples include simulation studies about experimental design, studies comparing the outcomes of a DCE to other stated preference method outcomes and studies examining different model specifications [352,353,354]. This might be another explanation for the less consistent increase in DCE application studies.
The common use of fractional designs, as described in prior reviews [6, 7], has continued. This review also found that main effects DCEs continue to dominate; however, there is a downwards trend as DCE designs incorporate two-way interactions more often. This is in line with the recommendations of Louviere and Lancsar , who suggest inclusion of interaction terms should be explored in the experimental design stage. Ngene became the most popular software tool in the current review period for generating experimental designs, while D-efficient designs became the most popular method to create choice sets. Perhaps as a consequence of the rise in software-generated designs, this review also showed that an increasing percentage of articles did not include information about experimental design features such as the design plan. Omitting this type of information might inhibit quality assessment and reduce confidence in the results. Future research might focus on the specific reasons why such information is missing and the impact of the missing information on quality assessment of DCEs. One potential reason for omitting methodological details is the journal word limit. When confronted with a low word limit, authors should consider using online space to report additional design and analysis details.
In addition to these observations about the generation of experimental designs, we identified design information that would be helpful to report in DCEs and future systematic reviews. For example, prior reviews did not include information about blocking, and although at least half of the DCEs we reviewed used blocking, 30% of the studies we reviewed did not include information about blocking. Blocking could be an important technique in light of the growing literature about the cognitive burden of DCEs and the impact of this cognitive burden on respondent outcomes . However, blocking also has the disadvantage of requiring a larger sample size . The approach described by Sándor and Wedel  might be another alternative to increase the validity of DCE outcomes in case of relatively small sample sizes or the investigation of preference heterogeneity.
Prior reviews identified a shift to more flexible econometric analysis models [6, 7], which is not necessarily positive. This trend has continued in this review. Most studies included multinomial logit or mixed logit models. Although we did not formally extract information about variance estimation, we noted that among the DCEs using multinomial logit models to analyse choice data, few reported robust or Huber-White standard errors (most studies reported ‘regular’ standard errors). Since these standard errors allow for more flexible substitution patterns and flexible variances, it is common in economics and econometrics to report these standard errors instead of ‘regular’ standard errors . Also, in the presence of repeated observations from the same individuals, conventional standard errors are biased downward . Thus, future DCEs in health economics could benefit from more appropriate treatment of clustered data (i.e. use of robust standard errors) and more complete reporting of econometric output.
In terms of analytical methods, we also observed some patterns in the exploration of preference and scale heterogeneity. We noted that, among the 39% of studies that used a mixed logit model, many treated heterogeneity as a nuisance, i.e. they used the mixed model to accommodate repeated measures but did not report additional information about the ‘mixed’ aspect of the data (e.g. standard deviation estimates). Since preference heterogeneity is regarded as an important aspect within choice modelling, taking full advantage of the modelling results might help us understand preference heterogeneity better . With regard to scale heterogeneity, work by Fiebig et al.  indicated that other models such as the generalised multinomial logit and heteroskedastic multinomial logit models could be considered when analysing DCE data, to identify differences in scale when comparing preferences between groups of respondents . Data from this review identified a small number of DCEs using such methods; for a more detailed breakdown, we refer readers to another review focussing on scale heterogeneity specifically . However, it is important to mention that the generalised multinomial logit model should be used with caution since the ability of this model to capture scale heterogeneity has been questioned in the literature .
Articles by Vass and Payne  and Mott  describe issues influencing the degree to which DCE findings are used in healthcare decision-making (e.g. health-state valuation and health technology assessment). These articles, rising popularity of the method, and interest from regulators and funders suggest that DCEs could play an important role in real-world decision-making [361, 362]. However, concerns have been expressed about the validity, reliability, robustness and generalisability of DCEs [11, 363]. A key stage in understanding the robustness of DCEs is understanding whether stated preferences reflect ‘true’ preferences as revealed in the market . In this study, we observed that the number of studies testing external validity remained small. Future research should focus on identifying and resolving the methodological and practical challenges involved in validity testing, and on guiding the incorporation of DCEs into actual decision-making in healthcare. Another practice that may improve the robustness of DCEs and facilitate their use in healthcare decision-making is the increased use of qualitative methods to complement quantitative DCE analysis . Prior reviews and additional literature suggest that qualitative research methods can strengthen DCEs and other quantitative methods by facilitating numerous investigations such as (1) identification of relevant attributes and levels, (2) verification that respondents understand the presented information, and (3) learning about respondents’ decision strategies [6, 7, 11, 364]. These investigations can help determine whether respondents are making choices in line with the underpinning utility theories, thereby supporting the legitimacy of the underlying assumptions. This review showed an overall upwards trend in the number of DCEs using qualitative methods to select attributes and levels. This move towards a more mixed-methods approach has been observed by others, for example, the study by Ikenwilo et al. .
Strengths and Limitations
The current study has several strengths. First, the detailed data extraction was completed by each author individually, with the total number of articles approximately divided equally among authors because of the relative short timeframe and the need to balance author burden with study quality. Additionally, a subsample of studies (20%) was double-checked by one author (V.S.) for quality control, which enhanced reliability. Second, this study identified trends in empirical DCEs by comparing outcomes from all prior reviews. Additionally, this study included aspects of empirical DCEs not investigated before, although these aspects were recognised in the literature as becoming more important in DCE research (e.g. blocking in experimental design and the type of qualitative methods used in a DCE). Third, our observation of less rapid growth in the number of empirical DCEs (compared to the growth observed in previous reviews) matches the trend in the preference research to focus on the broad range of stated preference methods available (rather than DCEs exclusively) [4, 5, 347].
A potential weakness of this study was the use of multiple reviewers with potentially different interpretations of DCE reports, which might have affected the data extraction and, as a consequence, the results presented. To limit inconsistency between reviewers, all co-authors discussed the data extraction frequently and results were cross-validated by a single author (V.S.). Similarly, this inconsistency in interpretation may also have occurred between the different review periods. Procedural information from the two most recent reviews was used to ensure consistency, and we are therefore confident the general trends reported and the conclusion that more detailed methods reporting is called for holds. Another potential weakness is the use of only one database (PubMed). However, like the authors of the prior reviews [6, 7], we do not expect the review findings to be significantly different when performing searches on other databases. Also, since we were interested in identifying trends and therefore maximising comparability between the different reviews, we preferred to restrict our searches to this single database. As with many systematic reviews, data were extracted from published manuscripts and online appendices. The results are therefore reliant on what was reported in the final article and do not necessarily reflect all activities of the authors. Trends presented could therefore reflect factors such as publication bias, journal scope, editor preferences, and word limits, as well as preferences of journal editors rather than actual practice. Additionally, although we did update the data extraction tool based on changes in the field, future research might benefit from updating other aspects of the systematic review protocol such as search terms and inclusion and exclusion criteria (e.g. inclusion of best–best scaling). Finally, although we believe that DCEs are both useful and common enough to deserve focused attention in this review, DCEs represent one method among many for examining health preferences, and other methods may be preferable depending on the circumstances .
This study provides an overview of the applications and methods used by DCEs in health. The use of empirical DCEs in health economics has continued to grow, as have the areas of application and the geographic scope. This study identified changes in the experimental design (e.g. more frequent use of D-efficient designs), analysis methods (e.g. mixed logit models most frequently used), validity enhancement (e.g. more diverse use of internal validity checks), qualitative methods (e.g. upwards trend of qualitative methods used for attribute and level selection) and outcome measures (e.g. coefficients most frequently used). However, a large number of studies not reporting methodological details were also identified. DCEs should include more complete information, for example, information about design generation, blocking, model specification, random-parameter estimation and model results. Developing reporting guidelines specifically for DCEs might positively impact quality assessment, increase confidence in the results and improve the ability of decision-makers to act on the results. How and when to integrate health-related DCE outcomes into decision-making remains an important area for future research.
In this review, best–worst scaling (BWS) case 1 and 2 are distinguished from case 3. Since case 1 and 2 BWS do not involve attribute-based comparisons between two or more alternatives, they were excluded from this review , consistent with the previous review . Case 3 BWS, however, involves an attribute-based comparison between two or more alternatives and is considered an extension of DCEs in the literature [367, 42]. Therefore, case 3 BWS applications were included in this review.
Hogg CN. Patient and public involvement: what next for the NHS? Health Expect. 2007;10(2):129–38.
Mockford C, Staniszewska S, Griffiths F, Herron-Marx S. The impact of patient and public involvement on UK NHS health care: a systematic review. Int J Qual Health Care. 2012;24(1):28–38. https://doi.org/10.1093/intqhc/mzr066.
Soekhai V, Whichello C, Levitan B, Veldwijk J, Hammad T, Kihlbom U, et al. Compendium of methods for measuring patient preferences in medical treatment. Value Health. 2017;20(9):A684–5.
MDIC. Medical Device Innovation Consortium (MDIC): patient centered risk-benefit project report. [Internet]. 2015. http://mdic.org/wpcontent/uploads/2015/05/MDIC_PCBR_Framework_Web1.pdf. Accessed 29 June 2018.
Mahieu PA, Andersson H, Beaumais O, dit Sourd RC, Hess S, Wolff F. Stated preferences: a unique database composed of 1,657 recent published articles in journals related to agriculture, environment or health. Rev Agric Food Environ Stud. 2017;98(3):201–20.
Clark MD, Determann D, Petrou S, Moro D, de Bekker-Grob EW. Discrete choice experiments in health economics: a review of the literature. Pharmacoeconomics [Internet]. 2014. [cited 2018 Jun 18];32:883–902. http://www.ncbi.nlm.nih.gov/pubmed/25005924.
De Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ [Internet]. 2012. Wiley-Blackwell; 2012 [cited 2018 Jun 18];21:145–72. http://doi.wiley.com/10.1002/hec.1697.
Lancaster KJ. A new approach to consumer theory. J Polit Econ [Internet]. The University of Chicago Press. 1966. [cited 2018 Jun 18];74:132–57. http://www.journals.uchicago.edu/doi/10.1086/259131.
Mandeville KL, Lagarde M, Hanson K. The use of discrete choice experiments to inform health workforce policy: a systematic review. BMC Health Serv Res [Internet]. 2014. [cited 2018 Jun 18];14. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4161911/pdf/12913_2014_Article_3466.pdf.
Thurstone LL. A law of comparative judgment. Psychol Rev [Internet]. 1927. [cited 2018 Jul 8];34:273–86. http://content.apa.org/journals/rev/34/4/273.
Ryan M, Gerard K. Using discrete choice experiments to value health care programmes: current practice and future research reflections. Appl Heal Econ Heal Policy [Internet]. 2003. [cited 2018 Jun 18];2:55–64. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&CSC=Y&NEWS=N&PAGE=fulltext&D=med4&AN=14619274%5Cnhttp://sfxeu08.hosted.exlibrisgroup.com/sgul?sid=OVID:medline&id=pmid:14619274&id=doi:&issn=1175-5652&isbn=&volume=2&issue=1&spage=55&pages=55-64&date=2003&title=Appl.
Louviere JJ, Lancsar E. Choice experiments in health: the good, the bad, the ugly and toward a brighter future. Heal Econ Policy Law [Internet]. 2009. [cited 2018 Jun 20];4:527–46. http://www.ncbi.nlm.nih.gov/pubmed/19715635.
Lancsar E, Swait J. Reconceptualising the external validity of discrete choice experiments. Pharmacoeconomics [Internet]. Springer International Publishing; 2014. [cited 2018 Jun 26];32:951–65. http://link.springer.com/10.1007/s40273-014-0181-7.
Bridges JFP, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint analysis applications in health—a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. Value Heal [Internet]. 2011. [cited 2018 Jun 23];14:403–13. https://www.ispor.org/TaskForces/documents/ISPOR-CA-in-Health-TF-Report-Checklist.pdf.
Johnson FR, Lancsar E, Marshall D, Kilambi V, Mühlbacher A, Regier DA, et al. Constructing experimental designs for discrete-choice experiments: report of the ISPOR Conjoint Analysis Experimental Design Good Research Practices Task Force. Value Heal [Internet]. 2013. [cited 2018 Jun 23];16:3–13. https://www.ispor.org/ValueInHealth/ShowValueInHealth.aspx?issue=3551E3F3-83A8-4895-9415-5272AF29A9DF.
Lancsar E, Louviere J. Conducting discrete choice experiments to inform health care decision-making: a user’s guide, experiments to inform healthcare a user’s guide. Pharmacoeconomics [Internet]. 2008. [cited 2018 Jul 13];26:661–77. https://link.springer.com/content/pdf/10.2165%2F00019053-200826080-00004.pdf.
Hauber AB, González JM, Groothuis-Oudshoorn CGM, Prior T, Marshall DA, Cunningham C, et al. Statistical methods for the analysis of discrete choice experiments: a report of the ISPOR Conjoint Analysis Good Research Practices Task Force. Value Heal [Internet]. 2016. [cited 2018 Jun 23];19:300–15. https://www.ispor.org/Conjoint-Analysis-Statistical-Methods-Guidelines.pdf.
Louviere JJ, Islam T, Wasi N, Street D, Burgess L. Designing discrete choice experiments: do optimal designs come at a price? J Consum Res [Internet]. The University of Chicago Press. 2008. [cited 2018 Jun 20];35:360–75. https://academic.oup.com/jcr/article-lookup/doi/10.1086/586913.
Vass CM, Payne K. Using discrete choice experiments to inform the benefit-risk assessment of medicines: are we ready yet? Pharmacoeconomics [Internet]. 2017. [cited 2018 Jul 8];35:859–66. http://www.ncbi.nlm.nih.gov/pubmed/28536955.
Mott DJ. Incorporating quantitative patient preference data into healthcare decision-making processes: is HTA falling behind? Patient [Internet]. Springer International Publishing. 2018. [cited 2018 Jul 8];11:249–52. http://link.springer.com/10.1007/s40271-018-0305-9.
Mulhern B, Norman R, Street D, Viney R. One method, many methodological choices: a structured review of discrete-choice experiments for health state valuation. PharmacoEconomics. 2018;2018:1–15.
Quaife M, Terris-Prestholt F, Di Tanna GL, Vickerman P. How well do discrete choice experiments predict health choices? A systematic review and meta-analysis of external validity. Eur J Health Econ. 2018;2018:1–14.
Marshall D, Bridges JF, Hauber B, Cameron R, Donnalley L, Fyie K, et al. Conjoint analysis applications in health—how are studies being designed and reported? Patient Patient-Cent Outcomes Res. 2010;3(4):249–56.
Kleij KS, Tangermann U, Amelung VE, Krauth C. Patients’ preferences for primary health care–a systematic literature review of discrete choice experiments. BMC Health Serv Res. 2017;17(1):476.
Clark MD, Szczepura A, Gumber A, Howard K, Moro D, Morton RL. Measuring trade-offs in nephrology: a systematic review of discrete choice experiments and conjoint analysis studies. Nephrol Dial Transpl. 2017;33(2):348–55.
Michaels-Igbokwe C, MacDonald S, Currie GR. Individual preferences for child and adolescent vaccine attributes: a systematic review of the stated preference literature. Patient Patient-Cent Outcomes Res. 2017;10(6):687–700.
Regmi K, Kaphle D, Timilsina S, Tuha NAA. Application of discrete-choice experiment methods in tobacco control: a systematic review. PharmacoEconomics-Open. 2018;2018:1–13.
Whitty JA, Gonçalves ASO. A systematic review comparing the acceptability, validity and concordance of discrete choice experiments and best–worst scaling for eliciting preferences in healthcare. Patient Patient-Cent Outcomes Res. 2017;2017:1–17.
Harrison M, Milbers K, Hudson M, Bansback N. Do patients and health care providers have discordant preferences about which aspects of treatments matter most? Evidence from a systematic review of discrete choice experiments. BMJ Open. 2017;7(5):e014719.
Wright SJ, Vass CM, Sim G, Burton M, Fiebig DG, Payne K. Accounting for scale heterogeneity in healthcare-related discrete choice experiments when comparing stated preferences: a systematic review. Patient Patient-Cent Outcomes Res. 2018;2018:1–14.
Bien DR, Danner M, Vennedey V, Civello D, Evers SM, Hiligsmann M. Patients’ preferences for outcome, process and cost attributes in cancer treatment: a systematic review of discrete choice experiments. Patient Patient-Cent Outcomes Res. 2017;10(5):553–65.
Vass C, Gray E, Payne K. Discrete choice experiments of pharmacy services: a systematic review. Int J Clin Pharm. 2016;38(3):620–30.
Mansfield C, Tangka FK, Ekwueme DU, Smith JL, Guy GP Jr, Li C, et al. Peer reviewed: stated preference for cancer screening: a systematic review of the literature, 1990–2013. Prevent Chronic Dis. 2016;2016:13.
Schatz NK, Fabiano GA, Cunningham CE, Waschbusch DA, Jerome S, Lupas K, Morris KL. Systematic review of patients’ and parents’ preferences for ADHD treatment options and processes of care. Patient Patient-Cent Outcomes Res. 2015;8(6):483–97.
Vass C, Rigby D, Payne K. The role of qualitative research methods in discrete choice experiments: a systematic review and survey of authors. Med Decis Mak. 2017;37(3):298–313.
Mandeville KL, Lagarde M, Hanson K. The use of discrete choice experiments to inform health workforce policy: a systematic review. BMC Health Serv Res. 2014;14(1):367.
Hiligsmann M, Bours SP, Boonen A. A review of patient preferences for osteoporosis drug treatment. Curr Rheumatol Rep. 2015;17(9):61.
Webb EJ, Meads D, Eskyte I, King N, Dracup N, Chataway J, et al. A systematic review of discrete-choice experiments and conjoint analysis studies in people with multiple sclerosis. Patient Patient-Cent Outcomes Res. 2018;2018:1–12.
Janssen EM, Marshall DA, Hauber AB, Bridges JFP. Improving the quality of discrete-choice experiments in health: how can we assess validity and reliability? Expert Rev Pharmacoecon Outcomes Res [Internet]. 2017. [cited 2018 Jul 25];17:531–42. http://www.ncbi.nlm.nih.gov/pubmed/29058478.
Zhou M, Thayer WM, Bridges JF. Using latent class analysis to model preference heterogeneity in health: a systematic review. PharmacoEconomics. 2018;2018:1.
Mulhern B, Norman R, Street D, Viney R. One method, many methodological choices: a structured review of discrete-choice experiments for health state valuation. PharmacoEconomics. 2018;2018:1–15.
Flynn TN, Louviere JJ, Peters TJ, Coast J. Best-worst scaling: what it can do for health care research and how to do it. J Health Econ [Internet]. 2007. [cited 2018 Jun 22];26:171–89. http://www.ncbi.nlm.nih.gov/pubmed/16707175.
Augustovski F, Beratarrechea A, Irazola V, Rubinstein F, Tesolin P, Gonzalez J, et al. Patient preferences for biologic agents in rheumatoid arthritis: a discrete-choice experiment. Value Health. 2013;16:385–93.
Boone D, Mallett S, Zhu S, Yao GL, Bell N, Ghanouni A, et al. Patients’ & healthcare professionals’ values regarding true- & false-positive diagnosis when colorectal cancer screening by CT colonography: discrete choice experiment. PLoS One. 2013;2013:8.
Carroll FE, Al-Janabi H, Flynn T, Montgomery AA. Women and their partners’ preferences for Down’s syndrome screening tests: a discrete choice experiment. Prenat Diagn. 2013;33:449–56.
Deal K, Marshall D, Dabrowski D, Charter A, Bukoski M, Moayyedi P. Assessing the value of symptom relief for patients with gastroesophageal reflux disease treatment: willingness to pay using a discrete choice experiment. Value Heal [Internet]. 2013;16:588–98. https://doi.org/10.1016/j.jval.2013.01.007 (Elsevier).
De Bekker-Grob EW, Bliemer MCJ, Donkers B, Essink-Bot ML, Korfage IJ, Roobol MJ, et al. Patients’ and urologists’ preferences for prostate cancer treatment: a discrete choice experiment. Br J Cancer [Internet]. 2013;109:633–40. https://doi.org/10.1038/bjc.2013.370 (Nature Publishing Group).
Gelhorn HL, Stringer SM, Brooks A, Thompson C, Monz BU, Boye KS, et al. Preferences for medication attributes among patients with type 2 diabetes mellitus in the UK. Diabetes Obes Metab. 2013;15:802–9.
Glenngård AH, Hjelmgren J, Thomsen PH, Tvedten T. Patient preferences and willingness-to-pay for ADHD treatment with stimulants using discrete choice experiment (DCE) in Sweden, Denmark and Norway. Nord J Psychiatry. 2013;67:351–9.
Gonzalez JM, Johnson FR, Runken MC, Poulos CM. Evaluating migraineurs’ preferences for migraine treatment outcomes using a choice experiment. Headache. 2013;53:1635–50.
Hauber AB, Arden NK, Mohamed AF, Johnson FR, Peloso PM, Watson DJ, et al. A discrete-choice experiment of United Kingdom patients’ willingness to risk adverse events for improved function and pain control in osteoarthritis. Osteoarthr Cartil [Internet]. 2013;21:289–97. https://doi.org/10.1016/j.joca.2012.11.007 (Elsevier Ltd).
Krucien N, Gafni A, Fleury B, Pelletier-Fleury N. Patients’ with obstructive sleep apnoea syndrome (OSAS) preferences and demand for treatment: a discrete choice experiment. Thorax. 2013;68:487–8.
Laba TL, Brien JA, Fransen M, Jan S. Patient preferences for adherence to treatment for osteoarthritis: the MEdication Decisions in Osteoarthritis Study (MEDOS). BMC Musculoskelet Disord. 2013;14.
Lathia N, Isogai PK, Walker SE, De Angelis C, Cheung MC, Hoch JS, et al. Eliciting patients’ preferences for outpatient treatment of febrile neutropenia: a discrete choice experiment. Support Care Cancer. 2013;21:245–51.
Meghani SH, Chittams J, Hanlon AL, Curry J. Measuring preferences for analgesic treatment for cancer pain: how do African-Americans and Whites perform on choice-based conjoint (CBC) analysis experiments? BMC Med Inform Decis Mak [Internet]. BMC Medical Informatics and Decision-making. 2013. 13:1. Available from: BMC Medical Informatics and Decision-making
Milte R, Ratcliffe J, Miller M, Whitehead C, Cameron ID, Crotty M. What are frail older people prepared to endure to achieve improved mobility following hip fracture? A discrete choice experiment. J Rehabil Med. 2013;45:81–6.
Mohamed AF, Zhang J, Johnson FR, Lomon ID, Malvolti E, Townsend R, et al. Avoidance of weight gain is important for oral type 2 diabetes treatments in Sweden and Germany: patient preferences. Diabetes Metab [Internet]. 2013;39:397–403. https://doi.org/10.1016/j.diabet.2013.06.001 (Elsevier Masson SAS).
Moia M, Mantovani LG, Carpenedo M, Scalone L, Monzini MS, Cesana G, et al. Patient preferences and willingness to pay for different options of anticoagulant therapy. Intern Emerg Med. 2013;8:237–43.
Najafzadeh M, Johnston KM, Peacock SJ, Connors JM, Marra MA, Lynd LD, et al. Genomic testing to determine drug response: measuring preferences of the public and patients using discrete choice experiment (DCE). BMC Health Serv Res. 2013;2013:13.
Parkinson B, Goodall S, Norman R. Measuring the loss of consumer choice in mandatory health programmes using discrete choice experiments. Appl Health Econ Health Policy. 2013;11:139–50.
Pisa G, Freytag S, Schandry R. Chronic obstructive pulmonary disease (COPD) patients’ disease-related preferences: a study using conjoint analysis. Patient. 2013;6:93–101.
Schaarschmidt ML, Umar N, Schmieder A, Terris DD, Goebeler M, Goerdt S, et al. Patient preferences for psoriasis treatments: impact of treatment experience. J Eur Acad Dermatol Venereol. 2013;27:187–98.
Veldwijk J, Lambooij M, van Gils P, Struijs J, Smit H, de Wit GA. Type 2 diabetes patients’ preferences and willingness to pay for lifestyle programs: a discrete choice experiment. BMC Public Health [Internet]. 2013;13:1099. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed11&NEWS=N&AN=24289831. Accessed 16 May 2018.
Whitty JA, Stewart S, Carrington MJ, Calderone A, Marwick T, Horowitz JD, et al. Patient preferences and willingness-to-pay for a home or clinic based program of chronic heart failure management: findings from the Which? trial. PLoS One. 2013;8:1–8.
Zimmermann TM, Clouth J, Elosge M, Heurich M, Schneider E, Wilhelm S, et al. Patient preferences for outcomes of depression treatment in Germany: a choice-based conjoint analysis study. J Affect Disord [Internet]. 2013;148:210–9. https://doi.org/10.1016/j.jad.2012.11.062 (Elsevier).
Cameron MP, Newman PA, Roungprakhon S, Scarpa R. The marginal willingness-to-pay for attributes of a hypothetical HIV vaccine. Vaccine [Internet]. 2013;31:3712–7. https://doi.org/10.1016/j.vaccine.2013.05.089 (Elsevier Ltd).
Tokes K, Quadri S, Cahill P, Chiu G, Ivanov A, Tang H. Disease and treatment perceptions among Asian Americans diagnosed with chronic hepatitis B infection. J Gen Intern Med. 2014;29:477–84.
Dixon S, Nancarrow SA, Enderby PM, Moran AM, Parker SG. Assessing patient preferences for the delivery of different community-based models of care using a discrete choice experiment. Health Expect. 2013;2013:1204–14.
Benning TM, Dellaert BGC, Severens JL, Dirksen CD. The effect of presenting information about invasive follow-up testing on individuals’ noninvasive colorectal cancer screening participation decision: results from a discrete choice experiment. Value Heal [Internet]. 2014;17:578–87. https://doi.org/10.1016/j.jval.2014.04.007 (Elsevier).
Bessen T, Chen G, Street J, Eliott J, Karnon J, Keefe D, et al. What sort of follow-up services would Australian breast cancer survivors prefer if we could no longer offer long-term specialist-based care? A discrete choice experiment. Br J Cancer [Internet]. 2014;110:859–67. https://doi.org/10.1038/bjc.2013.800 (Nature Publishing Group).
Bewtra M, Kilambi V, Fairchild AO, Siegel CA, Lewis JD, Johnson FR. Patient preferences for surgical versus medical therapy for ulcerative colitis. Inflamm Bowel Dis [Internet]. 2014. [cited 2018 Jun 19];20:103–14. http://www.ncbi.nlm.nih.gov/pubmed/24280881.
Fraenkel L, Suter L, Cunningham CE, Hawker G. Understanding preferences for disease-modifying drugs in osteoarthritis. Arthritis Care Res (Hoboken) [Internet]. 2014. [cited 2018 Jun 19];66:1186–92. http://www.ncbi.nlm.nih.gov/pubmed/24470354.
Goossens LMA, Utens CMA, Smeenk FWJM, Donkers B, Van Schayck OCP, Rutten-Van Mölken MPMH. Should I stay or should I go home? A latent class analysis of a discrete choice experiment on hospital-at-home. Value Heal [Internet]. 2014;17:588–96. https://doi.org/10.1016/j.jval.2014.05.004 (Elsevier).
Hauber AB, Arellano J, Qian Y, González JM, Posner JD, Mohamed AF, et al. Patient preferences for treatments to delay bone metastases. Prostate. 2014;74:1488–97.
Havrilesky LJ, Secord AA, Ehrisman JA, Berchuck A, Valea FA, Lee PS, et al. Patient preferences in advanced or recurrent ovarian cancer. Cancer. 2014;120:3651–9.
Howard K, Gerard K, Adelson P, Bryce R, Wilkinson C, Turnbull D. Women’s preferences for inpatient and outpatient priming for labour induction: a discrete choice experiment. BMC Health Serv Res. 2014;14:1–11.
Johnson P, Bancroft T, Barron R, Legg J, Li X, Watson H, et al. Discrete choice experiment to estimate breast cancer patients’ preferences and willingness to pay for prophylactic granulocyte colony-stimulating factors. Value Health [Internet]. 2014;17:380–9. https://doi.org/10.1016/j.jval.2014.01.002 (Elsevier).
Kawata AK, Kleinman L, Harding G, Ramachandran S. Evaluation of patient preference and willingness to pay for attributes of maintenance medication for chronic obstructive pulmonary disease (COPD). Patient—Patient-Centered Outcomes Res [Internet]. 2014. 7:413–26. https://doi.org/10.1007/s40271-014-0064-1.
Kløjgaard ME, Manniche C, Pedersen LB, Bech M, Søgaard R. Patient preferences for treatment of low back pain—a discrete choice experiment. Value Heal [Internet]. 2014;17:390–6. https://doi.org/10.1016/j.jval.2014.01.005.
Nafees B, Setyawan J, Lloyd A, Ali S, Hearn S, Sasane R, et al. Parent preferences regarding stimulant therapies for ADHD: a comparison across six European countries. Eur Child Adolesc Psychiatry. 2014;23:1189–200.
Ostermann J, Njau B, Brown DS, Mühlbacher A, Thielman N. Heterogeneous HIV testing preferences in an urban setting in tanzania: results from a discrete choice experiment. PLoS One. 2014;2014:9.
Poulos C, Hauber AB, González JM, Turpcu A. Patients’ willingness to trade off between the duration and frequency of rheumatoid arthritis treatments. Arthritis Care Res. 2014;66:1008–15.
Smith ML, White CB, Railey E, Sledge GW. Examining and predicting drug preferences of patients with metastatic breast cancer: using conjoint analysis to examine attributes of paclitaxel and capecitabine. Breast Cancer Res Treat. 2014;145:83–9.
Torbica A, Fattore G, Ayala F. Eliciting preferences to inform patient-centred policies: the case of psoriasis. Pharmacoeconomics. 2014;32:209–23.
Van Den Wijngaard L, Van Wely M, Dancet EAF, Van Mello NM, Koks CAM, Van Der Veen F, et al. Patients’ preferences for gonadotrophin-releasing hormone analogs in in vitro fertilization. Gynecol Obstet Invest. 2014;78:16–21.
Van Haaren-ten Haken T, Pavlova M, Hendrix M, Nieuwenhuijze M, de Vries R, Nijhuis J. Eliciting preferences for key attributes of intrapartum care in the Netherlands. Birth. 2014;41:185–94.
Wijnen BFM, de Kinderen RJA, Colon AJ, Dirksen CD, Essers BAB, Hiligsmann M, et al. Eliciting patients’ preferences for epilepsy diagnostics: a discrete choice experiment. Epilepsy Behav [Internet]. 2014;31:102–9. https://doi.org/10.1016/j.yebeh.2013.11.029 (Elsevier Inc.).
Gerard K, Tinelli M, Latter S, Smith A, Blenkinsopp A. Patients’ valuation of the prescribing nurse in primary care: a discrete choice experiment. Health Expect. 2015;18:2223–35.
Krucien N, Le M, Ms V, Pelletier-fleury N. What are the patients’ preferences for the chronic care model? An application to the obstructive sleep apnoea syndrome. Health Expect. 2014;2014:2536–48.
Bewtra M, Fairchild AO, Gilroy E, Leiman DA, Kerner C, Johnson FR, et al. Inflammatory bowel disease patients’ willingness to accept medication risk to avoid future disease relapse. Am J Gastroenterol [Internet]. 2015;110:1675–81. https://doi.org/10.1038/ajg.2015.321 (Nature Publishing Group).
De Vries ST, De Vries FM, Dekker T, Haaijer-ruskamp FM, De Vries ST, De Vries FM, et al. The role of patients’ age on their preferences for choosing additional blood pressure-lowering drugs: a discrete choice experiment in patients with diabetes. PLoS One [Internet]. 2015;10:1–15. https://doi.org/10.1371/journal.pone.0139755.
Bottger B, Thate-Waschke I-M, Bauersachs R, Kohlmann T, Wilke T. Preferences for anticoagulation therapy in atrial fibrillation: the patients’ view. J Thromb Thrombol [Internet]. 2015;40:406–15. https://doi.org/10.1007/s11239-015-1263-x.
De Bekker-Grob EW, Niers EJ, Van Lanschot JJB, Steyerberg EW, Wijnhoven BPL, Eva EWDB, et al. Patients’ preferences for surgical management of esophageal cancer: a discrete choice experiment. World J Surg. 2015;39:2492–9 (Springer International Publishing).
Howard K, Mph HI, Mhealthec M, Bbus GPS, Mph MPP. Men’s preferences and trade-offs for prostate cancer screening: a discrete choice experiment. 2014;3123–35.
Beulen L, Grutters JPC, Faas BHW, Feenstra I, Groenewoud H, van Vugt JMG, et al. Women’s and healthcare professionals’ preferences for prenatal testing: a discrete choice experiment. Prenat Diagn. 2015;35:549–57.
Böttger B, Thate-Waschke I-M, Bauersachs R, Kohlmann T, Wilke T. Preferences for anticoagulation therapy in atrial fibrillation. J Thromb Thrombol. 2015;40:406–15.
Brown P, Panattoni L, Cameron L, Knox S, Ashton T, Tenbensel T, et al. Hospital sector choice and support for public hospital care in New Zealand: results from a labeled discrete choice survey. J Health Econ [Internet]. 2015;43:118–27. https://doi.org/10.1016/j.jhealeco.2015.06.004 (Elsevier B.V.).
Chamot E, Mulambia C, Kapambwe S, Shrestha S, Parham GP, Macwan’gi M, et al. Preference for human papillomavirus-based cervical cancer screening: results of a choice-based conjoint study in Zambia. J Low Genit Tract Dis. 2015;19:119–23.
Chen L-C, Cheng L-J, Zhang Y, He X, Knaggs RD. Acupuncture or low frequency infrared treatment for low back pain in Chinese patients: a discrete choice experiment. PLoS One [Internet]. 2015;10:e0126912. https://doi.org/10.1371/journal.pone.0126912.
Coxon D, Frisher M, Jinks C, Jordan K, Paskins Z, Peat G. The relative importance of perceived doctor’s attitude on the decision to consult for symptomatic osteoarthritis: a choice-based conjoint analysis study. BMJ Open. 2015;5:1–10.
Danyliv A, Pavlova M, Gryga I, Groot W. Preferences for physician services in Ukraine: a discrete choice experiment. BMJ Open. 2015;30:346–65.
Harris P, Whitty JA, Kendall E, Ratcliffe J, Wilson A, Littlejohns P, et al. The Australian public’s preferences for emergency care alternatives and the influence of the presenting context: a discrete choice experiment. 2015;1–12.
Laba T, Howard K, Rose J, Peiris D, Redfern J, Usherwood T, et al. Patient preferences for a polypill for the prevention of cardiovascular diseases. 2015.
Larson E, Vail D, Mbaruku GM, Kimweri A, Freedman LP, Kruk ME. Moving toward patient-centered care in Africa: a discrete choice experiment of preferences for delivery care among 3,003 Tanzanian women. 2015;1–12.
Mcateer A, Yi D, Watson V, Norwood P, Ryan M, Hannaford PC, et al. Exploring preferences for symptom management in primary care. 2015;478–88.
Berhane A, Enquselassie F. Patients’ preferences for attributes related to health care services at hospitals in Amhara Region, northern Ethiopia: a discrete choice experiment. Patient Prefer Adherence [Internet]. 2015;9:1293–301. http://www.proxy.its.virginia.edu/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=a9h&AN=110257669&site=ehost-live&scope=site
Michaels-igbokwe C, Lagarde M, Cairns J, Initiative I, Terris-prestholt F. Designing a package of sexual and reproductive health and HIV outreach services to meet the heterogeneous preferences of young people in Malawi: results from a discrete choice experiment. 2015;15–7.
Ostermann J, Njau B, Mtuy T, Brown DS, Mühlbacher A, Thielman N. One size does not fit all: HIV testing preferences differ among high-risk groups in Northern Tanzania. AIDS Care - Psychol Socio-Medical Asp AIDS/HIV [Internet]. 2015. [cited 2018 Jun 19];27:595–603. http://www.ncbi.nlm.nih.gov/pubmed/25616562.
Salloum RG, Maziak W, Hammond D, Nakkash R, Islam F, Cheng X, et al. Eliciting preferences for waterpipe tobacco smoking using a discrete choice experiment: implications for product regulation. BMJ Open. 2015;1–8.
Sawamura K, Sano H, Rn MN. Japanese public long-term care insured: preferences for future long-term care facilities, including relocation, waiting times, and individualized care. JMDA [Internet]. 2015;16:350.e9–20. https://doi.org/10.1016/j.jamda.2015.01.082 (Elsevier).
Brinovec RP, Warren E, Wittgens K, Dickmann P. Decision-making criteria among European patients: exploring patient preferences for primary care services. 2018;25:3–9.
Filby A, Smith AB, Carr LM. Consumer preferences for scanning modality to diagnose focal liver lesions. Int J Technol Assess Health Care. 2015;2:27–35.
Whitty JA, Kendall E, Sav A, et al. Preferences for the delivery of community pharmacy services to help manage chronic conditions. Res Soc Adm Pharm [Internet]. 2015;11:197–215. https://doi.org/10.1016/j.sapharm.2014.06.007 (Elsevier Inc).
Zickafoose JS, DeCamp LR, Prosser LA. Parents’ preferences for enhanced access in the pediatric medical home: a discrete choice experiment. JAMA Pediatr [Internet]. NIH Public Access. 2015. [cited 2018 Jun 19];169:358–64. http://www.ncbi.nlm.nih.gov/pubmed/25643000.
Hauber AB, Nguyen H, Posner J, Kalsekar I, Ruggles J. A discrete-choice experiment to quantify patient preferences for frequency of glucagon-like peptide-1 receptor agonist injections in the treatment of type 2 diabetes. 2016;7995.
Spinks J, Janda M, Soyer HP, Whitty JA. Consumer preferences for teledermoscopy screening to detect melanoma early. J Telemed Telecare. 2016;22:39–46.
Ramirez M, Wu S, Beale E. Designing a text messaging intervention to improve physical activity behavior among low-income Latino patients with diabetes. Los Angeles, 2014–2015. Prev Chronic Dis. 2016;13:160035. https://doi.org/10.5888/pcd13.160035.
Murchie P, Norwood PF, Pietrucin-materek M, Porteous T, Hannaford PC, Ryan M. Determining cancer survivors’ preferences to inform new models of follow-up care. Nature Publishing Group; 2016;115:1495–503. http://dx.doi.org/10.1038/bjc.2016.352.
Tang C, Xu J, Zhang M. The choice and preference for public- private health care among urban residents in China: evidence from a discrete choice experiment. BMC Health Serv Res [Internet]. BMC Health Services Research; 2016;1–11. http://dx.doi.org/10.1186/s12913-016-1829-0.
Dong D, Ozdemir S, Bee YM, Toh S, Bilger M, Finkelstein E. Measuring high-risk patients’ preferences for pharmacogenetic testing to reduce severe adverse drug reaction: a discrete choice experiment. Value Heal [Internet]. Elsevier; 2016;19:767–75. http://dx.doi.org/10.1016/j.jval.2016.03.1837.
Abiiro GA, Torbica A, Kwalamasa K. What factors drive heterogeneity of preferences for micro-health insurance in rural Malawi? 2018;1172–83.
Minh H Van, Chung LH, Giang KB, Duc DM, Hinh ND, Mai VQ, et al. Potential impact of graphic health warnings on cigarette packages in reducing cigarette demand and smoking-related deaths in Vietnam. 2016;17:85–90.
Porteous T, Ryan M, Bond C, Watson M, Watson V. Managing minor ailments; the public’ s preferences for attributes of community pharmacies. A discrete choice experiment. 2016;1–15.
Veldwijk J, Essers BAB, Lambooij MS, Dirksen CD, Smit HA, Wit GA De. Survival or mortality: does risk attribute framing influence decision-making behavior in a discrete choice experiment? Value Heal [Internet]. Elsevier; 2016;19:202–9. http://dx.doi.org/10.1016/j.jval.2015.11.004.
Wong SF, Sci BM, Norman R, Dunning TL, Ashley DM, Collins I, et al. A discrete choice experiment to examine the preferences of patients with cancer and their willingness to pay for different types of health care appointments. J Natl Compr Cancer Netw. 2016;14:311–9.
Ozawa S, Grewal S, Bridges JFP. Household size and the decision to purchase health insurance in Cambodia: results of a discrete-choice experiment with scale adjustment. Appl Health Econ Health Policy. Springer International Publishing; 2016;14:195–204.
Czoli CD, Goniewicz M, Islam T, Kotnowski K, Hammond D. Consumer preferences for electronic cigarettes: results from a discrete choice experiment. 2016;30–7.
Veldwijk J, Lambooij MS, Kallenberg FGJ, Kranen HJ Van, Bredenoord AL, Dekker E, et al. Preferences for genetic testing for colorectal cancer within a population-based screening program: a discrete choice experiment. 2016;1:361–6.
Kotnowski K, Fong GT, Gallopel-morvan K, Islam T, Hammond D. The impact of cigarette packaging design among young females in Canada: findings from a discrete choice experiment. 2018;1348–56.
Kan HJ, de Bekker-Grob EW, Van Marion ES, Van Oijen GW, van Nieuwenhoven CA, Zhou C, et al. Patients’ preferences for treatment for dupuytren’s disease: a discrete choice experiment. Plastic Reconstr Surg. 2016;137(1):165–73. https://doi.org/10.1097/prs.0000000000001878.
Marshall HS, Chen G, Clarke M, Ratcliffe J. Adolescent, parent and societal preferences and willingness to pay for meningococcal B vaccine: a discrete choice experiment. Vaccine [Internet]. Elsevier Ltd; 2016;34:671–7. http://dx.doi.org/10.1016/j.vaccine.2015.11.075.
Wang B, Chen G, Ratcliffe J, Haji H, Afzali A, Giles L, et al. Adolescent values for immunisation programs in Australia: a discrete choice experiment. 2017;28:1–14. http://dx.doi.org/10.1371/journal.pone.0181073.
Determann D, Lambooij MS, Steyerberg EW, Bekker-grob EW De, Wit GA De. Impact of survey administration mode on the results of a health-related discrete choice experiment: online and paper comparison. Value Heal [Internet]. Elsevier Inc.; 2017;20:953–60. http://dx.doi.org/10.1016/j.jval.2017.02.007.
Wright SJ, Ulph F, Dharni N. Eliciting preferences for information provision in newborn bloodspot screening programs. Value Health [Internet]. Elsevier Inc.; 2017;20:651–61. http://dx.doi.org/10.1016/j.jval.2016.11.007.
Carlin CS, Higuera L, Anderson S. Improving patient-centered care by assessing patient preferences for multiple sclerosis disease-modifying agents: a stated-choice experiment. 2017;1–7.
Eliasson L, Freitas HM De, Dearden L, Calimlim B, Lloyd AJ. Patients’ preferences for the treatment of metastatic castrate-resistant prostate cancer: a discrete choice experiment. Clin Ther [Internet]. Elsevier HS Journals, Inc.; 2017;39:723–37. http://dx.doi.org/10.1016/j.clinthera.2017.02.009.
Marshall DA, Gonzalez JM, Macdonald K V, Johnson FR. Estimating preferences for complex health technologies: lessons learned and implications for personalized medicine. Value Heal [Internet]. Elsevier Inc.; 2017;20:32–9. http://dx.doi.org/10.1016/j.jval.2016.08.737.
Cranen K, Groothuis-Oudshoorn CG, Vollenbroek-Hutten MM, IJzerman MJ. Toward patient-centered telerehabilitation design: understanding chronic pain patients’ preferences for web-based exercise telerehabilitation using a discrete choice experiment. J Med Internet Res [Internet]. JMIR Publications Inc. 2017. [cited 2018 Jun 19];19:e26. http://www.ncbi.nlm.nih.gov/pubmed/28108429.
Determann D, Lambooij MS, Gyrd-hansen D, Bekker-grob EW De, Steyerberg EW, Heldoorn M, et al. Personal health records in the Netherlands: potential user preferences quantified by a discrete choice experiment. 2017;24:529–36.
Flood EM, Bell KF, Cruz MC De, Ginchereau FM. Patient preferences for diabetes treatment attributes and drug classes. 2017;7995.
Deen WK Van, Nguyen D, Duran NE. Value redefined for inflammatory bowel disease patients: a choice-based conjoint analysis of patients’ preferences. Springer International Publishing; 2017;455–65.
Miners AH, Llewellyn CD, Cooper VL, Youssef E, Pollard AJ, Lagarde M, et al. A discrete choice experiment to assess people living with HIV’s (PLWHIV’s) preferences for GP or HIV clinic appointments. 2016;1–7.
Hauber AB, Mohamed AF, Gonzalez JM, Fairchild O, Zelt SC, Graff O, et al. Benefit-risk tradeoff preferences for chronic hand eczema treatments. 2017;6634.
Mühlbacher AC, Bridges JFP, Bethge S, Dintsios C-M, Schwalm A, Gerber-Grote A, et al. Preferences for antiviral therapy of chronic hepatitis C: a discrete choice experiment. Eur J Heal Econ [Internet]. 2017;18:155–65. https://doi.org/10.1007/s10198-016-0763-8.
Marshall T, Pugh A, Fairchild A, Hass S. Patient Preferences for device-aided treatments indicated for advanced Parkinson disease. Value Heal [Internet]. 2017;20:1383–93. https://doi.org/10.1016/j.jval.2017.06.001 (Elsevier Inc.).
Seanehia J, Treibich C, Holmberg C, Müller-Nordhorn J, Casin V, Raude J, et al. Quantifying population preferences around vaccination against severe but rare diseases: a conjoint analysis among French university students, 2016. Vaccine [Internet]. 2017 [cited 2018 Jul 12];35:2676–84. http://www.ncbi.nlm.nih.gov/pubmed/28408120.
Zipursky RB, Cunningham CE, Stewart B, Rimas H, Cole E, Vaz SM. Characterizing outcome preferences in patients with psychotic disorders: a discrete choice conjoint experiment. Schizophr Res [Internet]. 2017 [cited 2018 Jul 12];185:107–13. http://www.ncbi.nlm.nih.gov/pubmed/28038919.
Alayli-Goebbels AFG, Dellaert BGC, Knox SA, Ament AJHA, Lakerveld J, Bot SDM, et al. Consumer preferences for health and nonhealth outcomes of health promotion: results from a discrete choice experiment. Value Health. 2013;16:114–23.
Bailey H. Results from a preliminary study to develop the quality adjustments for quality adjusted life year values for Trinidad and Tobago. West Indian Med J. 2013;62:543–7.
Gu NY, Botteman MF, Gerber RA, Ji X, Postema R, Wan Y, et al. Eliciting health state utilities for Dupuytren’s contracture using a discrete choice experiment. Acta Orthop. 2013;84:571–8.
Norman R, Cronin P, Viney R. A pilot discrete choice experiment to explore preferences for EQ-5D-5L health states. Appl Health Econ Health Policy. 2013;11:287–98.
Prosser LA, Payne K, Rusinak D, Shi P, Messonnier M. Using a discrete choice experiment to elicit time trade-off and willingness-to-pay amounts for influenza health-related quality of life at different ages. Pharmacoeconomics. 2013;31:305–15.
Howard K, Salkeld GP, Patel MI, Mann GJ, Pignone MP. Men’s preferences and trade-offs for prostate cancer screening: a discrete choice experiment. Health Expect. 2015;18:3123–35.
Notten KJB, Essers BA, Weemhoff M, Rutten AGH, Donners J, Gestel I Van. Do patients prefer mesh or anterior colporrhaphy for primary correction of anterior vaginal wall prolapse: a labelled discrete choice experiment. 2015;873–80.
Wijngaard L Van Den, Rodijk ICM, Veen F Van Der, Erven MHWG, Koks CAM, Verhoeve HR, et al. Patient preference for a long-acting recombinant FSH product in ovarian hyperstimulation in IVF: a discrete choice experiment. 2015;30:331–7.
Kauf TL, Yang J, Kimball AB, Sundaram M, Okun M, Mulani P, et al. Psoriasis patients’ willingness to accept side-effect risks for improved treatment efficacy treatment efficacy. 2015;6634.
Miller FA, Hayeems RZ, Bombard Y, Cressman S, Barg C, Carroll JC, Wilson B, Little J, Allanson J, Chakraborty P, Giguere Y, Regier DA. Public perceptions of the benefits and risks of newborn screening. Pediatrics. 2015;136(2):e413–23.
Mohamed AF, González JM, Fairchild A. Patient benefit-risk tradeoffs for radioactive iodine-refractory differentiated thyroid cancer treatments. 2015;2015.
Feliciano R, Ponte C, Botella M, Lizán L. Patients’ and physicians’ preferences for type 2 diabetes mellitus treatments in Spain and Portugal: a discrete choice experiment. 2015;1443–58.
Christin J, Mu AC. Chronic pain patients’ treatment preferences: a discrete-choice experiment. 2015;613–28.
Ngorsuraches S, Nawanukool K, Petcharamanee K, Poopantrakool U. Parents’ preferences and willingness-to-pay for human papilloma virus vaccines in Thailand. J Pharm Policy Pract [Internet]. Journal of Pharmaceutical Policy and Practice; 2015. https://doi.org/10.1186/s40545-015-0040-8
Ngorsuraches S, Thongkeaw K. Patients’ preferences and willingness-to-pay for postmenopausal hormone receptor-positive, HER2-negative advanced breast cancer treatments after failure of standard treatments. Berlin: Springer International Publishing, Springerplus; 2015.
Regier DA, Peacock SJ, Pataky R, van der Hoek K, Jarvik G, Veenstra DA. Societal preferences for the return of incidental findings from clinical genomic sequencing: a discrete choice experiment. CMAJ. 2015;187(6):E190–7.
Ryan M. Gaining pounds by losing pounds: preferences for lifestyle interventions to reduce obesity. 2015;161–82.
Finkelstein E, Malhotra C, Chay J, Ozdemir S, Chopra A, Kanesvaran R. Impact of treatment subsidies and cash payouts on treatment choices at the end of life. Value Heal [Internet]. 2016;19:788–94. https://doi.org/10.1016/j.jval.2016.02.015 (Elsevier).
Shiroiwa T, Ikeda S, Noto S, Igarashi A. Comparison of value set based on DCE and/or TTO data: scoring for EQ-5D-5L health states in Japan. Value Health [Internet]. 2016;19:648–54. https://doi.org/10.1016/j.jval.2016.03.1834 (Elsevier).
Versteegh MM, Vermeulen KM, Evers SMAA, De Wit GA, Prenger R, Stolk EA. Dutch tariff for the five-level version of EQ-5D. Value Health [Internet]. 2016;19:343–52. https://doi.org/10.1016/j.jval.2016.01.003 (Elsevier).
Mulhern B, Shah K, Janssen MFB, Longworth L, Ibbotson R. Valuing health using time trade-off and discrete choice experiment methods: does dimension order impact on health state values? Value Health [Internet]. 2016;19:210–7. https://doi.org/10.1016/j.jval.2015.11.005 (Elsevier).
Wanishayakorn T, Sornlertlumvanich K, Ngorsuraches S. Benefit–risk assessment of HMG-CoA reductase inhibitors (statins): a discrete choice experiment. BMJ Open. 2016.
Cross J, Yang J, Johnson FR, Quiroz J, Dunn J, Raspa M, et al. Fragile X syndrome. 2016;37:71–9.
De Bekker-Grob EW, Rose JM, Donkers B, Essink-Bot ML, Bangma CH, Steyerberg EW. Men’s preferences for prostate cancer screening: a discrete choice experiment. Br J Cancer [Internet]. 2013;108:533–41. https://doi.org/10.1038/bjc.2013.5 (Nature Publishing Group).
Dwight Johnson M, Apesoa-Varano C, Hay J, Unutzer J, Hinton L. Depression treatment preferences of older white and Mexican origin men. Gen Hosp Psychiatry [Internet]. 2013;35:59–65. https://doi.org/10.1016/j.genhosppsych.2012.08.003 (Elsevier B.V.).
Kjær T, Bech M, Kronborg C, Mørkbak MR. Public preferences for establishing nephrology facilities in Greenland: estimating willingness-to-pay using a discrete choice experiment. Eur J Heal Econ. 2013;14:739–48.
Knox SA, Viney RC, Gu Y, Hole AR, Fiebig DG, Street DJ, et al. The effect of adverse information and positive promotion on women’s preferences for prescribed contraceptive products. Soc Sci Med [Internet]. 2013;83:70–80. https://doi.org/10.1016/j.socscimed.2012.12.025 (Elsevier Ltd).
Lynn FA, Crealey GE, Alderdice FA, Mcelnay JC. Preferences for a third-trimester ultrasound scan in a low-risk obstetric population: a discrete choice experiment. 2013;892–903.
Agyei-Baffour P, Boahemaa MY, Addy EA. Contraceptive preferences and use among auto artisanal workers in the informal sector of Kumasi, Ghana: a discrete choice experiment. Reprod Health [Internet]. 2015;12:1–11.
Arbiol J, Yabe M, Nomura H, Borja M, Gloriani N, Yoshida SI. Using discrete choice modeling to evaluate the preferences and willingness to pay for leptospirosis vaccine. Hum Vaccines Immunother. 2015;11:1046–56.
Poon J, Curtis SE, Boye KS. Evaluating preferences for profiles of GLP-1 receptor agonists among injection-naïve type 2 diabetes patients in the UK. 2015;1611–22.
Groenewoud S, Van Exel NJA, Bobinac A, Berg M, Huijsman R, Stolk EA. What influences patients’ decisions when choosing a health care provider? Measuring preferences of patients with knee arthrosis, chronic depression, or Alzheimer’s disease, using discrete choice experiments. Health Serv Res [Internet]. 2015. [cited 2018 Jun 19];50:1941–72. http://www.ncbi.nlm.nih.gov/pubmed/26768957.
Hauber AB, Tunceli K, Gantz I, Brodovicz KG, Alexander CM, Davies MJ, et al. A survey of patient preferences for oral antihyperglycemic therapy in patients with type 2 diabetes mellitus. 2015;75–84.
Hechmati G, Hauber AB, Arellano J, Mohamed AF, Qian Y. Patients’ preferences for bone metastases treatments in France, Germany and the United Kingdom. 2015;21–8.
Kistler CE, Hess TM, Howard K, Pignone MP, Crutchfield TM, Hawley ST, et al. Older adults’ preferences for colorectal cancer-screening test attributes and test choice. 2015;1005–16.
Kromer C, Schaarschmidt M, Schmieder A, Herr R. Patient preferences for treatment of psoriasis with biologicals: a discrete choice experiment. 2015;1–15.
Krucien N, Gafni A, Pelletier-fleury N. Empirical testing of the external validity of a discrete choice experiment to determine preferred treatment option: the case of sleep apnea. 2015;965:951–65.
Lambooij MS, Harmsen IA, Veldwijk J, Melker H De, Mollema L, Weert YWM Van, et al. Consistency between stated and revealed preferences: a discrete choice experiment and a behavioural experiment on vaccination behaviour compared. 2015;1–8.
Levitan B, Markowitz M, Mohamed AF, Johnson FR, Alphs L, Citrome L, et al. Patients’ preferences related to benefits, risks, and formulations of schizophrenia treatment. Psychiatr Serv [Internet]. 2015. [cited 2018 Jun 19];66:719–26. http://www.ncbi.nlm.nih.gov/pubmed/25772762.
Malhotra C, Farooqui MA, Kanesvaran R, Bilger M, Finkelstein E. Comparison of preferences for end-of-life care among patients with advanced cancer and their caregivers: a discrete choice experiment. 2015.
Johnson FR, Farah A, Reed MF, Balp M. Preferences and stated adherence for antibiotic treatment of cystic fibrosis pseudomonas infections. 2015.
Mühlbacher AC, Bethge S. Reduce mortality risk above all else: a discrete-choice experiment in acute coronary syndrome patients. Pharmacoeconomics. 2014;33:71–81.
Mühlbacher AC, Bethge S. Patients’ preferences: a discrete-choice experiment for treatment of non-small-cell lung cancer. Eur J Heal Econ [Internet]. 2015;16:657–70. https://doi.org/10.1007/s10198-014-0622-4.
Nafees B, Lloyd A, Elkin E, Porret T, Nafees B, Lloyd A, et al. To explore preferences and willingness to pay for attributes regarding stoma appliances amongst patients in the UK, France and Germany. 2015;7995.
Pacou M, Basso F, Gore C, Hass B, Taieb V, Cognet M, et al. Patient and physician preferences for the treatment of chronic hepatitis C virus infections: does the perspective matter? 2015;1063–8.
Pinder B, Lloyd AJ, Marley J. Patient preferences and willingness to pay for innovations in intermittent self-catheters. 2015;381–8.
Pisa G, Eichmann F, Hupfer S. Assessing patient preferences in heart failure using conjoint methodology. Patient Preference and Adherence. 2015;1233–41.
Salampessy BH, Veldwijk J, Schuit AJ, Wit GA De, Lambooij MS. The predictive value of discrete choice experiments in public health: an exploratory application. Patient Patient-Cent Outcomes Res [Internet]. Springer International Publishing; 2015;521–9. Doi: 10.1007/s40271-015-0115-2
Salloum RG, Rn CWA, Kohler RE, Ba AKK, Oh L, Rn KAW. Assessing preferences for a university-based smoking cessation program in Lebanon: a discrete choice experiment. 2015;580–5.
Schaarschmidt M, Kromer C, Herr R, Schmieder A. Patient preferences for biologicals in psoriasis: top priority of safety for cardiovascular patients. 2015;1–14.
Veldwijk J, Lambooij MS, Til JA Van, Smit A, Td GA, Td IF De, et al. Patient education and counseling words or graphics to present a discrete choice experiment: does it matter? 2015;98:1376–84.
Uemura H, Matsubara N, Kimura G, Yamaguchi A, Ledesma DA, Dibonaventura M, et al. Patient preferences for treatment of castration-resistant prostate cancer in Japan: a discrete-choice experiment. BMC Urol [Internet]. BMC Urology; 2016;2–4. http://dx.doi.org/10.1186/s12894-016-0182-2.
Mühlbacher A, Bethge S. What matters in type 2 diabetes mellitus oral treatment? A discrete choice experiment to evaluate patient preferences. Eur J Heal Econ [Internet]. 2016;17:1125–40. https://doi.org/10.1007/s10198-015-0750-5.
Lee J, Kim K, Shin Y, Young H, Ji E, Kim S, et al. Gynecologic oncology treatment preferences of advanced ovarian cancer patients for adding bevacizumab to first-line therapy. Gynecol Oncol [Internet]. 2016;143:622–7. https://doi.org/10.1016/j.ygyno.2016.10.021 (Elsevier B.V.).
Brown ZS, Kramer RA, Ocan D, Oryema C. Household perceptions and subjective valuations of indoor residual spraying programmes to control malaria in northern Uganda. Infect Dis Poverty [Internet]. 2016;2016:1–13. https://doi.org/10.1186/s40249-016-0190-1.
Mühlbacher A, Bethge S. First and foremost battle the virus: eliciting patient preferences in antiviral therapy for hepatitis C using a discrete choice experiment. Value Health [Internet]. 2016;19:776–87. https://doi.org/10.1016/j.jval.2016.04.007 (Elsevier).
Franco MR. Smallest worthwhile effect of exercise programs to prevent falls among older people: estimates from benefit–harm trade-off and discrete choice methods. 2018;806–12.
Hazlewood GS, Bombardier C, Tomlinson G, Thorne C, Bykerk VP, Thompson A, et al. Treatment preferences of patients with early rheumatoid arthritis: a discrete-choice experiment. 2018;1959–68.
Shafrin J, Bruno A, Macewan JP, Campinha-bacote A, Trocio J, Shah M, et al. Physician and patient preferences for nonvalvular atrial fibrillation therapies. Value Health [Internet]. 2016;19:451–9. https://doi.org/10.1016/j.jval.2016.01.001 (Elsevier).
Van Dijk JD, Groothuis-oudshoorn CGM, Marshall DA, Ijzerman MJ. An empirical comparison of discrete choice experiment and best-worst scaling to estimate stakeholders’ risk tolerance for hip replacement surgery. Value Health [Internet]. 2016;19:316–22. https://doi.org/10.1016/j.jval.2015.12.020 (Elsevier).
Ride J, Lancsar E. Women’s preferences for treatment of perinatal depression and anxiety: a discrete choice experiment. 2016;1–23.
Morel T, Aymé S, Cassiman D, Simoens S, Morgan M, Vandebroek M (2016) Quantifying benefit-risk preferences for new medicines in rare disease patients and caregivers. Orphanet J Rare Dis [Internet]. https://doi.org/10.1186/s13023-016-0444-9
Holmes EAF, Morrison VL, Hughes DA. What influences persistence with medicines? A multinational discrete choice experiment of 2549 patients. PharmacoEconomics, 2016;522–31.
Craig BM, Mitchell SA, Ct ABSTRA. Examining the value of menopausal symptom relief among US women. Value Health [Internet]. 2016;19:158–66. https://doi.org/10.1016/j.jval.2015.11.002 (Elsevier).
Niroomand N, Jenkins GP. Estimating the value of life, injury, and travel time saved using a stated preference framework. Accid Anal Prev [Internet]. 2016;91:216–25. https://doi.org/10.1016/j.aap.2016.03.004 (Elsevier Ltd).
O’Hara NN, Slobogean GP, Mohammadi T. Are patients willing to pay for total shoulder arthroplasty? Evidence from a discrete choice experiment. Can J Surg. 2016;59(2):107–12. https://doi.org/10.1503/cjs.011915.
Qian Y, Arellano J, Hauber AB, Mohamed AF, Marcos J, Guy G, et al. Patient, caregiver, and nurse preferences for treatments for bone metastases from solid tumors. Patient Patient-Center Outcomes Res. 2016;9:323–33 (Springer International Publishing).
Kerr C, Lloyd EJ, Kosmas CE, Smith HT, Cooper JA, Johnston K, et al. Health-related quality of life in Parkinson’s: impact of ‘off’ time and stated treatment preferences. Qual Life Res. 2016;25:1505–15 (Springer International Publishing).
Poulos C, Kinter E, John JY, Posner J, Reder AT. Patient preferences for injectable treatments for multiple sclerosis in the United States: a discrete-choice experiment. Patient Patient-Center Outcomes Res. 2016;9:171–80 (Springer International Publishing).
Arx L Von, Johnson FR, Mørkbak MR, Kjær T. Be careful what you ask for: effects of benefit descriptions on diabetes patients’ benefit-risk tradeoff preferences. 2017;20:670–8.
Viney R, Norman R, Brazier J, Cronin P, King MT, Ratcliffe J, et al. An Australian discrete choice experiment to value EQ-5D health states. Health Econ [Internet]. 2014. [cited 2018 Jun 19];23:729–42. http://www.ncbi.nlm.nih.gov/pubmed/23765787.
Eckert J, Lichters M, Piedmont S, Vogt B, Robra BP. Case vignettes based on EQ-5D to elicit stated preferences for health services utilization from the insurees’ perspective. BMC Health Serv Res [Internet]. 2015;15:1–11. https://doi.org/10.1186/s12913-015-1143-2.
Craig BM, Brown DS, Reeve BB. The value adults place on child health and functional status. Value Health [Internet]. NIH Public Access; 2015. [cited 2018 Jun 19];18:449–56. http://www.ncbi.nlm.nih.gov/pubmed/26091599.
Haagsma JA, Noordhout CM De, Polinder S, Vos T, Havelaar AH, Cassini A, et al. Assessing disability weights based on the responses of 30,660 people from four European countries. 2015;1–15.
Robinson A, Spencer A, Moffatt P. A Framework for estimating health state utility values within a discrete choice experiment: modeling risky choices. 2015;341–50.
Rosato R, Testa S, Oggero A, Molinengo G, Bertolotto A. Quality of life and patient preferences: identification of subgroups of multiple sclerosis patients. Qual Life Res [Internet]. Springer International Publishing; 2015;2173–82. http://dx.doi.org/10.1007/s11136-015-0952-4.
Rowen D, Brazier J, Hout B Van. A comparison of methods for converting DCE values onto the full health-dead QALY scale. 2015;328–40.
Scalone L, Stalmeier PFM, Milani S, Krabbe PFM. Values for health states with different life durations. Eur J Heal Econ [Internet]. Springer Berlin Heidelberg; 2015;917–25. http://dx.doi.org/10.1007/s10198-014-0634-0.
Craig BM, Brown DS, Reeve BB. Valuation of child behavioral problems from the perspective of US adults. Med Decis Making. 2017;36:199–209.
Norman R, Kemmler G, Viney R, Pickard AS, Gamper E, Holzner B, et al. Order of presentation of dimensions does not systematically bias utility weights from a discrete choice experiment. Value Heal [Internet]. 2016;19:1033–8. https://doi.org/10.1016/j.jval.2016.07.003 (Elsevier).
Ock M, Lee JY, Oh I, Park H, Yoon S, Jo M. Disability weights measurement for 228 causes of disease in the Korean Burden of Disease Study 2012. 2016;3:129–38.
Rowen D, Brazier J, Mukuria C, Keetharuth A, Hole AR, Tsuchiya A, et al. Eliciting societal preferences for weighting QALYs for burden of illness and end of life. 2016;210–22.
Mulhern B, Norman R, Lorgelly P, Lancsar E, Ratcliffe J, Brazier J, et al. Is dimension order important when valuing health states using discrete choice experiments including duration? Pharmacoeconomics. 2017;35:439–51 (Springer International Publishing).
Ageyi-Baffour P, Rominski S, Nakua E, Gyakobo M, Lori JR. Factors that influence midwifery students in Ghana when deciding where to practice: a discrete choice experiment. BMC Med Educ. 2013;13:2–7.
Keuffel E, Jaskiewicz W, Paphassarang C, Tulenko K. Net costs of health worker rural incentive packages: an example from the Lao People’s Democratic Republic. Med Care. 2013;51:985–91.
Lagarde M, Pagaiya N, Tangcharoensathian V, Blaauw D. One size does not fit all: investigating doctors’ stated preference heterogeneity for job incentives to inform policy in Thailand. Health Econ [Internet]. 2013. [cited 2018 Jun 19];22:1452–69. http://www.ncbi.nlm.nih.gov/pubmed/23349119.
Rao KD, Ryan M, Shroff Z, Vujicic M, Ramani S, Berman P. Rural clinician scarcity and job preferences of doctors and nurses in India: a discrete choice experiment. PLoS One. 2013;8.
Scott A, Witt J, Humphreys J, Joyce C, Kalb G, Jeon SH, et al. Getting doctors into the bush: general practitioners’ preferences for rural location. Soc Sci Med [Internet]. Elsevier Ltd; 2013;96:33–44. http://dx.doi.org/10.1016/j.socscimed.2013.07.002.
Pedersen LB, Gyrd-Hansen D. Preference for practice: a Danish study on young doctors’ choice of general practice using a discrete choice experiment. Eur J Heal Econ. 2014;15:611–21.
Holte J, Helgheim J, Kjaer T, Abelsen B, Abel J. The impact of pecuniary and non-pecuniary incentives for attracting young doctors to rural general practice. Soc Sci Med [Internet]. Elsevier Ltd; 2015;128:1–9. http://dx.doi.org/10.1016/j.socscimed.2014.12.022.
Honda A, Vio F. Incentives for non-physician health professionals to work in the rural and remote areas of Mozambique—a discrete choice experiment for eliciting job preferences. Hum Resour Health. 2015;13:23.
Robyn PJ, Shroff Z, Zang OR, Kingue S, Djienouassi S, Kouontchou C, et al. Addressing health workforce distribution concerns: a discrete choice experiment to develop rural retention strategies in Cameroon. Int J Health Policy Manag. 2015;4:169–80. https://doi.org/10.15171/ijhpm.2015.27.
Scott A, Witt J, Duffield C. What do nurses and midwives value about their jobs? Results from a discrete choice experiment. 2015;20:31–8.
Song K, Scott A, Sivey P, Meng Q. Improving Chinese primary care providers’ recruitment and retention: a discrete choice experiment. 2018;68–77.
Gallego G, Dew A, Lincoln M, Bundy A, Chedid RJ, Bulkeley K, et al. Should I stay or should I go? Exploring the job preferences of allied health professionals working with people with disability in rural Australia. Human Resources for Health; 2015;1–13.
Smitz M, Witter S, Lemiere C, Hoang- P, Eozenou V, Lievens T, et al. Understanding health workers’ job preferences to improve rural retention in Timor-Leste: findings from a discrete choice experiment. 2016;1–14.
Shiratori S, Agyekum EO, Shibanuma A, Oduro A, Okawa S, Enuameh Y, et al. Motivation and incentive preferences of community health officers in Ghana: an economic behavioral experiment approach. Hum Resour Health [Internet]. 2016. https://doi.org/10.1186/s12960-016-0148-1.
Efendi F, Chen C, Nursalam N, Wachyu N, Andriyani F, Kurniati A, et al. How to attract health students to remote areas in Indonesia: a discrete choice experiment. 2016;430–45.
Cleland J, Johnston P, Watson V, Krucien N, Ska D. What do UK doctors in training value in a post? A discrete choice experiment. 2016;189–202.
Takemura T, Kielmann K, Blaauw D. Job preferences among clinical officers in public sector facilities in rural Kenya: a discrete choice experiment. Hum Resour Health [Internet]; 2016;1–10. https://doi.org/10.1186/s12960-015-0097-0.
Linley WG, Hughes DA. Decision-makers’ preferences for approving new medicines in Wales: a discrete-choice experiment with assessment of external validity. Pharmacoeconomics. 2013;31:345–55.
Norman R, Hall J, Street D, Viney R. Efficiency and equity: a stated preference approach. Health Econ [Internet]. Wiley-Blackwell; 2013. [cited 2018 Jun 19];22:568–81. http://doi.wiley.com/10.1002/hec.2827.
Sadique MZ, Devlin N, Edmunds WJ, Parkin D. The effect of perceived risks on the demand for vaccination: results from a discrete choice experiment. PLoS One. 2013;8.
Terris-Prestholt F, Hanson K, MacPhail C, Vickerman P, Rees H, Watts C. How much demand for new HIV prevention technologies can we really expect? Results from a discrete choice experiment in South Africa. PLoS One. 2013;8.
Skedgel C, Wailoo A, Akehurst R. Societal preferences for distributive justice in the allocation of health care resources: a latent class discrete choice experiment. 2015;94–105.
Mentzakis E, Paolucci F, Rubicko G. Priority setting in the Austrian healthcare system: results from a discrete choice experiment and implications for mental health. J Ment Health Policy Econ [Internet]. 2014. [cited 2018 Jun 19];17:61–73. http://www.ncbi.nlm.nih.gov/pubmed/25153094.
Michaels-Igbokwe C, Terris-Prestholt F, Lagarde M, Chipeta E, Cairns J, Mayhew S, et al. Young people’s preferences for family planning service providers in rural Malawi: a discrete choice experiment. PLoS One [Internet]. 2015;10:1–18. https://doi.org/10.1371/journal.pone.0143287.
Bosworth R, Cameron TA, DeShazo JR. Willingness to pay for public health policies to treat illnesses. J Health Econ [Internet]. 2015;39:74–88. https://doi.org/10.1016/j.jhealeco.2014.10.004 (Elsevier B.V.).
Harrison M, Marra C, Shojania K, Bansback N. Societal preferences for rheumatoid arthritis treatments: evidence from a discrete choice experiment. 2018;1816–25.
Honda A, Ryan M, Niekerk R Van, Mcintyre D. Improving the public health sector in South Africa: eliciting public preferences using a discrete choice experiment. 2018;600–11.
Luyten J, Kessels R, Goos P, Beutels P. Public Preferences for prioritizing preventive and curative health care interventions: a discrete choice experiment. Value Health [Internet]. 2015;18:224–33. https://doi.org/10.1016/j.jval.2014.12.007 (Elsevier).
Paolucci F, Mentzakis E, Defechereux T, Niessen W. Equity and efficiency preferences of health policy makers in China—a stated preference analysis. Health Policy Plan. 2015;30(8):1059–66. https://doi.org/10.1093/heapol/czu123.
Severin F, Hess W, Schmidtke J, Mühlbacher A, Rogowski W. Value judgments for priority setting criteria in genetic testing: a discrete choice experiment. Health Policy (New York) [Internet]. 2015;119:164–73. https://doi.org/10.1016/j.healthpol.2014.04.013 (Elsevier Ireland Ltd).
Shah KK, Tsuchiya A, Wailoo AJ. Valuing health at the end of life: a stated preference discrete choice experiment. Soc Sci Med [Internet]. 2015;124:48–56. https://doi.org/10.1016/j.socscimed.2014.11.022 (Elsevier Ltd).
Skedgel C, Wailoo AJ, Akehurst RL. Societal preferences for distributive justice in the allocation of health care resources: a latent class discrete choice experiment. Med Decision Mak. 2015;35(1):94–105.
Wetering L, Exel J, Bobinac A, Brouwer WBF. Valuing QALYs in relation to equity considerations using a discrete choice experiment. Pharmacoeconomics. 2015;33:1289–300 (Springer International Publishing).
Whitty JA, Ratcliffe J, Kendall E, Burton P, Wilson A, Littlejohns P, et al. Prioritising patients for bariatric surgery: building public preferences from a discrete choice experiment into public policy. BMJ Open. 2015;5:e008919. https://doi.org/10.1136/bmjopen-2015-008919.
Determann D, Korfage IJ, Fagerlin A, Steyerberg EW, Bliemer MC, Voeten HA, et al. Public preferences for vaccination programmes during pandemics caused by pathogens transmitted through respiratory droplets—a discrete choice experiment in four European countries. 2013. 2016;1–13.
Shiroiwa T, Saito S, Shimozuma K, Kodama S. Societal preferences for interventions with the same efficiency: assessment and application to decision-making. Appl Health Econ Health Policy. 2016;14:375–85 (Springer International Publishing).
Herman PM, Ingram M, Cunningham CE, Rimas H, Murrieta L, Schachter K, et al. A comparison of methods for capturing patient preferences for delivery of mental health services to low-income Hispanics engaged in primary care. Patient Patient-Center Outcomes Res. 2016;9:293–301 (Springer International Publishing).
Howard K, Jan S, Rose JM, Wong G, Craig JC, Irving M, et al. Preferences for policy options for deceased organ donation for transplantation: a discrete choice experiment. 2016;100.
Becker MPE, Sc BA, Sc M, Christensen BK, Ph D, Cunningham CE, et al. Preferences for early intervention mental health services: a discrete-choice conjoint experiment. 2016.
Ng V, Sargeant JM. Prioritizing zoonotic diseases: differences in perspectives between human and animal health professionals in North America. PloS One. 2016;196–211.
Mühlbacher AC, Bethge S, Reed SD, Schulman KA. Patient preferences for features of health care delivery systems: a discrete choice experiment. Health Serv Res [Internet]. 2016 [cited 2018 Jun 19];51:704–27. http://www.ncbi.nlm.nih.gov/pubmed/26255998.
Lock J, Urhan G, Peters M, Meijer K, Brons P. Facilitating the implementation of pharmacokinetic-guided dosing of prophylaxis in haemophilia care by discrete choice experiment. 2016;1–10.
Ozdemir S, Wong TT, Allingham RR, Finkelstein EA. Predicted patient demand for a new delivery system for glaucoma medicine. Medicine (Baltimore) [Internet]. 2017. [cited 2018 Jun 19];96:e6626. http://www.ncbi.nlm.nih.gov/pubmed/28403115.
Van De Wetering EJ, Van Exel J, Brouwer WBF. The challenge of conditional reimbursement: stopping reimbursement can be more difficult than not starting in the first place! Value Heal [Internet]. 2017;20:118–25. https://doi.org/10.1016/j.jval.2016.09.001 (Elsevier Inc.).
Rudarakanchana N, Reeves BC, Bicknell CD, Heatley FM, Cheshire NJ, Powell JT. Editor’s choice—treatment decisions for descending thoracic aneurysm: preferences for thoracic endovascular aneurysm repair or surveillance in a discrete choice experiment. Eur J Vasc Endovasc Surg [Internet]. 2014;48:13–22. https://doi.org/10.1016/j.ejvs.2014.03.015 (Elsevier Ltd).
Bailey K, Cunningham C, Pemberton J, Rimas H, Morrison KM. Understanding academic clinicians’ decision-making for the treatment of childhood obesity. Child Obes [Internet]. 2015;11:696–706. http://online.liebertpub.com/doi/10.1089/chi.2015.0031.
Arellano J, González JM, Qian Y, Habib M, Mohamed AF, Gatta F, et al. Physician preferences for bone metastasis drug therapy in Canada. Curr Oncol. 2015;22:e342–8.
Arellano J, Hauber AB, Mohamed AF, Gonzalez JM, Collins H, Hechmati G, et al. Physicians’ preferences for bone metastases drug therapy in the United States. Value Health [Internet]. 2015;18:78–83. https://doi.org/10.1016/j.jval.2014.10.004 (Elsevier).
Oliveira TC, Barlow J, Bayer S. The association between general practitioner participation in joint teleconsultations and rates of referral: a discrete choice experiment. 2015;1–8.
Lloyd AJ, Ziani E, Nicolas L, Fordham BA, Soubeyrand B, Bornhöft C. What are the preferences of health care professionals in Germany regarding fully liquid, ready-to-use hexavalent pediatric vaccine versus hexavalent pediatric vaccine that needs reconstitution? 2015;1517–24.
Offerhaus PM, Researcher M, Otten W, Psychologist S, Boxem-tiemessen JCG, Teacher S, et al. Variation in intrapartum referral rates in primary midwifery care in the Netherlands: a discrete choice experiment. Midwifery [Internet]. Elsevier; 2015;31:e69–e78. https://doi.org/10.1016/j.midw.2015.01.005.
Poulos C, Johnson FR, Krishnarajah G, Anonychuk A, Misurski D. Pediatricians’ preferences for infant meningococcal vaccination. Value Heal [Internet]. 2015;18:67–77. https://doi.org/10.1016/j.jval.2014.10.010 (Elsevier).
Malhotra C, Chan N, Zhou J, Dalager HB, Finkelstein E. Variation in physician recommendations, knowledge and perceived roles regarding provision of end-of-life care. BMC Palliat Care [Internet]. 2015. https://doi.org/10.1186/s12904-015-0050-y.
Baji P, Gulácsi L, Lovász BD, Golovics PA, Brodszky V, Péntek M, et al. Treatment preferences of originator versus biosimilar drugs in Crohns disease; discrete choice experiment among gastroenterologists. Scand J Gastroenterol [Internet]. 2016;51:22–7. https://doi.org/10.3109/00365521.2015.1054422.
Blumenschein P, Lilley M, Bakal JA, Christian S. Evaluating stakeholder’s perspective on referred out genetic testing in Canada: a discrete choice experiment. Clin Genet. 2016;89:133–8.
Fransen J, Kievit W, Neogi T, Schumacher R, Jansen TIM, Dalbeth N, et al. What should be the cut point for classification criteria of studies in gout? Conjoint Anal. 2016;68:1731–5.
Baji P, Garcı M, Paolucci F. Comparative analysis of decision maker preferences for equity/efficiency attributes in reimbursement decisions in three European countries. 2016;791–9.
Baji P, Gulácsi L, Lovász BD, Golovics PA, Péntek M, Rencz F, et al. Treatment preferences of originator versus biosimilar drugs in Crohn’s disease. Scand J Gastroenterol [Internet]. Informa Healthcare; 2015;5521:0.
Morgan JL, Walters SJ, Collins K, Robinson TG, Cheung K, Audisio R, et al. What influences healthcare professionals’ treatment preferences for older women with operable breast cancer? An application of the discrete choice experiment. Eur J Surg Oncol [Internet]. 2017;43:1282–7. https://doi.org/10.1016/j.ejso.2017.01.012 (Elsevier Ltd).
Lee H, Bae E. Eliciting preferences for medical devices in South Korea: a discrete choice experiment. Health Policy (New York) [Internet]. Elsevier Ireland Ltd; 2017;121:243–9. https://doi.org/10.1016/j.healthpol.2017.01.002.
Bøgelund M, Hagelund L, Asmussen MB. COPD-treating nurses’ preferences for inhaler attributes—a discrete choice experiment. 2017;7995.
Hifinger M, Hiligsmann M, Ramiro S, et al. Economic considerations and patients’ preferences affect treatment selection for patients with rheumatoid arthritis: a discrete choice experiment among European rheumatologists. Ann Rheum Dis. 2017;76:126–32.
Munger MA, Walsh M, Godin J, Feehan M. Pharmacist’s demand for optimal primary care service delivery in a community pharmacy: the OPTiPharm study. 2017. https://doi.org/10.1177/1060028017722795.
Boeri M, Longo A, Grisolía JM, Hutchinson WG, Kee F. The role of regret minimisation in lifestyle choices affecting the risk of coronary heart disease. J Health Econ [Internet]. 2013;32:253–60. https://doi.org/10.1016/j.jhealeco.2012.10.007 (Elsevier B.V.).
Franken M, Koolman X. Health system goals: a discrete choice experiment to obtain societal valuations. Health Policy (New York) [Internet]. 2013;112:28–34. https://doi.org/10.1016/j.healthpol.2012.12.013 (Elsevier Ireland Ltd).
Hurley J, Mentzakis E. Health-related externalities: evidence from a choice experiment. J Health Econ [Internet]. 2013;32:671–81. https://doi.org/10.1016/j.jhealeco.2013.03.005 (Elsevier Ireland Ltd).
Laver K, Ratcliffe J, George S, Lester L, Crotty M. Preferences for rehabilitation service delivery: a comparison of the views of patients, occupational therapists and other rehabilitation clinicians using a discrete choice experiment. Aust Occup Ther J. 2013;60:93–100.
Ng V, Sargeant JM. A quantitative approach to the prioritization of zoonotic diseases in North America: a health professionals’ perspective. PLoS One. 2013;8.
Rischatsch M, Zweifel P. What do physicians dislike about managed care? Evidence from a choice experiment. Eur J Heal Econ. 2013;14:601–13.
Burnett HF, Ungar WJ, Regier DA, Feldman BM, Miller FA. Parents’ willingness to pay for biologic treatments in juvenile idiopathic arthritis. Value Health [Internet]. 2014;17:830–7. https://doi.org/10.1016/j.jval.2014.08.2668 (Elsevier).
Burton CR, Fargher E, Plumpton C, Roberts GW, Owen H, Roberts E. Investigating preferences for support with life after stroke: a discrete choice experiment. BMC Health Serv Res [Internet]. 2014;14:63. http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L601480208%5Cn, https://doi.org/10.1186/1472-6963-14-63.
Chu LW, So JC, Wong LC, Luk JK, Chiu PK, Chan CS, et al. Community end-of-life care among Chinese older adults living in nursing homes. Geriatr Gerontol Int. 2014;14:273–84.
Cunningham CE, Walker JR, Eastwood JD, Westra H, Rimas H, Chen Y, et al. Modeling mental health information preferences during the early adult years: a discrete choice conjoint experiment. J Health Commun. 2014;19:413–40.
Deal K, Keshavjee K, Troyan S, Kyba R, Holbrook AM. Physician and patient willingness to pay for electronic cardiovascular disease management. Int J Med Inform [Internet]. 2014;83:517–28. https://doi.org/10.1016/j.ijmedinf.2014.04.007 (Elsevier Ireland Ltd).
Determann D, Korfage IJ, Lambooij MS, Bliemer M, Richardus JH, Steyerberg EW, et al. Acceptance of vaccinations in pandemic outbreaks: a discrete choice experiment. PLoS One. 2014;9.
Groothuis-Oudshoorn CG, Fermont JM, Van Til JA, Ijzerman MJ. Public stated preferences and predicted uptake for genome-based colorectal cancer screening. BMC Med Inform Decis Mak. 2014;14.
Hoefman RJ, Van Exel J, Rose JM, Van De Wetering EJ, Brouwer WBF. A discrete choice experiment to obtain a tariff for valuing informal care situations measured with the CarerQol instrument. Med Decis Mak [Internet]. 2014;34:84–96. https://doi.org/10.1177/0272989X13492013.
Huppelschoten AG, Verkerk EW, Appleby J, Groenewoud H, Adang EMM, Nelen WLDM, et al. The monetary value of patient-centred care: results from a discrete choice experiment in Dutch fertility care. Hum Reprod. 2014;29:1712–20.
Pechey R, Burge P, Mentzakis E, Suhrcke M, Marteau TM. Public acceptability of population-level interventions to reduce alcohol consumption: a discrete choice experiment. Soc Sci Med [Internet]. 2014;113:104–9. https://doi.org/10.1016/j.socscimed.2014.05.010 (Elsevier Ltd).
Plumb AA, Boone D, Fitzke H, Helbren E, Mallett S, von Wagner C, et al. Detection of extracolonic pathologic findings with CT colonography: a discrete choice experiment of perceived benefits. Eur Radiol. 2014;273:144–52.
Shono A, Kondo M. Parents’ preferences for seasonal influenza vaccine for their children in Japan. Vaccine [Internet]. 2014;32:5071–6. https://doi.org/10.1016/j.vaccine.2014.07.002 (Elsevier Ltd).
Struik MHL, Koster K, Veldwijk J, Schuit AJ, Lambooij MS. Preference structure of clinicians in the use of electronic medical records; quantifying the relative importance of barriers and facilitators of an innovation. Value Health [Internet]. 2013;16:A471. http://www.sciencedirect.com/science/article/pii/S1098301513027629.
Veldwijk J, Lambooij MS, Bruijning-Verhagen PCJ, Smit HA, de Wit GA. Parental preferences for rotavirus vaccination in young children: a discrete choice experiment. Vaccine [Internet]. 2014;32:6277–83. https://doi.org/10.1016/j.vaccine.2014.09.004 (Elsevier Ltd).
De Bekker-Grob EW, Bergstra AD, Bliemer MCJ, Trijssenaar-Buhre IJM, Burdorf A. Protective behaviour of citizens to transport accidents involving hazardous materials: a discrete choice experiment applied to populated areas nearby waterways. PLoS One [Internet]. 2015;10:1–14. https://doi.org/10.1371/journal.pone.0142507.
Ho MP, Gonzalez JM, Lerner HP, Neuland CY, Whang JM, McMurry-Heath M, et al. Incorporating patient-preference evidence into regulatory decision-making. Surg Endosc Other Interv Tech [Internet]. 2015;29:2984–93. https://doi.org/10.1007/s00464-014-4044-2 (Springer US).
Chen TT, Tung TH, Hsueh YS, Tsai MH, Liang HM, Li KL, et al. Measuring preferences for a diabetes pay-for-performance for patient (P4P4P) program using a discrete choice experiment. Value Health [Internet]. 2015;18:578–86. https://doi.org/10.1016/j.jval.2015.03.1793 (Elsevier).
Kessels R, Herck P Van, Dancet E, Annemans L, Sermeus W. How to reform Western care payment systems according to physicians, policy makers, healthcare executives and researchers: a discrete choice experiment. BMC Health Serv Res [Internet]. 2015;1–14. https://doi.org/10.1186/s12913-015-0847-7.
Kjaer NK, Halling A, Pedersen LB. General practitioners’ preferences for future continuous professional development: evidence from a Danish discrete choice experiment. Educ Prim Care 2015;9879.
Lagarde M, Erens B, Mays N. Determinants of the choice of GP practice registration in England: evidence from a discrete choice experiment. Health Policy (New York) [Internet]. 2015;119:427–36. https://doi.org/10.1016/j.healthpol.2014.10.008 (Elsevier Ireland Ltd).
Morgan H, Hoddinott P, Thomson G, Crossland N, Farrar S, Yi D, et al. Benefits of incentives for breastfeeding and smoking cessation in pregnancy (BIBS): a mixed-methods study. 2015;19.
Powell G, Holmes EAF, Plumpton CO, Ring A, Baker GA, Jacoby A, et al. Pharmacogenetic testing prior to carbamazepine treatment of epilepsy: patients’ and physicians’ preferences for testing and service delivery. 2015.
Rischatsch M. Who joins the network? Physicians’ resistance to take budgetary co-responsibility. J Health Econ [Internet]. 2015;40:109–21. https://doi.org/10.1016/j.jhealeco.2014.12.002 (Elsevier B.V.).
Landfeldt E, Eriksson J, Ireland S, Musingarimi P, Jackson C, Tweats E, et al. Patient, physician, and general population preferences for treatment characteristics in relapsed or refractory chronic lymphocytic leukemia: a conjoint analysis. Elsevier Ltd. 2016;40:17–23.
Makkar SR, Turner T, Williamson A, Louviere J, Redman S, Haynes A, et al. The development of ORACLe: a measure of an organisation’s capacity to engage in evidence-informed health policy. Health Res Policy Syst [Internet]. 2016. https://doi.org/10.1186/s12961-015-0069-9.
Obse A, Ryan M, Heidenreich S, Normand C, Hailemariam D. Eliciting preferences for social health insurance in Ethiopia: a discrete choice experiment. 2018;1423–32.
Goto R, Kakihara H. A discrete choice experiment studying students’ preferences for scholarships to private medical schools in Japan. Hum Resour Health [Internet]. 2016. https://doi.org/10.1186/s12960-016-0102-2.
Mühlbacher A, Johnson FR, Yang J, Happich M, Belger M. Do you want to hear the bad news? The value of diagnostic tests for Alzheimer’s disease. Value Health [Internet]. 2016;19:66–74. https://doi.org/10.1016/j.jval.2015.10.011 (Elsevier).
Pesko MF, Kenkel DS, Wang H, Hughes JM. The effect of potential electronic nicotine delivery system regulations on nicotine product selection. Addiction [Internet]. 2016. [cited 2018 Jun 19];111:734–44. http://www.ncbi.nlm.nih.gov/pubmed/26639526.
Flynn TN, Bilger M, Malhotra C, Finkelstein EA, Flynn TN. Are efficient designs used in discrete choice experiments too difficult for some respondents? A case study eliciting preferences for end-of-life care. Pharmacoeconomics. 2016;34:273–84 (Springer International Publishing).
Wymbs FA, Cunningham CE, Chen Y, Rimas HM, Deal K, Waschbusch DA, et al. Examining parents’ preferences for group and individual parent training for children with ADHD symptoms. 2015;45.
Wetering EJ, Exel NJA, Rose JM, Hoefman RJ, Brouwer WBF. Are some QALYs more equal than others? Eur J Heal Econ [Internet]. Springer Berlin Heidelberg; 2016;117–27. https://doi.org/10.1007/s10198-014-0657-6.
Kaambwa B, Ratcliffe J, Shulver W, Killington M, Taylor A, Crotty M, et al. Investigating the preferences of older people for telehealth as a new model of health care service delivery: a discrete choice experiment. 2016;0:1–13.
Shono A, Kondo M. Mothers’ preferences regarding new combination vaccines for their children in Japan, 2014. Hum Vaccin Immunother [Internet]. Taylor & Francis; 2017;13:766–71. https://doi.org/10.1080/21645515.2016.1255387.
Lloyd AJ, Gallop K, Ali S, Hughes D, Lloyd AJ, Gallop K, et al. Social preference weights for treatments in Fabry disease in the UK: a discrete choice experiment. 2017;7995.
Gonzalez JM, Johnson FR, Mcateer H, Posner J, Mughal F. Comparing preferences for outcomes of psoriasis treatments among patients and dermatologists in the U.K.: results from a discrete-choice experiment. 2017;777–85.
Schoot T Van De, Pavlova M, Atanasova E, Groot W. Preferences of Bulgarian consumers for quality, access and price attributes of healthcare services—result of a discrete choice experiment. Int J Health Plann Manage. 2017;47–71.
Naunheim MR, Rathi VK, Naunheim ML, Alkire BC, Lam AC, Song PC, et al. What do patients want from otolaryngologists? A discrete choice experiment. 2017. https://doi.org/10.1177/0194599817717662.
Jin J, Wang W, He R, Gong H. Valuing health risk in agriculture: a choice experiment approach to pesticide use in China. Environmental Science and Pollution Research; 2017;17526–33.
Decalf VH, Huion AMJ, Benoit DF, Petrovic M, Everaert KCMM. Older people’s preferences for side effects associated with antimuscarinic treatments of overactive bladder: a discrete-choice experiment. Drugs Aging. 2017;34:615–23 (Springer International Publishing).
Deuchert E, Kauer L, Meisen Zannol F. Would you train me with my mental illness? Evidence from a discrete choice experiment. J Ment Health Policy Econ. 2013;16:67–80.
Joy SM, Blauvelt BM, Tuncer MA, Beaugrand M, Sangro B, Colombo M, et al. Stakeholder perspectives on European priorities for comprehensive liver cancer control: a conjoint analysis. Eur J Public Health. 2013;23:951–7.
Shingler SL, Swinburn P, Ali S, Perard R, Lloyd AJ. A discrete choice experiment to determine patient preferences for injection devices in multiple sclerosis. J Med Econ [Internet]. 2013;16:1036–42. http://www.tandfonline.com/doi/full/10.3111/13696998.2013.811079.
Brown DS, Poulos C, Johnson FR, Chamiec-Case L, Messonnier ML. Preference measurement in health. Adv Health Econ Health Serv Res [Internet]. 2014;24:93–121. http://www.scopus.com/inward/record.url?eid=2-s2.0-84908326857&partnerID=tZOtx3y1.
Ryan M. Using conjoint analysis to take account of patient preferences and go beyond health outcomes: an application to in vitro fertilization. Soc Sci Med [Internet]. 1999. [cited 2018 Jun 23];48:535–46. http://www.ncbi.nlm.nih.gov/pubmed/10075178.
Jonker MF, Donkers B, De Bekker-Grob EW, Stolk EA. The effect of level overlap and color coding on attribute non-attendance in discrete choice experiments. 2017. [cited 2018 Jun 27]; https://www.valueinhealthjournal.com/article/S1098-3015(17)33609-4/pdf.
Fiebig DG, Keane MP, Louviere J, Wasi N. The generalized multinomial logit model: accounting for scale and coefficient heterogeneity. Mark Sci [Internet]. INFORMS. 2010. [cited 2018 Jul 9];29:393–421. http://pubsonline.informs.org/doi/abs/10.1287/mksc.1090.0508.
Ryan M, Scott DA, Reeves C, Bate A, van Teijlingen ER, Russell EM, et al. Eliciting public preferences for healthcare. Health Technol Assess (Rockv) [Internet]. 2001.5:1–186. http://www.hta.ac.uk/execsumm/summ505.htm.
Cheung KL, Wijnen BFM, Hollin IL, et al. Using best–worst scaling to investigate preferences in health care. PharmacoEconomics. 2016;34:1195.
Krucien N, Watson V, Ryan M. Is best-worst scaling suitable for health state valuation? A comparison with discrete choice experiments. Health Econ [Internet]. Wiley-Blackwell. 2017. [cited 2018 Jun 26];26:e1–16. http://doi.wiley.com/10.1002/hec.3459.
Kremer IEH, Evers SMAA, Jongen PJ, Hiligsmann M. Comparison of preferences of healthcare professionals and MS patients for attributes of disease-modifying drugs: a best-worst scaling. Heal Expect [Internet]. Wiley/Blackwell (10.1111). 2018. [cited 2018 Jun 26];21:171–80. http://doi.wiley.com/10.1111/hex.12599.
Mühlbacher AC, Kaczynski A, Zweifel P, Johnson FR. Experimental measurement of preferences in health and healthcare using best-worst scaling: an overview. Health Econ Rev. 2016;6:2. https://doi.org/10.1186/s13561-015-0079-x.
Vanniyasingam T, Cunningham CE, Foster G, Thabane L. Simulation study to determine the impact of different design features on design efficiency in discrete choice experiments. BMJ Open [Internet]. British Medical Journal Publishing Group. 2016. [cited 2018 Jun 26];6:e011985. http://www.ncbi.nlm.nih.gov/pubmed/27436671.
Pignone MP, Howard K, Brenner AT, Crutchfield TM, Hawley ST, Lewis CL, et al. Comparing 3 techniques for eliciting patient values for decision-making about prostate-specific antigen screening. JAMA Intern Med [Internet]. 2013. [cited 2018 Jul 16];173:362. http://www.ncbi.nlm.nih.gov/pubmed/23400279.
Lancsar E, Fiebig DG, Hole AR. Discrete choice experiments: a guide to model specification, estimation and software. Pharmacoeconomics [Internet]. Springer-Verlag London Ltd. 2017. [cited 2018 Jul 16];35:697–716. http://link.springer.com/10.1007/s40273-017-0506-4.
Sándor Z, Wedel M. Designing conjoint choice experiments using managers’ prior beliefs. J Mark Res [Internet]. 2001. [cited 2018 Jul 30];38:430–44. http://journals.ama.org/doi/abs/10.1509/jmkr.38.4.430.18904.
Pforr K. Femlogit—implementation of the multinomial logit model with fixed effect. Stata J [Internet]. 2014. [cited 2018 Jul 9];14:847–62. http://ideas.repec.org/a/tsj/stataj/v7y2007i4p465-506.html.
Snijders TAB, Borgatti SP. Non-parametric standard errors and tests for network statistics. Connections. 1999;2:61–70.
Groothuis-Oudshoorn CGM, Flynn TN, Yoo H Il, Magidson J, Oppe M. Key issues and potential solutions for understanding healthcare preference heterogeneity free from patient-level scale confounds. Patient - Patient-Centered Outcomes Res [Internet]. Springer International Publishing. 2018. [cited 2018 Jul 9];1–4. http://link.springer.com/10.1007/s40271-018-0309-5.
Vass CM, Wright S, Burton M, Payne K. Scale heterogeneity in healthcare discrete choice experiments: a primer. Patient - Patient-Centered Outcomes Res [Internet]. Springer International Publishing. 2018. [cited 2018 Jul 16];11:167–73. http://link.springer.com/10.1007/s40271-017-0282-4.
Hess S, Rose JM. Can scale and coefficient heterogeneity be separated in random coefficients models? Transportation (Amst) [Internet]. Springer US. 2012. [cited 2018 Jul 30];39:1225–39. http://link.springer.com/10.1007/s11116-012-9394-9.
de Bekker-Grob EW, Berlin C, Levitan B, Raza K, Christoforidi K, Cleemput I, et al. Giving patients’ preferences a voice in medical treatment life cycle: the PREFER Public–Private Project. Patient - Patient-Centered Outcomes Res [Internet]. Springer International Publishing. 2017. [cited 2018 Jul 25];10:263–6. http://link.springer.com/10.1007/s40271-017-0222-3.
Food and Drug Administration (FDA). Patient preference information—voluntary submission, review in Premarket Approval Applications, Humanitarian Device Exemption Applications, and De Novo Requests, and inclusion in decision summaries and device labeling [Internet]. 2016. http://www.regulations.gov.
Gonzalez JM, Johnson FR, Levitan B, Noel R, Peay H. Symposium title: preference evidence for regulatory decisions. Patient. 2018;11(5):467–73. https://doi.org/10.1007/s40271-018-0311-y.
Sandelowski M. Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. Res Nurs Health. 2000;23:246–55.
Ikenwilo D, Heidenreich S, Ryan M, Mankowski C, Nazir J, Watson V. The best of both worlds: an example mixed methods approach to understand men’s preferences for the treatment of lower urinary tract symptoms. Patient Patient-Centered Outcomes Res [Internet]. 2018. [cited 2018 Jul 9];11:55–67. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&CSC=Y&NEWS=N&PAGE=fulltext&D=prem&AN=28660567http://nt2yt7px7u.search.serialssolutions.com/?sid=OVID:Ovid+MEDLINE%28R%29+In-Process+%26+Other+Non-Indexed+Citations+%3CApril+27%2C+2018%3E&genre=article&id=pmid:286605.
Louviere JJ, Flynn TN, Marley AAJ. Best-worst scaling [Internet]. Best-Worst Scaling Theory, Methods Appl. 2015. [cited 2018 Jun 22]. http://ebooks.cambridge.org/ref/id/CBO9781107337855.
Flynn TN. Valuing citizen and patient preferences in health: recent developments in three types of best-worst scaling. Expert Rev Pharmacoeconomics Outcomes Res [Internet]. 2010. [cited 2018 Jun 18];10:259–67. http://www.ncbi.nlm.nih.gov/pubmed/20545591.
The authors would like to thank Dr. Ewan Gray, Prof. Katherine Payne and Dr. Logan Trenaman for their help with reference screening. The authors would also like to thank Mr. Martin Eden for his helpful comments on a draft of the manuscript.
Vikas Soekhai was funded through the Research Excellence Initiative-Erasmus Choice Modelling Centre grant from the Erasmus University Rotterdam. Esther de Bekker-Grob was funded through a personal grant from The Netherlands Organisation for Scientific Research (NWO-Talent-Scheme-Veni-Grant No. 451-15-039). Alan Ellis was funded through a Patient-Centered Outcomes Research Institute® (PCORI®) Award (ME-1602-34572). Caroline Vass prepared this manuscript with support from ‘Mind the Risk’, a project funded by Riksbankens Jubileumsfond, part of the Swedish Foundation for Humanities and Social Sciences. The statements presented in this article are solely the responsibility of the authors and do not necessarily represent the views of the funders.
A simplified dataset generated during the current review is available upon request. The full detailed dataset generated during the current study will not be publicly available due to ongoing analysis, but more details regarding the simplified dataset are available from the corresponding author on reasonable request.
About this article
Cite this article
Soekhai, V., de Bekker-Grob, E.W., Ellis, A.R. et al. Discrete Choice Experiments in Health Economics: Past, Present and Future. PharmacoEconomics 37, 201–226 (2019). https://doi.org/10.1007/s40273-018-0734-2