Abstract
Healthcare decision making is usually characterized by a low degree of transparency. The demand for transparent decision processes can be fulfilled only when assessment, appraisal and decisions about health technologies are performed under a systematic construct of benefit assessment. The benefit of an intervention is often multidimensional and, thus, must be represented by several decision criteria. Complex decision problems require an assessment and appraisal of various criteria; therefore, a decision process that systematically identifies the best available alternative and enables an optimal and transparent decision is needed. For that reason, decision criteria must be weighted and goal achievement must be scored for all alternatives. Methods of multi-criteria decision analysis (MCDA) are available to analyse and appraise multiple clinical endpoints and structure complex decision problems in healthcare decision making. By means of MCDA, value judgments, priorities and preferences of patients, insurees and experts can be integrated systematically and transparently into the decision-making process. This article describes the MCDA framework and identifies potential areas where MCDA can be of use (e.g. approval, guidelines and reimbursement/pricing of health technologies). A literature search was performed to identify current research in healthcare. The results showed that healthcare decision making is addressing the problem of multiple decision criteria and is focusing on the future development and use of techniques to weight and score different decision criteria. This article emphasizes the use and future benefit of MCDA.
Similar content being viewed by others
References
Marsh K, et al. Assessing the value of healthcare interventions using multi-criteria decision analysis: a review of the literature. PharmacoEconomics. 2014;32(4):345–65.
International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Multi-criteria decision analysis in health care decision makingdecision-making emerging good practices task force. 2015. Available from: http://www.ispor.org/TaskForces/Multi-Criteria-Decision-Analysis-Bgr.asp. Accessed 15 May 2015.
Nuijten MJC, Dubois DJ. Cost-utility analysis: current methodological issues and future perspectives. Front Pharmacol. 2011;2:29.
Wahlster P, et al. Balancing costs and benefits at different stages of medical innovation: a systematic review of Multi-criteria decision analysis (MCDA). BMC Health Serv Res. 2015;15(1):262.
Figueira JM, Ehrogott, Greco S. Multiple criteria decision analysis: State of the Art Surveys, in international series in operations research and management science 78. New York: Springer Science + Business Media; 2005.
Goetghebeur MM, et al. Evidence and value: impact on DEcisionMaking–the EVIDEM framework and potential applications. BMC Health Serv Res. 2008;8:270.
Goetghebeur MM, et al. Combining multicriteria decision analysis, ethics and health technology assessment: applying the EVIDEM decision-making framework to growth hormone for Turner syndrome patients. Cost Eff Resour Alloc. 2010;8:4.
Hummel JM, et al. A multicriteria decision analysis of augmentative treatment of upper limbs in persons with tetraplegia. J Rehabil Res Dev. 2005;42(5):635–44.
Nutt DJ, et al. Drug harms in the UK: a multicriteria decision analysis. Lancet. 2010;376(9752):1558–65.
Tervonen T, Figueira JR. A survey on stochastic multicriteria acceptability analysis methods. J Mult Crit Decis Anal. 2008;15(1–2):1–14.
Facey K, et al. Patients’ perspectives in health technology assessment: a route to robust evidence and fair deliberation. Int J Technol Assess Health Care. 2010;26(3):334–40.
Mühlbacher AC. Patient-centric HTA: different strokes for different folks. Expert Rev Pharmacoecon Outcomes Res. 2015;15(4):591–7.
Keeney RL, Raiffa H. Decision analysis with multiple conflicting objectives. New York: Wiley; 1976.
Belton V, Stewart T. Problem structuring and multiple criteria decision analysis, in Trends in multiple criteria decision analysis. 2010. London: Springer, pp. 209–39.
Devlin N, Sussex J. Incorporating multiple criteria in HTA: methods and processes. London: Off Health Econ; 2011.
Baltussen R, Niessen L. Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Effect Res Alloc. 2006;4(1):14.
Dolan JG. Multi-criteria clinical decision support: A primer on the use of multiple criteria decision makingdecision-making methods to promote evidence-based, patient-centered healthcare. Patient. 2010;3(4):229–48.
Belton V, Stewart TJ. Multiple criteria decision analysis: an integrated approach. 2002. Boston: Kluwer Academic Publ. XVIII, 372 S.
Broekhuizen H, et al. A review and classification of approaches for dealing with uncertainty in multi-criteria decision analysis for healthcare decisions. Pharmacoeconomics. 2015;33(5):445–55.
Diaby V, Goeree R. How to use multi-criteria decision analysis methods for reimbursement decision-making in healthcare: a step-by-step guide. Expert Rev Pharmacoecon Outcomes Res. 2014;14(1):81–99.
Fenton N, Neil M. Making decisions: using Bayesian nets and MCDA. Knowl Based Syst. 2001;14(7):307–25.
Mühlbacher A, Bethge S, Tockhorn A. Präferenzmessung im Gesundheitswesen: Grundlagen von discrete-choice-experimenten [measuring preferences in healthcare: introduction to discrete-choice experiments]. Gesundh Qual. 2013;4:159–72.
Mühlbacher AC, Kaczynski A. Der Analytic Hierarchy Process (AHP): Eine Methode zur Entscheidungsunterstützung im Gesundheitswesen. PharmacoEcon Ger Res Artic. 2014;11(2):119–32.
Mühlbacher AC, Kaczynski A, Zweifel P. Experimentelle Präferenzmessung im Gesundheitswesen mit Hilfe von Best-Worst Scaling (BWS). PharmacoEcon Ger Res Artic. 2013;11(2):101–17.
Stewart TJ. Dealing with uncertainties in MCDA, in multiple criteria decision analysis: State of the Art Surveys. London: Springer; 2005, pp. 445–466.
Thokala P, Duenas A. Multiple criteria decision analysis for health technology assessment. Value Health. 2012;15(8):1172–81.
Mayag B, Grabisch M, Labreuche C. A representation of preferences by the Choquet integral with respect to a 2-additive capacity. Theory Decis. 2011;71(3):297–324.
Yager RR. On ordered weighted averaging aggregation operators in multicriteria decisionmaking. Syst Man Cybern IEEE Trans. 1988;18(1):183–90.
Feizizadeh B, Blaschke T. Uncertainty analysis of GIS-based ordered weighted averaging method for landslide susceptibility mapping in Urmia Lake Basin, Iran. In: Proceedings of GIScience; 2012.
Marsh K, Caro JJ, Muszbek N. Does the future belong to MCDA? ISPOR Connect. 2012;18(6):9–11.
Diaby V, et al. Multi-criteria decision analysis for health technology assessment in Canada: insights from an expert panel discussion. Expert Rev Pharmacoecon Outcomes Res. 2015;15(1):13–9.
Zimmermann H.-J, Gutsche L. Multi-criteria analyse. London: Springer; 1991.
Guitouni A, Martel J-M. Tentative guidelines to help choosing an appropriate MCDA method. Eur J Oper Res. 1998;109(2):501–21.
Von Winterfeldt D, Fischer G. Multi-attribute utility theory: models and assessment procedures. In: Wendt D, Vlek C, editors. Utility, probability, and human decision making. theory and decision library. Netherlands: Springer; 1975. p. 47–85.
Sussex J, et al. A pilot study of multicriteria decision analysis for valuing orphan medicines. Value Health. 2013;16(8):1163–9.
Ishizaka A, Nemery P. Multi-criteria decision analysis: methods and software. 1st ed. Chichester: Wiley; 2013.
Tzeng, G.-H, Huang J.-J. Multiple attribute decision makingdecision-making: methods and applications. London: CRC press; 2011.
Peacock S, et al. Overcoming barriers to priority setting using interdisciplinary methods. Health Policy. 2009;92(2–3):124–32.
Baltussen R, et al. Multi-criteria decision analysis to prioritize health interventions: Capitalizing on first experiences. Health Policy. 2010;96(3):262–4.
Le Gales C, Moatti J. Searching for consensus through multi-criteria decision analysis. Assessment of screening strategies for hemoglobinopathies in southeastern France. Int J Technol Assess Health Care. 1990;6(3):430.
Adunlin G, Diaby V, Xiao H. Application of multicriteria decision analysis in health care: a systematic review and bibliometric analysis. Health Expect. 2014. doi:10.1111/hex.12287.
Nobre FF, Trotta LT, Gomes LF. Multi-criteria decision makingdecision-making–an approach to setting priorities in health care. Stat Med. 1999;18(23):3345–54.
Tony M, et al. Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada. BMC Health Serv Res. 2011;11:329.
Youngkong S, et al. Multi-criteria decision analysis for setting priorities on HIV/AIDS interventions in Thailand. Health Res Policy Syst. 2012;10:6.
Defechereux T, et al. Health care priority setting in Norway a multicriteria decision analysis. BMC Health Serv Res. 2012;12:39.
Wilson E, et al. Prioritizing health technologies in a Primary Care Trust. J Health Serv Res Policy. 2007;12(2):80–5.
IJzerman MJ, Marsh K, Hebborn A, Lanitis T. Understanding and modeling business decisions in market access and reimbursement using multi-criteria decision analysis techniques. 2014. Available from: http://www.ispor.org/meetings/montreal0614/presentations/W17-Teres_Lanitis-Kevin_Marsh.pdf. Accessed 17 May 2015.
Mühlbacher AC, Juhnke C. Patient preferences versus physicians’ judgement: does it make a difference in healthcare decision makingdecision-making? Appl Health Econ Health policy. 2013;11(3):163–80.
Baltussen R, et al. Towards a multi-criteria approach for priority setting: an application to Ghana. Health Econ. 2006;15(7):689–96.
Wen S, Zhang L, Yang B. Two approaches to incorporate clinical data uncertainty into multiple criteria decision analysis for benefit–risk assessment of medicinal products. Value Health. 2014;17(5):619–28.
Maruthur NM, et al. Systematic assessment of benefits and risks: study protocol for a multi-criteria decision analysis using the Analytic Hierarchy Process for comparative effectiveness research. F1000Res. 2013;2:160.
Guo JJ, et al. A review of quantitative risk-benefit methodologies for assessing drug safety and efficacy-report of the ISPOR risk-benefit management working group. Value Health. 2010;13(5):657–66.
Food and Drug Administration (FDA). Structured approach to benefit–risk assessment in drug regulatory decision-making draft PDUFA V implementation plan—February, 2013 Fiscal Years 2013–2017. 2013. Available from: http://www.fda.gov/downloads/ForIndustry/UserFees/PrescriptionDrugUserFee/UCM329758.pdf. Accessed 10 May 2015.
Sussex J, Towse A, Devlin N. Operationalizing value-based pricing of medicines. Pharmacoeconomics. 2013;31(1): 1–10.
Danner M, et al. Integrating patients’ views into health technology assessment: analytic hierarchy process (AHP) as a method to elicit patient preferences. Int J Technol Assess Health Care. 2011;27(04):369–75.
Goetghebeur MM, et al. Bridging health technology assessment (HTA) and efficient health care decision makingdecision-making with multicriteria decision analysis (MCDA): applying the EVIDEM framework to medicines appraisal. Med Decis Making. 2012;32(2):376–88.
van Til J, et al. Does technique matter; a pilot study exploring weighting techniques for a multi-criteria decision support framework. Cost Eff Resour Alloc. 2014;12(1):22.
EVIDEM collaboration. Evidence and value: impact on decisionmaking (EVIDEM). EVIDEM Framework. 2015. Available from: https://www.evidem.org/. Accessed 12 May 2015.
Radaelli G, et al. Implementation of EUnetHTA core Model(R) in Lombardia: the VTS framework. Int J Technol Assess Health Care. 2014;30(1):105–12.
Wahlster P, et al. Methodological challenges in multi-criteria decision analysis (MCDA) for health policy decision-making: a systematic review. Value Health. 2013;16(7):A454.
Hummel M, IJzerman M, van Manen J. IQWiG-Berichte—Nr. 163: analytic hierarchy process (AHP)—pilotprojekt zur erhebung von patienten-präferenzen in der indikation depression. Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen, editor.
Klinke A, Renn O. A new approach to risk evaluation and management: risk-based, precaution-based, and discourse-based strategies1. Risk Anal. 2002;22(6):1071–94.
Hart D. Die Nutzen/Risiko-Abwägung im Arzneimittelrecht. Bundesgesundheitsblatt-Gesundheitsforschung-Gesundheitsschutz. 2005;48(2):204–14.
González JM, Craig BM, Mühlbacher AC. Choice defines value: using discrete-choice experiments to understand and inform health care decisions. ISPOR Connect. 2013;19(2):6–7.
Diaby V, Campbell K, Goeree R. Multi-criteria decision analysis (MCDA) in health care: a bibliometric analysis. Oper Res Health Care. 2013;2(1):20–4.
Institut für Qualität und Wirtschaftlicheit im Gesundheitswesen (IQWiG). Wahlbasierte Conjoint-Analyse—Pilotprojekt zur Identifikation, Gewichtung und Priorisierung multipler Attribute in der Indikation Hepatitis C; IQWiG-Berichte—Nr. 227, unter Mitwirkung von, et al., editors; 2014: Köln.
Towse A, Barnsley P. Approaches to identifying, measuring, and aggregating elements of value. Int J Technol Assess Health Care. 2013;29:360–4.
Devlin NJ. The economics of a ‘liberated’ NHS. PharmacoEconomics. 2010;28(12):1075–8.
Briggs AH, et al. Model parameter estimation and uncertainty: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-6. Value Health. 2012;15(6):835–42.
Durbach IN, Stewart TJ. Modeling uncertainty in multi-criteria decision analysis. Eur J Oper Res. 2012;223(1):1–14.
Acknowledgments
The authors would like to thank the reviewers for their valuable and constructive contribution. The reviewers were Vakaramoko Diaby, James Dolan and Sitaporn Youngkong; the authors were blind to the reviewers’ identities during the peer review and revision of the manuscript.
Author contributions
ACM and AK contributed to the conception, developed the theoretical framework, and contributed to the writing of the manuscript. All authors gave final approval of the version to be submitted.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
No funding was obtained to prepare this manuscript. The authors Axel Mühlbacher and Anika Kaczynski declare that there are no conflicts of interest.
Rights and permissions
About this article
Cite this article
Mühlbacher, A.C., Kaczynski, A. Making Good Decisions in Healthcare with Multi-Criteria Decision Analysis: The Use, Current Research and Future Development of MCDA. Appl Health Econ Health Policy 14, 29–40 (2016). https://doi.org/10.1007/s40258-015-0203-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40258-015-0203-4