Skip to main content

Challenges in Modelling the Cost Effectiveness of Various Interventions for Cardiovascular Disease

PharmacoEconomics volume 32, pages 627–637 (2014)Cite this article

Abstract

Objectives

Decision analytic modelling is essential in performing cost-effectiveness analyses (CEAs) of interventions in cardiovascular disease (CVD). However, modelling inherently poses challenges that need to be dealt with since models always represent a simplification of reality. The aim of this study was to identify and explore the challenges in modelling CVD interventions.

Methods

A document analysis was performed of 40 model-based CEAs of CVD interventions published in high-impact journals. We analysed the systematically selected papers to identify challenges per type of intervention (test, non-drug, drug, disease management programme, and public health intervention), and a questionnaire was sent to the corresponding authors to obtain a more thorough overview. Ideas for possible solutions for the challenges were based on the papers, responses, modelling guidelines, and other sources.

Results

The systematic literature search identified 1,720 potentially relevant articles. Forty authors were identified after screening the most recent 294 papers. Besides the challenge of lack of data, the challenges encountered in the review suggest that it was difficult to obtain a sufficiently valid and accurate cost-effectiveness estimate, mainly due to lack of data or extrapolating from intermediate outcomes. Despite the low response rate of the questionnaire, it confirmed our results.

Conclusions

This combination of a review and a survey showed examples of CVD modelling challenges found in studies published in high-impact journals. Modelling guidelines do not provide sufficient guidance in resolving all challenges. Some of the reported challenges are specific to the type of intervention and disease, while some are independent of intervention and disease.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

49,54 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1

References

  1. Caro JJ, Briggs AH, Siebert U, Kuntz KM, ISPOR-SMDM Modeling Good Research Practices Task Force. Modeling good research practices—overview: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-1. Value Health. 2012;15(6):796–803.

    Article  PubMed  Google Scholar 

  2. Roberts M, Russell LB, Paltiel AD, Chambers M, McEwan P, Krahn M, et al. Conceptualizing a model: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-2. Value Health. 2012;15(6):804–11.

    Article  PubMed  Google Scholar 

  3. Siebert U, Alagoz O, Bayoumi AM, Jahn B, Owens DK, Cohen DJ, et al. State-transition modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-3. Value Health. 2012;15(6):812–20.

    Article  PubMed  Google Scholar 

  4. Karnon J, Stahl J, Brennan A, Caro JJ, Mar J, Moller J, et al. Modeling using discrete event simulation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-4. Value Health. 2012;15(6):821–7.

    Article  PubMed  Google Scholar 

  5. Pitman R, Fisman D, Zaric GS, Postma M, Kretzschmar M, Edmunds J, et al. Dynamic transmission modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-5. Value Health. 2012;15(6):828–34.

    Article  PubMed  Google Scholar 

  6. Briggs AH, Weinstein MC, Fenwick EA, Karnon J, Sculpher MJ, Paltiel AD, et al. Model parameter estimation and uncertainty: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-6. Value Health. 2012;15(6):835–42.

    Article  PubMed  Google Scholar 

  7. Eddy DM, Hollingworth W, Caro JJ, Tsevat J, McDonald KM, Wong JB, et al. Model transparency and validation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-7. Value Health. 2012;15(6):843–50.

    Article  PubMed  Google Scholar 

  8. Centre for Reviews and Dissemination. NHS EED economics filter: Medline (Ovid) monthly search; 2013. http://www.crd.york.ac.uk/crdweb/AboutPage.asp.

  9. ISI Web of Knowledge. Journal Citation Reports 2012; 2013. http://admin-apps.webofknowledge.com/JCR/JCR?SID=P2O5aGPGn3SVdnPEIKN&locale=en_US.

  10. Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;22(343):d4002.

    Article  Google Scholar 

  11. Sutton AJ, Song F, Gilbody SM, Abrams KR. Modelling publication bias in meta-analysis: a review. Stat Methods Med Res. 2000;9(5):421–45.

    CAS  Article  PubMed  Google Scholar 

  12. Magnuson EA, Farkouh ME, Fuster V, Wang K, Vilain K, Li H, et al. Cost-effectiveness of percutaneous coronary intervention with drug eluting stents versus bypass surgery for patients with diabetes mellitus and multivessel coronary artery disease: results from the FREEDOM trial. Circulation. 2013;127(7):820–31.

    PubMed Central  Article  PubMed  Google Scholar 

  13. Dias S, Welton NJ, Sutton AJ, Ades AE. Evidence synthesis for decision making 1: introduction. Med Decis Making. 2013;33(5):597–606.

    PubMed Central  Article  PubMed  Google Scholar 

  14. Ades AE, Caldwell DM, Reken S, Welton NJ, Sutton AJ, Dias S. Evidence synthesis for decision making 7: a reviewer’s checklist. Med Decis Making. 2013;33(5):679–91.

    CAS  PubMed Central  Article  PubMed  Google Scholar 

  15. Dias S, Sutton AJ, Ades AE, Welton NJ. Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Med Decis Making. 2013;33(5):607–17.

    PubMed Central  Article  PubMed  Google Scholar 

  16. Dias S, Sutton AJ, Welton NJ, Ades AE. Evidence synthesis for decision making 6: embedding evidence synthesis in probabilistic cost-effectiveness analysis. Med Decis Making. 2013;33(5):671–8.

    PubMed Central  Article  PubMed  Google Scholar 

  17. Dias S, Sutton AJ, Welton NJ, Ades AE. Evidence synthesis for decision making 3: heterogeneity—subgroups, meta-regression, bias, and bias-adjustment. Med Decis Making. 2013;33(5):618–40.

    PubMed Central  Article  PubMed  Google Scholar 

  18. Dias S, Welton NJ, Sutton AJ, Ades AE. Evidence synthesis for decision making 5: the baseline natural history model. Med Decis Making. 2013;33(5):657–70.

    PubMed Central  Article  PubMed  Google Scholar 

  19. Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Med Decis Making. 2013;33(5):641–56.

    PubMed Central  Article  PubMed  Google Scholar 

  20. Stettler C, Wandel S, Allemann S, Kastrati A, Morice MC, Schomig A, et al. Outcomes associated with drug-eluting and bare-metal stents: a collaborative network meta-analysis. Lancet. 2007;370(9591):937–48.

    CAS  Article  PubMed  Google Scholar 

  21. Bojke L, Claxton K, Palmer S, Sculpher M. Defining and characterising structural uncertainty in decision analytic models. CHE Research Paper 9; 2006. http://www.york.ac.uk/che/pdf/rp9.pdf

  22. Frederix GW, Severens JL, Hovels AM, Raaijmakers JA, Schellens JH. Reviewing the cost-effectiveness of endocrine early breast cancer therapies: influence of differences in modeling methods on outcomes. Value Health. 2012;15(1):94–105.

    Article  PubMed  Google Scholar 

  23. Grutters JP, Sculpher M, Briggs AH, Severens JL, Candel MJ, Stahl JE, et al. Acknowledging patient heterogeneity in economic evaluation: a systematic literature review. Pharmacoeconomics. 2013;31(2):111–23.

    Article  PubMed  Google Scholar 

  24. Lieu TA, Gurley RJ, Lundstrom RJ, Ray GT, Fireman BH, Weinstein MC, et al. Projected cost-effectiveness of primary angioplasty for acute myocardial infarction. J Am Coll Cardiol. 1997;30(7):1741–50.

    CAS  Article  PubMed  Google Scholar 

  25. Westwood ME, Raatz HD, Misso K, Burgers L, Redekop K, Lhachimi SK, et al. Systematic review of the accuracy of dual-source cardiac CT for detection of arterial stenosis in difficult to image patient groups. Radiology. 2013;267(2):387–95.

    Article  PubMed  Google Scholar 

  26. Burgers LT, Redekop W, Westwood M, Lhachimi S, Severens JL, Armstrong N, et al. Using five existing models to comprehensively model the cost-effectiveness of a high definition ct scanner in a coronary artery disease population: a nice diagnostic guidance project. Value Health. 2011;14(7):A259.

    Google Scholar 

  27. Putter H, Fiocco M, Geskus RB. Tutorial in biostatistics: competing risks and multi-state models. Stat Med. 2007;26(11):2389–430.

    CAS  Article  PubMed  Google Scholar 

  28. Wolbers M, Koller MT, Witteman JC, Steyerberg EW. Prognostic models with competing risks: methods and application to coronary risk prediction. Epidemiology. 2009;20(4):555–61.

    Article  PubMed  Google Scholar 

  29. van Gils PF, Over EA, Hamberg-van Reenen HH, de Wit GA, van den Berg M, Schuit AJ, et al. The polypill in the primary prevention of cardiovascular disease: cost-effectiveness in the Dutch population. BMJ Open. 2011;1(2):e000363.

    Google Scholar 

  30. Anderson KM, Odell PM, Wilson PWF, Kannel WB. Cardiovascular-disease risk profiles. Am Heart J. 1991;121(1):293–8.

    CAS  Article  PubMed  Google Scholar 

  31. Conroy RM, Pyorala K, Fitzgerald AP, Sans S, Menotti A, De Backer G, et al. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003;24(11):987–1003.

    CAS  Article  PubMed  Google Scholar 

  32. van Kempen BJ, Spronk S, Koller MT, Elias-Smale SE, Fleischmann KE, Ikram MA, et al. Comparative effectiveness and cost-effectiveness of computed tomography screening for coronary artery calcium in asymptomatic individuals. J Am Coll Cardiol. 2011;58(16):1690–701.

    Article  PubMed  Google Scholar 

  33. Drummond M, Griffin A, Tarricone R. Economic evaluation for devices and drugs—same or different? Value Health. 2009;12(4):402–4.

    Article  PubMed  Google Scholar 

  34. Ramsay CR, Grant AM, Wallace SA, Garthwaite PH, Monk AF, Russell IT. Statistical assessment of the learning curves of health technologies. Health Technol Assess. 2001;5(12):1–79.

    CAS  PubMed  Google Scholar 

  35. Woods JR, Saywell RM Jr, Nyhuis AW, Jay SJ, Lohrman RG, Halbrook HG. The learning curve and the cost of heart transplantation. Health Serv Res. 1992;27(2):219–38.

    CAS  PubMed Central  PubMed  Google Scholar 

  36. Jahn B, Theurl E, Siebert U, Pfeiffer KP. Tutorial in medical decision modeling incorporating waiting lines and queues using discrete event simulation. Value Health. 2010;13(4):501–6.

    Article  PubMed  Google Scholar 

  37. Brown LC, Powell JT, Thompson SG, Epstein DM, Sculpher MJ, Greenhalgh RM. The UK EndoVascular Aneurysm Repair (EVAR) trials: randomised trials of EVAR versus standard therapy. Health Technol Assess. 2012;16(9):1–218.

    CAS  PubMed  Google Scholar 

  38. Denchev P, Kaltman JR, Schoenbaum M, Vitiello B. Modeled economic evaluation of alternative strategies to reduce sudden cardiac death among children treated for attention deficit/hyperactivity disorder. Circulation. 2010;121(11):1329–37.

    Article  PubMed  Google Scholar 

  39. Hunink M. Multiple test results. In: Hunink M, Glasziou P, Siegel J, Weeks J, Pliskin J, Elstein A, et al., editors. Decision making in health and medicine. New York: Cambridge university press; 2010. p. 177.

    Google Scholar 

  40. Weintraub WS, Madeira SW Jr, Bodenheimer MM, Seelaus PA, Katz RI, Feldman MS, et al. Critical analysis of the application of Bayes’ theorem to sequential testing in the noninvasive diagnosis of coronary artery disease. Am J Cardiol. 1984;54(1):43–9.

    CAS  Article  PubMed  Google Scholar 

  41. Dijkgraaf M. Evaluation of diagnostic device clinical outcomes. In: Ackerman S, Smith M, Ehreth J, Eldessouki R, Sullivan E, editors. Therapeutic and diagnostic device outcomes research. USA: International Society for Pharmacoeconomics and Outcomes Research; 2011. p. 139.

    Google Scholar 

  42. Berry E, Kelly S, Hutton J, Lindsay HS, Blaxill JM, Evans JA, et al. Intravascular ultrasound-guided interventions in coronary artery disease: a systematic literature review, with decision-analytic modelling, of outcomes and cost-effectiveness. Health Technol Assess. 2000;4(35):1–117.

    CAS  PubMed  Google Scholar 

  43. Hughes D, Cowell W, Koncz T, Cramer J, International Society for Pharmacoeconomics & Outcomes Research Economics of Medication Compliance Working Group. Methods for integrating medication compliance and persistence in pharmacoeconomic evaluations. Value Health. 2007;10(6):498–509.

    Article  PubMed  Google Scholar 

  44. Sokol MC, McGuigan KA, Verbrugge RR, Epstein RS. Impact of medication adherence on hospitalization risk and healthcare cost. Med Care. 2005;43(6):521–30.

    Article  PubMed  Google Scholar 

  45. Drummond MF, Sculpher MJ, Torrance G, O’Brien BJ, Stoddart G. Economic evaluation using patient-level data. Methods for the economic evaluation of health care programmes. 3rd ed. Oxford: Oxford University Press; 2005. p. 247.

    Google Scholar 

  46. Peterson AM, Nau DP, Cramer JA, Benner J, Gwadry-Sridhar F, Nichol M. A checklist for medication compliance and persistence studies using retrospective databases. Value Health. 2007;10(1):3–12.

    Article  PubMed  Google Scholar 

  47. Heart Protection Study Collaborative, Mihaylova B, Briggs A, Armitage J, Parish S, Gray A, et al. Lifetime cost effectiveness of simvastatin in a range of risk groups and age groups derived from a randomised trial of 20,536 people. BMJ. 2006;333(7579):1145.

    Article  PubMed  Google Scholar 

  48. Kirisits A, Redekop WK. The economic evaluation of medical devices: challenges ahead. Appl Health Econ Health Policy. 2013;11(1):15–26.

    Article  PubMed  Google Scholar 

  49. Goldman L, Mudge GH Jr, Cook EF. The changing “natural history” of symptomatic coronary artery disease: basis versus bias. Am J Cardiol. 1983;51(3):449–54.

    CAS  Article  PubMed  Google Scholar 

  50. Ara R, Brazier JE. Populating an economic model with health state utility values: moving toward better practice. Value Health. 2010;13(5):509–18.

    Article  PubMed  Google Scholar 

  51. Weinstein MC. Recent developments in decision-analytic modelling for economic evaluation. Pharmacoeconomics. 2006;24(11):1043–53.

    Article  PubMed  Google Scholar 

  52. Taylor RS, Iglesias CP. Assessing the clinical and cost-effectiveness of medical devices and drugs: are they that different? Value Health. 2009;12(4):404–6.

    Article  PubMed  Google Scholar 

  53. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Pharmacoeconomics. 2013;31(5):361–7.

    Article  PubMed  Google Scholar 

  54. van Kempen BJ, Ferket BS, Hofman A, Spronk S, Steyerberg E, Hunink MG. Do different methods of modeling statin treatment effectiveness influence the optimal decision? Med Decis Making. 2012;32(3):507–16.

    Article  PubMed  Google Scholar 

  55. Frederix GW, Severens JL, Hovels AM, Raaijmakers JA, Schellens JH. The cloudy crystal ball of cost-effectiveness studies. Value Health. 2013;16(6):1100–2.

    Article  PubMed  Google Scholar 

  56. Turner D, Raftery J, Cooper K, Fairbank E, Palmer S, Ward S, et al. The CHD challenge: comparing four cost-effectiveness models. Value Health. 2011;14(1):53–60.

    Article  PubMed  Google Scholar 

  57. Spiegelhalter DJ, Best NG. Bayesian approaches to multiple sources of evidence and uncertainty in complex cost-effectiveness modelling. Stat Med. 2003;22(23):3687–709.

    Article  PubMed  Google Scholar 

  58. Koopmanschap MA, Rutten FF. A practical guide for calculating indirect costs of disease. Pharmacoeconomics. 1996;10(5):460–6.

    CAS  Article  PubMed  Google Scholar 

  59. Briggs A, Clark T, Wolstenholme J, Clarke P. Missing… presumed at random: cost-analysis of incomplete data. Health Econ. 2003;12(5):377–92.

    Article  PubMed  Google Scholar 

  60. Briggs AH. Handling uncertainty in cost-effectiveness models. Pharmacoeconomics. 2000;17(5):479–500.

    CAS  Article  PubMed  Google Scholar 

  61. Downs SM. Technical report: urinary tract infections in febrile infants and young children. The Urinary Tract Subcommittee of the American Academy of Pediatrics Committee on Quality Improvement. Pediatrics. 1999;103(4):e54.

    CAS  Article  PubMed  Google Scholar 

  62. Robinson M, Palmer S, Sculpher M, Philips Z, Ginnelly L, Bowens A, et al. Cost-effectiveness of alternative strategies for the initial medical management of non-ST elevation acute coronary syndrome: systematic review and decision-analytical modelling. Health Technol Assess. 2005;9(27):iii–iv, ix–xi, 1–158.

    Google Scholar 

  63. Reed SD, Anstrom KJ, Bakhai A, Briggs AH, Califf RM, Cohen DJ, et al. Conducting economic evaluations alongside multinational clinical trials: toward a research consensus. Am Heart J. 2005;149(3):434–43.

    Article  PubMed  Google Scholar 

  64. Jones L, Griffin S, Palmer S, Main C, Orton V, Sculpher M, et al. Clinical effectiveness and cost-effectiveness of clopidogrel and modified-release dipyridamole in the secondary prevention of occlusive vascular events: a systematic review and economic evaluation. Health Technol Assess. 2004;8(38):iii–iv, 1–196.

    Google Scholar 

  65. Briggs A, Claxton K, Sculpher M. Introduction. Decision modelling for health economic evaluation. Oxford: Oxford University Press; 2006. p. 1.

    Google Scholar 

  66. Hill R, Bagust A, Bakhai A, Dickson R, Dundar Y, Haycox A. Coronary artery stents: a rapid systematic review and economic evaluation. Health Technol Assess. 2004;8(35):1–256.

    Google Scholar 

  67. Stahl JE. Modelling methods for pharmacoeconomics and health technology assessment: an overview and guide. Pharmacoeconomics. 2008;26(2):131–48.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

W.K. Redekop, J.L. Severens and L.T. Burgers have nothing to disclose. L.T. Burgers acts as overall guarantor for the manuscript content. L.T. Burgers, W.K. Redekop and J.L. Severens have all contributed significantly to the planning of the study, performing the document analysis, and drafting and finalizing the manuscript. The current authors acknowledge the authors of the selected papers who responded to the questionnaire: Peter Alperin, Roberta Ara, Rodrigo Refoios Camejo, Peter Denchev, Crystal Smith-Spangler and Rod Taylor. Furthermore, we would like to acknowledge the following researchers who contributed to the challenges list in a pilot version of the questionnaire: Thea van Asselt, Hedwig Blommestein, Leander Buisman, Ron Handels, Tim Kanters and Annemieke Leunis.

Author information

Affiliations

  1. Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, The Netherlands

    Laura T. Burgers, William K. Redekop & Johan L. Severens

  2. Institute for Medical Technology Assessment, Erasmus University Rotterdam, Burgemeester Oudlaan 50, PO Box 1738, 3000 DR, Rotterdam, The Netherlands

    Laura T. Burgers, William K. Redekop & Johan L. Severens

Authors
  1. Laura T. Burgers
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. William K. Redekop
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Johan L. Severens
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Johan L. Severens.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 494 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Burgers, L.T., Redekop, W.K. & Severens, J.L. Challenges in Modelling the Cost Effectiveness of Various Interventions for Cardiovascular Disease. PharmacoEconomics 32, 627–637 (2014). https://doi.org/10.1007/s40273-014-0155-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40273-014-0155-9

Keywords

  • Economic Evaluation
  • Document Analysis
  • Public Health Intervention
  • Disease Management Programme
  • Structural Uncertainty