An Introduction to Markov Modelling for Economic Evaluation

Summary

Markov models are often employed to represent stochastic processes, that is, random processes that evolve over time. In a healthcare context, Markov models are particularly suited to modelling chronic disease. In this article, we describe the use of Markov models for economic evaluation of healthcare interventions. The intuitive way in which Markov models can handle both costs and outcomes make them a powerful tool for economic evaluation modelling. The time component of Markov models can offer advantages of standard decision tree models, particularly with respect to discounting. This paper gives a comprehensive description of Markov modelling for economic evaluation, including a discussion of the assumptions on which the type of model is based, most notably the memoryless quality of Markov models often termed the ‘Markovian assumption’. A hypothetical example of a drug intervention to slow the progression of a chronic disease is employed to demonstrate the modelling technique and the possible methods of analysing Markov models are explored. Analysts should be aware of the limitations of Markov models, particularly the Markovian assumption, although the adept modeller will often find ways around this problem.

This is a preview of subscription content, access via your institution.

References

  1. 1.

    Buxton MJ, Drummond MF, van Hout BA, et al. Modelling in economic evaluation: an unavoidable fact of life. Health Econ 1997; 6: 217–27

    PubMed  Article  CAS  Google Scholar 

  2. 2.

    Eddy DM. Technology assessment: the role of mathematical modelling. In: Mosteller F, editor. Assessing medical technologies. Washington, DC: National Academy Press, 1985: 144–53

    Google Scholar 

  3. 3.

    Michaels JA, Galland RB. Management of asymptomatic popliteal aneurysms: the use of a Markov decision tree to determine the criteria for a conservative approach. Eur J Vasc Surg 1993; 7 (2): 136–43

    PubMed  Article  CAS  Google Scholar 

  4. 4.

    Barnhart HX, Caldwell MB, Thomas P, et al. Natural history of human immunodeficiency virus disease in perinatally infected children: an analysis from the Pediatric Spectrum of Disease Project. Pediatrics 1996; 97 (5): 710–6

    PubMed  CAS  Google Scholar 

  5. 5.

    Ludbrook A. A cost—effectiveness analysis of the treatment of chronic renal failure. Appl Econ 1981; 13: 337–50

    Article  Google Scholar 

  6. 6.

    Hillner BE, Mc Leod DG, Crawford ED, et al. Estimating the cost effectiveness of total androgen blockade with flutamide in M1 prostate cancer. Urology 1995; 45 (5): 633–40

    PubMed  Article  CAS  Google Scholar 

  7. 7.

    Sculpher M, Michaels J, Mc Kenna M, et al. A cost—utility analysis of laser—assisted angioplasty for peripheral arterial occlusions. Int J Technol Assess Health Care 1996; 12 (1): 104–25

    PubMed  Article  CAS  Google Scholar 

  8. 8.

    Briggs AH, Sculpher MJ, Logan RP, et al. Cost effectiveness of screening for and eradication of Helicobacter pylori in management of dyspeptic patients under 45 years of age. BMJ. 1996; 312 (7042): 1321–5

    PubMed  Article  CAS  Google Scholar 

  9. 9.

    Sonnenberg FA, Beck JR. Markov models in medical decision making: a practical guide. Med Decis Making 1993; 13: 322–38

    PubMed  Article  CAS  Google Scholar 

  10. 10.

    Bloom BS, Fendrick AM. Timing and timeliness in medicalcare evaluation. Pharmacoeconomics 1996; 9 (3): 183–7

    PubMed  Article  CAS  Google Scholar 

  11. 11.

    Sculpher MJ, Drummond MF, Buxton MJ. The iterative use of economic evaluation as part of the process of health technology assessment. J Health Serv Res Policy 1997; 2: 26–30

    PubMed  CAS  Google Scholar 

  12. 12.

    Clemens K, Garrison LP, Jones A, et al. Strategic use of pharmacoeconomic research in early drug development and global pricing. Pharmacoeconomics 1993; 4 (5): 315–22

    PubMed  Article  CAS  Google Scholar 

  13. 13.

    Torgerson D, Donaldson C, Reid D. Using economics to prioritize research: a case study of randomized trials for the prevention of hip fractures due to osteoporosis. J Health Serv Res Policy 1996; 1: 141–6

    PubMed  CAS  Google Scholar 

  14. 14.

    Townsend J, Buxton M. Cost—effectiveness scenario analysis for a proposed trial of hormone replacement therapy. Health Policy 1997; 39: 181–94

    PubMed  Article  CAS  Google Scholar 

  15. 15.

    Glick H, Heyse JF, Thompson D, et al. A model for evaluating the cost—effectiveness of cholesterol—lowering treatment. Int J Technol Assess Health Care 1992; 8 (4): 719–34

    PubMed  Article  CAS  Google Scholar 

  16. 16.

    Shepherd J, Cobbe SM, Ford I, West of Scotland Coronary Prevention Study Group, et al. Prevention of coronary heart disease with pravastatin in men with hypercholesterolemia. N Engl J Med 1995; 333 (20): 1301–7

    PubMed  Article  CAS  Google Scholar 

  17. 17.

    Scandinavian Simvastatin Survival Study Group. Randomised trial of cholesterol lowering in 4444 patients with coronary heart disease: the Scandinavian Simvastatin Survival Study (4S). Lancet 1994; 344 (8934): 1383–9

    Google Scholar 

  18. 18.

    Johannesson M, Jonsson B, Kjekshus J, Scandinavian Simvastatin Survival Study Group, et al. Cost effectiveness of simvastatin treatment to lower cholesterol levels in patients with coronary heart disease. N Engl J Med 1997; 336 (5): 332–6

    PubMed  Article  CAS  Google Scholar 

  19. 19.

    Mark DB, Hlatky MA, Califf RM, et al. Cost effectiveness of thrombolytic therapy with tissue plasminogen activator as compared with streptokinase for acute myocardial infarction. N Engl J Med 1995; 332 (21): 1418–24

    PubMed  Article  CAS  Google Scholar 

  20. 20.

    Bryan S, Brown J. Extrapolation of cost—effectiveness information to local settings. Brunel: Brunel University, 1997. Health Economics Research Group (HERG) discussion paper no.: 17

    Google Scholar 

  21. 21.

    Gompertz B. On the nature of the of the function expressive of the law of human mortality. Phil Trans R Soc Lond 1825; 115: 513–85

    Article  Google Scholar 

  22. 22.

    Neilson S, Robinson I, Hunter M. Static and dynamic models of interdisease competition: past and projected mortality from amyotrophic lateral sclerosis and multiple sclerosis. Mech Ageing Dev 1993; 66: 223–41

    PubMed  Article  CAS  Google Scholar 

  23. 23.

    Miller DK, Homan SM. Determining transition probabilities: confusion and suggestions. Med Decis Making 1994; 14: 52–8

    PubMed  Article  CAS  Google Scholar 

  24. 24.

    Johannesson M. On the discounting of gained life—years in costeffectiveness analysis. Int J Technol Assess Health Care 1992; 8 (2): 359–64

    PubMed  Article  CAS  Google Scholar 

  25. 25.

    Parsonage M, Neuburger H. Discounting and health benefits. Health Econ 1992; 1 (1): 71–6

    PubMed  Article  CAS  Google Scholar 

  26. 26.

    Cairns J. Discounting and health benefits: another perspective. Health Econ 1992; 1 (1): 76–9

    PubMed  Article  CAS  Google Scholar 

  27. 27.

    Black N. Why we need observational studies to evaluate the effectiveness of health care. BMJ 1996; 312 (7040): 1215–8

    PubMed  Article  CAS  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Mr Andrew Briggs.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Briggs, A., Sculpher, M. An Introduction to Markov Modelling for Economic Evaluation. Pharmacoeconomics 13, 397–409 (1998). https://doi.org/10.2165/00019053-199813040-00003

Download citation

Keywords

  • Adis International Limited
  • Economic Evaluation
  • Markov Model
  • Markovian Assumption
  • Technol Assess Health