Advertisement

PharmacoEconomics

, Volume 34, Issue 2, pp 195–205 | Cite as

Using Classification and Regression Trees (CART) to Identify Prescribing Thresholds for Cardiovascular Disease

  • Chris SchillingEmail author
  • Duncan Mortimer
  • Kim Dalziel
  • Emma Heeley
  • John Chalmers
  • Philip Clarke
Original Research Article

Abstract

Background and Objective

Many guidelines for clinical decisions are hierarchical and nonlinear. Evaluating if these guidelines are used in practice requires methods that can identify such structures and thresholds. Classification and regression trees (CART) were used to analyse prescribing patterns of Australian general practitioners (GPs) for the primary prevention of cardiovascular disease (CVD). Our aim was to identify if GPs use absolute risk (AR) guidelines in favour of individual risk factors to inform their prescribing decisions of lipid-lowering medications.

Methods

We employed administrative prescribing information that is linked to patient-level data from a clinical assessment and patient survey (the AusHeart Study), and assessed prescribing of lipid-lowering medications over a 12-month period for patients (n = 1903) who were not using such medications prior to recruitment. CART models were developed to explain prescribing practice. Out-of-sample performance was evaluated using receiver operating characteristic (ROC) curves, and optimised via pruning.

Results

We found that individual risk factors (low-density lipoprotein, diabetes, triglycerides and a history of CVD), GP-estimated rather than Framingham AR, and sociodemographic factors (household income, education) were the predominant drivers of GP prescribing. However, sociodemographic factors and some individual risk factors (triglycerides and CVD history) only become relevant for patients with a particular profile of other risk factors. The ROC area under the curve was 0.63 (95 % confidence interval [CI] 0.60–0.64).

Conclusions

There is little evidence that AR guidelines recommended by the National Heart Foundation and National Vascular Disease Prevention Alliance, or conditional individual risk eligibility guidelines from the Pharmaceutical Benefits Scheme, are adopted in prescribing practice. The hierarchy of conditional relationships between risk factors and socioeconomic factors identified by CART provides new insights into prescribing decisions. Overall, CART is a useful addition to the analyst’s toolkit when investigating healthcare decisions.

Keywords

Absolute Risk Individual Risk Factor Pharmaceutical Benefit Scheme High Total Cholesterol National Heart Foundation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Notes

Acknowledgments

This work was supported by Monash University, the George Institute for Global Health, and the University of Melbourne.

Chris Schilling, Duncan Mortimer, Kim Dalziel, Emma Heeley, John Chalmers and Philip Clarke declare that they have no conflicts of interest.

Author contributions

CS, DM and KD conceptualized this report. All authors had input in developing the approach. CS produced multiple drafts. All authors provided input on the draft report and all read and approved the final report.

References

  1. 1.
    Bonner C, et al. General practitioners’ use of different cardiovascular risk assessment strategies: a qualitative study. Med J Aust. 2013;199(7):485–9.CrossRefPubMedGoogle Scholar
  2. 2.
    Jansen J, et al. General practitioners’ use of absolute risk versus individual risk factors in cardiovascular disease prevention: an experimental study. BMJ Open. 2014;4(5):e004812.PubMedCentralCrossRefPubMedGoogle Scholar
  3. 3.
    Greenland P, et al. 2010 ACCF/AHA guideline for assessment of cardiovascular risk in asymptomatic adults: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines developed in collaboration with the American Society of Echocardiography, American Society of Nuclear Cardiology, Society of Atherosclerosis Imaging and Prevention, Society for Cardiovascular Angiography and Interventions, Society of Cardiovascular Computed Tomography, and Society for Cardiovascular Magnetic Resonance. J Am Coll Cardiol. 2010;56(25):e50–103.CrossRefPubMedGoogle Scholar
  4. 4.
    Stone NJ, et al. 2013 ACC/AHA guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular risk in adults: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2014;63(25 Pt B):2889–934.Google Scholar
  5. 5.
    Lalor E, et al. National Vascular Disease Prevention Alliance. Guidelines for the management of absolute cardiovascular disease risk. 2012. ISBN 978–0–9872830–1–6. https://strokefoundation.com.au/~/media/strokewebsite/resources/treatment/absolutecvd_gl_webready.ashx?la=en.
  6. 6.
    National Heart Foundation of Australia. Guide to management of hypertension 2008. 2010. Available at: http://www.heartfoundation.org.au/SiteCollectionDocuments/HypertensionGuidelines2008to2010Update.pdf.
  7. 7.
    Heeley EL, et al. Cardiovascular risk perception and evidence-practice gaps in Australian general practice (the AusHEART study). Med J Aust. 2010;192(5):254–9.PubMedGoogle Scholar
  8. 8.
    Razavian M, et al. Cardiovascular risk management in chronic kidney disease in general practice (the AusHEART study). Nephrol Dial Transpl. 2012;27(4):1396–402.CrossRefGoogle Scholar
  9. 9.
    Zwar N, et al. GPs’ views of absolute cardiovascular risk and its role in primary prevention. Aust Fam Physician. 2005;34(6):503–4.PubMedGoogle Scholar
  10. 10.
    Varian HR. Big data: new tricks for econometrics. J Econ Perspect. 2014;28(2):3–27.CrossRefGoogle Scholar
  11. 11.
    Knott RJ, et al. How fair is Medicare? The income-related distribution of Medicare benefits with special focus on chronic care items. Med J Aust. 2012;197:625–30.CrossRefPubMedGoogle Scholar
  12. 12.
    Knott RJ, et al. The effects of reduced copayments on discontinuation and adherence failure to statin medication in Australia. Health Policy. 2015;119(5):620–7.CrossRefPubMedGoogle Scholar
  13. 13.
    Hothorn T, et al. Party: a laboratory for recursive partytioning. 2010. Available at: https://cran.r-project.org/web/packages/party/vignettes/party.pdf.
  14. 14.
    Drakopoulos SA. Hierarchical choice in economics. J Econ Surv. 1994;8(2):133–53.CrossRefGoogle Scholar
  15. 15.
    Scott A. Identifying and analysing dominant preferences in discrete choice experiments: an application in health care. J Econ Psychol. 2002;23(3):383–98.CrossRefGoogle Scholar
  16. 16.
    Pharmaceutical Benefits Scheme. General statement for lipid-lowering drugs prescribed as pharmaceutical benefits. Pharmaceutical Benefits Scheme; 2014.Google Scholar
  17. 17.
    Garg AX, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223–38.CrossRefPubMedGoogle Scholar
  18. 18.
    Berthold H, et al. Patterns and predictors of statin prescription in patients with type 2 diabetes. Cardiovasc Diabetol. 2009;8(1):25.PubMedCentralCrossRefPubMedGoogle Scholar
  19. 19.
    Wong M, et al. Patterns of antihypertensive prescribing, discontinuation and switching among a Hong Kong Chinese population from over one million prescriptions. J Hum Hypertens. 2008;22(10):714–6.CrossRefPubMedGoogle Scholar
  20. 20.
    Timofeev R. Classification and regression trees (CART) theory and applications. Humboldt-Universitat zu Berlin, Wirtschaftswissenschaftliche Fakultat. 2004. http://edoc.hu-berlin.de/docviews/abstract.php?id=26951.
  21. 21.
    Tomcikova D, et al. Epidemiology, quality improvement and outcome: risk of in-hospital mortality identified according to the typology of patients with acute heart failure: classification tree analysis on data from the Acute Heart Failure Database–main registry. J Crit Care. 2013;28:250–8.CrossRefPubMedGoogle Scholar
  22. 22.
    Navarro Mdel C, et al. Discriminative ability of heel quantitative ultrasound in postmenopausal women with prevalent vertebral fractures: application of optimal threshold cutoff values using classification and regression tree models. Calcif Tissue Int. 2012;91(2):114–20.CrossRefPubMedGoogle Scholar
  23. 23.
    Shi K-Q, et al. Risk stratification of spontaneous bacterial peritonitis in cirrhosis with ascites based on classification and regression tree analysis. Mol Biol Rep. 2012;39(5):6161–9.CrossRefPubMedGoogle Scholar
  24. 24.
    Breiman L, et al. Classification and regression trees. Boca Raton: CRC Press; 1984.Google Scholar
  25. 25.
    Torgo L. Inductive learning of tree-based regression models. Universidada do Porto. Reitoria. 1999. http://repositorio-aberto.up.pt/handle/10216/10018.
  26. 26.
    Briand B, et al. A similarity measure to assess the stability of classification trees. Comput Stat Data Anal. 2009;53(4):1208–17.CrossRefGoogle Scholar
  27. 27.
    Mohammed MA, El Sayed C, Marshall T. Patient and other factors influencing the prescribing of cardiovascular prevention therapy in the general practice setting with and without nurse assessment. Med Decis Making. 2012;32(3):498–506.CrossRefPubMedGoogle Scholar
  28. 28.
    The Mathworks Inc. Matlab and statistics toolbox release 2015a. Natick: The Mathworks; 2015.Google Scholar
  29. 29.
    Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. IJCAI. 1995;2:1137–43.Google Scholar
  30. 30.
    Kitsantas P, Hollander M, Li LM. Assessing the stability of classification trees using Florida birth data. J Stat Plan Inference. 2007;137(12):3917–29.CrossRefGoogle Scholar
  31. 31.
    Breiman L. Bagging predictors. Mach Learn. 1996;24(2):123–40.Google Scholar
  32. 32.
    Dannegger F. Tree stability diagnostics and some remedies for instability. Stat Med. 2000;19(4):475–91.CrossRefPubMedGoogle Scholar
  33. 33.
    Strobl C, Malley J, Tutz G. An introduction to recursive partitioning: rationale, application, and characteristics of classification and regression trees, bagging, and random forests. Psychol Methods. 2009;14(4):323.PubMedCentralCrossRefPubMedGoogle Scholar
  34. 34.
    Lopert R, Henry D. The Pharmaceutical Benefits Scheme: economic evaluation works… but is not a panacea. Aust Prescr. 2002;25(6):126.Google Scholar
  35. 35.
    French SD, et al. Evaluation of a theory-informed implementation intervention for the management of acute low back pain in general medical practice: the IMPLEMENT cluster randomised trial. PLoS One. 2013;8(6):e65471.PubMedCentralCrossRefPubMedGoogle Scholar
  36. 36.
    McKenzie JE, et al. Evidence-based care of older people with suspected cognitive impairment in general practice: protocol for the IRIS cluster randomised trial. Implement Sci. 2013;8(1):91.PubMedCentralCrossRefPubMedGoogle Scholar
  37. 37.
    McKenzie JE, et al. Improving the care for people with acute low-back pain by allied health professionals (the ALIGN trial): a cluster randomised trial protocol. Implement Sci. 2010;5(1):86.PubMedCentralCrossRefPubMedGoogle Scholar
  38. 38.
    Allen D, Harkins KJ. Too much guidance? Lancet. 2005;365(9473):1768.CrossRefPubMedGoogle Scholar
  39. 39.
    Prevedello LM, et al. Does clinical decision support reduce unwarranted variation in yield of CT pulmonary angiogram? Am J Med. 2013;126(11):975–81.PubMedCentralCrossRefPubMedGoogle Scholar
  40. 40.
    Cholesterol Treatment Trialists’ (CTT) Collaborators. Efficacy and safety of cholesterol-lowering treatment: prospective meta-analysis of data from 90,056 participants in 14 randomised trials of statins. Lancet. 2005;366(9493):1267–78.CrossRefGoogle Scholar
  41. 41.
    Kearney P, et al. Efficacy of cholesterol-lowering therapy in 18,686 people with diabetes in 14 randomised trials of statins: a meta-analysis. Lancet. 2008;371(9607):117–25.CrossRefPubMedGoogle Scholar
  42. 42.
    Ashworth M, et al. Social deprivation and statin prescribing: a cross-sectional analysis using data from the new UK general practitioner ‘Quality and Outcomes Framework’. J Public Health (Oxf). 2007;29(1):40–7.CrossRefGoogle Scholar
  43. 43.
    Weitoft GR, et al. Education and drug use in Sweden—a nationwide register-based study. Pharmacoepidemiol Drug Saf. 2008;17(10):1020–8.CrossRefPubMedGoogle Scholar
  44. 44.
    Heeley E, et al. Disparities between prescribing of secondary prevention therapies for stroke and coronary artery disease in general practice. Int J Stroke. 2012;7(8):649–54.CrossRefPubMedGoogle Scholar
  45. 45.
    Latry P, et al. Adherence with statins in a real-life setting is better when associated cardiovascular risk factors increase: a cohort study. BMC Cardiovasc Disord. 2011;11(1):46.PubMedCentralCrossRefPubMedGoogle Scholar
  46. 46.
    Field CA, Welsh AH. Bootstrapping clustered data. J R Stat Soc Series B Stat Methodol. 2007;69(3):369–90.CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Chris Schilling
    • 1
    Email author
  • Duncan Mortimer
    • 2
  • Kim Dalziel
    • 1
  • Emma Heeley
    • 3
  • John Chalmers
    • 3
  • Philip Clarke
    • 1
  1. 1.Centre for Health Policy, School of Population and Global HealthUniversity of MelbourneMelbourneAustralia
  2. 2.Centre for Health Economics, Monash Business SchoolMonash UniversityMelbourneAustralia
  3. 3.The George Institute for Global HealthThe University of Sydney and the Royal Prince Alfred HospitalSydneyAustralia

Personalised recommendations