Skip to main content

Advertisement

Log in

Regression discontinuity design to evaluate the effect of statins on myocardial infarction in electronic health records

  • METHODS
  • Published:
European Journal of Epidemiology Aims and scope Submit manuscript

Abstract

Regression discontinuity design (RDD) is a quasi-experimental method intended for causal inference in observational settings. While RDD is gaining popularity in clinical studies, there are limited real-world studies examining the performance on estimating known trial casual effects. The goal of this paper is to estimate the effect of statins on myocardial infarction (MI) using RDD and compare with propensity score matching and Cox regression. For the RDD, we leveraged a 2008 UK guideline that recommends statins if a patient’s 10-year cardiovascular disease (CVD) risk score > 20%. We used UK electronic health record data from the Health Improvement Network on 49,242 patients aged 65 + in 2008–2011 (baseline) without a history of CVD and no statin use in the two years prior to the CVD risk score assessment. Both the regression discontinuity (n = 19,432) and the propensity score matched populations (n = 24,814) demonstrated good balance of confounders. Using RDD, the adjusted point estimate for statins on MI was in the protective direction and similar to the statin effect observed in clinical trials, although the confidence interval included the null (HR = 0.8, 95% CI 0.4, 1.4). Conversely, the adjusted estimates using propensity score matching and Cox regression remained in the harmful direction: HR = 2.42 (95% CI 1.96, 2.99) and 2.51 (2.12, 2.97). RDD appeared superior to other methods in replicating the known protective effect of statins with MI, although precision was poor. Our findings suggest that, when used appropriately, RDD can expand the scope of clinical investigations aimed at causal inference by leveraging treatment rules from everyday clinical practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Data availability

THIN data cannot be shared publicly because of constraints dictated by the study’s ethics approval and Institutional review board restrictions. The IQVIA Medical Research Data, incorporating The Health Improvement Network (THIN), a Cegedim database of electronic health records. The lead and senior authors affirm that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

References

  1. Cholesterol Treatment Trialists C, Fulcher J, O'Connell R, et al. Efficacy and safety of LDL-lowering therapy among men and women: meta-analysis of individual data from 174,000 participants in 27 randomised trials. Lancet. 2015;385(9976):1397–1405.

  2. Force UPST. Statin use for the primary prevention of cardiovascular disease in adults: US preventive services task force recommendation statement. JAMA. 2022;328(8):746–53.

    Article  Google Scholar 

  3. Shepherd J, Blauw GJ, Murphy MB, et al. Pravastatin in elderly individuals at risk of vascular disease (PROSPER): a randomised controlled trial. Lancet (Lond Engl). 2002;360(9346):1623–30.

    Article  CAS  Google Scholar 

  4. Han BH, Sutin D, Williamson JD, et al. Effect of statin treatment vs usual care on primary cardiovascular prevention among older adults: the ALLHAT-LLT randomized clinical trial. JAMA Intern Med. 2017;177(7):955–65.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Venkataramani AS, Bor J, Jena AB. Regression discontinuity designs in healthcare research. BMJ. 2016;352: i1216.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Wallace J, Jiang K, Goldsmith-Pinkham P, Song Z. Changes in racial and ethnic disparities in access to care and health among US adults at age 65 years. JAMA Intern Med. 2021;181(9):1207–15.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Fukuma S, Iizuka T, Ikenoue T, Tsugawa Y. Association of the national health guidance intervention for obesity and cardiovascular risks with health outcomes among Japanese men. JAMA Intern Med. 2020;180(12):1630–7.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Maciejewski ML, Basu A. Regression discontinuity design. JAMA. 2020;324(4):381–2.

    Article  PubMed  Google Scholar 

  9. Desai S, McWilliams JM. Consequences of the 340B drug pricing program. N Engl J Med. 2018;378(6):539–48.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Hutcheon JA, Harper S, Liauw J, Skoll MA, Srour M, Strumpf EC. Antenatal corticosteroid administration and early school age child development: a regression discontinuity study in British Columbia, Canada. PLoS Med. 2020;17(12):e1003435.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Goulden R, Rowe BH, Abrahamowicz M, Strumpf E, Tamblyn R. Association of intravenous radiocontrast with kidney function: a regression discontinuity analysis. JAMA Intern Med. 2021;181(6):767–74.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Melamed A, Fink G, Wright AA, et al. Effect of adoption of neoadjuvant chemotherapy for advanced ovarian cancer on all cause mortality: quasi-experimental study. BMJ (Clin Res Ed). 2018;360: j5463.

    Article  Google Scholar 

  13. Chen S, Sudharsanan N, Huang F, Liu Y, Geldsetzer P, Bärnighausen T. Impact of community based screening for hypertension on blood pressure after two years: regression discontinuity analysis in a national cohort of older adults in China. BMJ. 2019;366:l4064.

  14. Sudharsanan N, Chen S, Barnighausen T, Geldsetzer P. The effect of home-based hypertension screening on blood pressure change over time in South Africa. Health Aff (Millwood). 2020;39(1):124–132.

  15. Cattaneo MD, Titiunik R. Regression discontinuity designs. Ann. Rev Econ. 2022;14 (forthcoming).

  16. Hahn J, Todd P, Van der Klaauw W. Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica. 2001;69(1):201–209

  17. Lee DS, Lemieux T. Regression discontinuity designs in economics. J Econ Lit. 2010;48(2):281–355.

    Article  Google Scholar 

  18. Thistlethwaite DL, Campbell DT. Regression-discontinuity analysis: An alternative to the ex post facto experiment. J Educ Psychol. 1960;51:309–317.

  19. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, Brindle P. Performance of the QRISK cardiovascular risk prediction algorithm in an independent UK sample of patients from general practice: a validation study. Heart. 2008;94(1):34–9.

    Article  CAS  PubMed  Google Scholar 

  20. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70(1):41–55.

    Article  Google Scholar 

  21. Smith LM, Lévesque LE, Kaufman JS, Strumpf EC. Strategies for evaluating the assumptions of the regression discontinuity design: a case study using a human papillomavirus vaccination programme. Int J Epidemiol. 2016;46(3):939–49.

    PubMed Central  Google Scholar 

  22. Cattaneo MD, Idrobo N, Titiunik R. A practical introduction to regression discontinuity designs: foundations. Cambridge: Cambridge University Press; 2019.

    Book  Google Scholar 

  23. Blak BT, Thompson M, Dattani H, Bourke A. Generalisability of The Health Improvement Network (THIN) database: demographics, chronic disease prevalence and mortality rates. Inform Prim Care. 2011;19(4):251–5.

    PubMed  Google Scholar 

  24. Danaei G, Garcia Rodriguez LA, Fernandez Cantero O, Hernan MA. Statins and risk of diabetes: an analysis of electronic medical records to evaluate possible bias due to differential survival. Diabetes Care. 2013;36(5):1236–40.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Smeeth L, Douglas I, Hall AJ, Hubbard R, Evans S. Effect of statins on a wide range of health outcomes: a cohort study validated by comparison with randomized trials. Br J Clin Pharmacol. 2009;67(1):99–109.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Lewis JD, Schinnar R, Bilker WB, Wang X, Strom BL. Validation studies of the health improvement network (THIN) database for pharmacoepidemiology research. Pharmacoepidemiol Drug Saf. 2007;16(4):393–401.

    Article  PubMed  Google Scholar 

  27. Maguire A, Blak BT, Thompson M. The importance of defining periods of complete mortality reporting for research using automated data from primary care. Pharmacoepidemiol Drug Saf. 2009;18(1):76–83.

    Article  PubMed  Google Scholar 

  28. Ruigomez A, Martin-Merino E, Rodriguez LA. Validation of ischemic cerebrovascular diagnoses in the health improvement network (THIN). Pharmacoepidemiol Drug Saf. 2010;19(6):579–85.

    Article  PubMed  Google Scholar 

  29. Bourke A, Dattani H, Robinson M. Feasibility study and methodology to create a quality-evaluated database of primary care data. Inform Prim Care. 2004;12:171–7.

    PubMed  Google Scholar 

  30. Anderson KM, Odell PM, Wilson PW, Kannel WB. Cardiovascular disease risk profiles. Am Heart J. 1991;121(1 Pt 2):293–8.

    Article  CAS  PubMed  Google Scholar 

  31. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, May M, Brindle P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ. 2007;335(7611):136.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Hippisley-Cox J, Coupland C, Vinogradova Y, et al. Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2. BMJ. 2008;336(7659):1475–82.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Garcia Rodriguez LA, Perez GS. Use of the UK general practice research database for pharmacoepidemiology. Br J Clin Pharmacol. 1998;45(5):419–25.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Dave S, Petersen I. Creating medical and drug code lists to identify cases in primary care databases. Pharmacoepidemiol Drug Saf. 2009;18(8):704–7.

    Article  PubMed  Google Scholar 

  35. Chisholm J. The Read clinical classification. BMJ. 1990;300(6732):1092.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Calonico S, Cattaneo MD, Titiunik R. Robust nonparametric confidence intervals for regression-discontinuity designs. Econometrica. 2014;82(6):2295–326.

    Article  Google Scholar 

  37. Calonico S, Cattaneo MD, Titiunik R. Optimal data-driven regression discontinuity plots. J Am Stat Assoc. 2015;110(512):1753–69.

    Article  CAS  Google Scholar 

  38. Imbens G, Kalyanaraman K. Optimal bandwidth choice for the regression discontinuity estimator. Rev Econ Stud. 2011;79(3):933–59.

    Article  Google Scholar 

  39. Calonico S, Cattaneo MD, Farrell MH, Titiunik R. Regression discontinuity designs using covariates. Rev Econ Stat. 2019;101(3):442–51.

    Article  Google Scholar 

  40. Calonico S, Cattaneo MD, Farrell MH, Titiunik R. rdrobust: software for regression-discontinuity designs. Stata J. 2017;17(2):372–404.

    Article  Google Scholar 

  41. Cholesterol Treatment Trialists C, Baigent C, Blackwell L, et al. Efficacy and safety of more intensive lowering of LDL cholesterol: a meta-analysis of data from 170,000 participants in 26 randomised trials. Lancet. 2010;376(9753):1670–1681.

  42. Geneletti S, O’Keeffe AG, Sharples LD, Richardson S, Baio G. Bayesian regression discontinuity designs: incorporating clinical knowledge in the causal analysis of primary care data. Stat Med. 2015;34(15):2334–52.

    Article  PubMed  PubMed Central  Google Scholar 

  43. O’Keeffe AG, Geneletti S, Baio G, Sharples LD, Nazareth I, Petersen I. Regression discontinuity designs: an approach to the evaluation of treatment efficacy in primary care using observational data. BMJ (Clinical research ed). 2014;349:g5293.

    PubMed  Google Scholar 

  44. Cohen JD, Brinton EA, Ito MK, Jacobson TA. Understanding Statin Use in America and Gaps in Patient Education (USAGE): an internet-based survey of 10,138 current and former statin users. J Clin Lipidol. 2012;6(3):208–15.

    Article  PubMed  Google Scholar 

  45. Lauffenburger JC, Robinson JG, Oramasionwu C, Fang G. Racial/Ethnic and gender gaps in the use of and adherence to evidence-based preventive therapies among elderly Medicare Part D beneficiaries after acute myocardial infarction. Circulation. 2014;129(7):754–63.

    Article  PubMed  Google Scholar 

  46. Jackevicius CA, Mamdani M, Tu JV. Adherence with statin therapy in elderly patients with and without acute coronary syndromes. JAMA. 2002;288(4):462–7.

    Article  PubMed  Google Scholar 

  47. Adams J, Ryan V, White M. How accurate are Townsend Deprivation Scores as predictors of self-reported health? A comparison with individual level data. J Public Health (Oxf). 2005;27(1):101–6.

    Article  CAS  PubMed  Google Scholar 

  48. Yusuf S, Bosch J, Dagenais G, et al. Cholesterol lowering in intermediate-risk persons without cardiovascular disease. N Engl J Med. 2016;374(21):2021–31.

    Article  CAS  PubMed  Google Scholar 

  49. Sattar N, Preiss D, Murray HM, et al. Statins and risk of incident diabetes: a collaborative meta-analysis of randomised statin trials. Lancet. 2010;375(9716):735–42.

    Article  CAS  PubMed  Google Scholar 

  50. Ridker PM, Danielson E, Fonseca FA, et al. Rosuvastatin to prevent vascular events in men and women with elevated C-reactive protein. N Engl J Med. 2008;359(21):2195–207.

    Article  CAS  PubMed  Google Scholar 

  51. Officers A, Coordinators for the ACRGTA, Lipid-Lowering Treatment to Prevent Heart Attack T. Major outcomes in moderately hypercholesterolemic, hypertensive patients randomized to pravastatin vs usual care: The Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial (ALLHAT-LLT). JAMA. 2002;288(23):2998–3007.

Download references

Acknowledgements

We thank all members and participants of The Health Improvement Network (THIN). The THIN team includes study coordinators, research scientists, statisticians, data managers, data entry staff, health providers, and administrative assistants, who make this de-identified and anonymized data source possible.

Funding

This work was funded by R56-AG061177 from the National Institute on Aging.

Author information

Authors and Affiliations

Authors

Contributions

AZ, MO, and SC designed and conceptualized the study. AZhang and AT curated the data. AZhang, NJ, and AT conducted the analysis. SC provided statistical and methodological support for the RDD analysis. MO and AZ wrote the original draft of the manuscript. All authors discussed results and commented on the manuscript. AZ, SC and MO supervised the project and acquired funding. All authors accept responsibility to submit for publication. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

Corresponding author

Correspondence to Michelle C. Odden.

Ethics declarations

Competing interests

Authors report no conflicts of interest.

Ethics approval

The most recent ethics approval was from the Columbia University Institutional Review Board, Protocol Number AAAS7732 (M00Y01).

Consent to participate

Informed consent was obtained for all individual participants included in the study.

Consent to publish

The authors affirm that human research participants provided informed consent for the publication of data that is collected and analyzed from The Health Improvement Network (THIN).

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 658 kb)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Odden, M.C., Zhang, A., Jawadekar, N. et al. Regression discontinuity design to evaluate the effect of statins on myocardial infarction in electronic health records. Eur J Epidemiol 38, 393–402 (2023). https://doi.org/10.1007/s10654-023-00982-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10654-023-00982-w

Keywords

Navigation