Skip to main content
Log in

The perpetual need of randomized clinical trials: challenges and uncertainties in emulating the REDUCE-AMI trial

  • COMMENTARY
  • Published:
European Journal of Epidemiology Aims and scope Submit manuscript

Abstract

Trial emulations in observational data analyses can complement findings from randomized clinical trials, inform future trial designs, or generate evidence when randomized studies are not feasible due to resource constraints and ethical or practical limitations. Importantly, trial emulation designs facilitate causal inference in observational data analyses by enhancing counterfactual thinking and comparisons of real-world observations (e.g. Mendelian Randomization) to hypothetical interventions. In order to enhance credibility, trial emulations would benefit from prospective registration, publication of statistical analysis plans, and subsequent prospective benchmarking to randomized clinical trials prior to their publication. Confounding by indication, however, is the key challenge to interpreting observed intended effects of an intervention as causal in observational data analyses. We discuss the target trial emulation of the REDUCE-AMI randomized clinical trial (ClinicalTrials.gov ID NCT03278509; beta-blocker use in patients with preserved left ventricular ejection fraction after myocardial infarction) to illustrate the challenges and uncertainties of studying intended effects of interventions without randomization to account for confounding. We furthermore directly compare the findings, statistical power, and clinical interpretation of the results of the REDUCE-AMI target trial emulation to those from the simultaneously published randomized clinical trial. The complexity and subtlety of confounding by indication when studying intended effects of interventions can generally only be addressed by randomization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. Miettinen OS. The need for randomization in the study of intended effects. Stat Med. 1983;2(2):267–71. https://doi.org/10.1002/sim.4780020222.

    Article  CAS  PubMed  Google Scholar 

  2. Salas M, Hofman A, Stricker BH. Confounding by indication: an example of variation in the use of epidemiologic terminology. Am J Epidemiol. 1999;149(11):981–3. https://doi.org/10.1093/oxfordjournals.aje.a009758.

    Article  CAS  PubMed  Google Scholar 

  3. Executive summary of the third report of the National Cholesterol Education Program (NCEP). Expert panel on detection, evaluation, and treatment of high blood cholesterol in adults (Adult Treatment Panel III). JAMA. 2001;285(19):2486–97. https://doi.org/10.1001/jama.285.19.2486.

    Article  Google Scholar 

  4. Blood Pressure Lowering Treatment Trialists Collaboration. Pharmacological blood pressure lowering for primary and secondary prevention of cardiovascular disease across different levels of blood pressure: an individual participant-level data meta-analysis. Lancet. 2021;397(10285):1625–36. https://doi.org/10.1016/S0140-6736(21)00590-0.

    Article  Google Scholar 

  5. Matthews AA, Dahabreh IJ, MacDonald CJ et al. Prospective benchmarking of an observational analysis in the SWEDEHEART registry against the REDUCE-AMI randomized trial. Eur J Epidemiol. 2024:Epub ahead of print. https://doi.org/10.1007/s10654-024-01119-3.

  6. Yndigegn T, Lindahl B, Alfredsson J, et al. Design and rationale of randomized evaluation of decreased usage of beta-blockers after acute myocardial infarction (REDUCE-AMI). Eur Heart J Cardiovasc Pharmacother. 2023;9(2):192–7. https://doi.org/10.1093/ehjcvp/pvac070.

    Article  PubMed  Google Scholar 

  7. Yndigegn T, Lindahl B, Mars K, et al. Beta-blockers after myocardial infarction and preserved ejection fraction. N Engl J Med. 2024;390(15):1372–81. https://doi.org/10.1056/NEJMoa2401479.

    Article  CAS  PubMed  Google Scholar 

  8. Gamble C, Krishan A, Stocken D, et al. Guidelines for the content of statistical analysis plans in clinical trials. JAMA. 2017;318(23):2337–43. https://doi.org/10.1001/jama.2017.18556.

    Article  PubMed  Google Scholar 

  9. Hemming K, Kearney A, Gamble C, et al. Prospective reporting of statistical analysis plans for randomised controlled trials. Trials. 2020;21(1):898. https://doi.org/10.1186/s13063-020-04828-8.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Fonarow GC. Randomization–there is no substitute. JAMA Cardiol. 2016;1(6):633–5. https://doi.org/10.1001/jamacardio.2016.1792.

    Article  PubMed  Google Scholar 

  11. Van Spall HG, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA. 2007;297(11):1233–40. https://doi.org/10.1001/jama.297.11.1233.

    Article  PubMed  Google Scholar 

  12. Harrell FE. Randomized clinical trials do not mimic clinical practice, thank goodness. 2023. https://www.fharrell.com/post/rct-mimic/. Accessed 25 March 2024.

  13. Rothwell PM. Can overall results of clinical trials be applied to all patients? Lancet. 1995;345(8965):1616–9. https://doi.org/10.1016/s0140-6736(95)90120-5.

    Article  CAS  PubMed  Google Scholar 

  14. Kent DM, Hayward RA. Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. JAMA. 2007;298(10):1209–12. https://doi.org/10.1001/jama.298.10.1209.

    Article  CAS  PubMed  Google Scholar 

  15. Takahashi K, Serruys PW, Fuster V, et al. Redevelopment and validation of the SYNTAX score II to individualise decision making between percutaneous and surgical revascularisation in patients with complex coronary artery disease: secondary analysis of the multicentre randomised controlled SYNTAXES trial with external cohort validation. Lancet. 2020;396(10260):1399–412. https://doi.org/10.1016/S0140-6736(20)32114-0.

    Article  PubMed  Google Scholar 

  16. Dorresteijn JA, Visseren FL, Ridker PM, et al. Estimating treatment effects for individual patients based on the results of randomised clinical trials. BMJ. 2011;343:d5888. https://doi.org/10.1136/bmj.d5888.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Collins R, Bowman L, Landray M, Peto R. The magic of randomization versus the myth of real-world evidence. N Engl J Med. 2020;382(7):674–8. https://doi.org/10.1056/NEJMsb1901642.

    Article  PubMed  Google Scholar 

  18. Matthews AA, Young JC, Kurth T. The target trial framework in clinical epidemiology: principles and applications. J Clin Epidemiol. 2023;164:112–5. https://doi.org/10.1016/j.jclinepi.2023.10.008.

    Article  PubMed  Google Scholar 

  19. Ference BA, Graham I, Tokgozoglu L, Catapano AL. Impact of lipids on cardiovascular health: JACC health promotion series. J Am Coll Cardiol. 2018;72(10):1141–56. https://doi.org/10.1016/j.jacc.2018.06.046.

    Article  CAS  PubMed  Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

MJGL conceived and drafted the manuscript. All authors commented on the previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Maarten J.G. Leening.

Ethics declarations

Conflict of interest

MJGL reports receiving speaker fees from Sanofi, Novartis, and Daiichi Sankyo; and served on advisory boards for Boehringer Ingelheim; and Sanofi; all unrelated to the topic of this manuscript. EB is a member of the Dutch Medicines Evaluation Board (CBG); opinions expressed in this commentary are his own and do not necessarily those of the CBG.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Maarten J.G. Leening, Editor, European Journal of Epidemiology.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leening, M.J., Boersma, E. The perpetual need of randomized clinical trials: challenges and uncertainties in emulating the REDUCE-AMI trial. Eur J Epidemiol 39, 343–347 (2024). https://doi.org/10.1007/s10654-024-01127-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10654-024-01127-3

Keywords

Navigation