Comparison of Data on Serious Adverse Events and Mortality in ClinicalTrials.gov, Corresponding Journal Articles, and FDA Medical Reviews: Cross-Sectional Analysis
Abstract
Introduction
Inconsistencies in data on serious adverse events (SAEs) and mortality in ClinicalTrials.gov and corresponding journal articles pose a challenge to research transparency.
Objective
The objective of this study was to compare data on SAEs and mortality from clinical trials reported in ClinicalTrials.gov and corresponding journal articles with US Food and Drug Administration (FDA) medical reviews.
Methods
We conducted a cross-sectional study of a randomly selected sample of new molecular entities approved during the study period 1 January 2013 to 31 December 2015. We extracted data on SAEs and mortality from 15 pivotal trials from ClinicalTrials.gov and corresponding journal articles (the two index resources), and FDA medical reviews (reference standard). We estimated the magnitude of deviations in rates of SAEs and mortality between the index resources and the reference standard.
Results
We found deviations in rates of SAEs (30% in ClinicalTrials.gov and 30% in corresponding journal articles) and mortality (72% in ClinicalTrials.gov and 53% in corresponding journal articles) when compared with the reference standard. The intra-class correlation coefficient between the three resources was 0.99 (95% confidence interval [CI] 0.98–0.99) for SAE rates and 0.99 (95% CI 0.97–0.99) for mortality rates.
Conclusion
There are differences in data on rates of SAEs and mortality in randomized clinical trials in both ClinicalTrials.gov and journal articles compared with FDA reviews. Further efforts should focus on decreasing existing discrepancies to enhance the transparency and reproducibility of data reporting in clinical trials.
Notes
Compliance with Ethical Standards
Funding
No sources of funding were used to assist in the preparation of this study.
Conflicts of interest
Richeek Pradhan and Sonal Singh have no conflicts of interest relevant to the content of this study.
Ethical standards
This research was conducted using publicly available data and did not entail any primary data collection from patients. No Independent Review Board approval was sought.
Supplementary material
References
- 1.WHO. Welcome to the WHO ICTRP. http://www.who.int/ictrp/en/. Accessed 10 Jul 2017.
- 2.ClinicalTrials.gov. https://clinicaltrials.gov/. Accessed 10 Jul 2017.
- 3.Zarin DA, Tse T, Williams RJ, Rajakannan T. Update on trial registration 11 years after the ICMJE policy was established. N Engl J Med. 2017;376:383–91.CrossRefPubMedPubMedCentralGoogle Scholar
- 4.Huang GD, Altemose JK, O’Leary TJ. Public access to clinical trials: lessons from an organizational implementation of policy. Contemp Clin Trials. 2017;57:87–9.CrossRefPubMedGoogle Scholar
- 5.Golder S, Loke YK, Wright K, Norman G. Reporting of adverse events in published and unpublished studies of health care interventions: a systematic review. PLoS Med. 2016;13:e1002127.CrossRefPubMedPubMedCentralGoogle Scholar
- 6.Tang E, Ravaud P, Riveros C, Perrodeau E, Dechartres A. Comparison of serious adverse events posted at ClinicalTrials.gov and published in corresponding journal articles. BMC Med. 2015;13:189.CrossRefPubMedPubMedCentralGoogle Scholar
- 7.Hartung DM, Zarin DA, Guise J-M, McDonagh M, Paynter R, Helfand M. Reporting discrepancies between the ClinicalTrials.gov results database and peer-reviewed publications. Ann Intern Med. 2014;160:477–83.CrossRefPubMedPubMedCentralGoogle Scholar
- 8.Earley A, Lau J, Uhlig K. Haphazard reporting of deaths in clinical trials: a review of cases of ClinicalTrials.gov records and matched publications-a cross-sectional study. BMJ Open. 2013. https://doi.org/10.1136/bmjopen-2012-001963.PubMedPubMedCentralGoogle Scholar
- 9.Schwartz LM, Woloshin S, Zheng E, Tse T, Zarin DA. ClinicalTrials.gov and Drugs@FDA: a comparison of results reporting for new drug approval trials. Ann Intern Med. 2016;165:421–30.CrossRefPubMedPubMedCentralGoogle Scholar
- 10.Golder S, Loke YK, Wright K, Sterrantino C. Most systematic reviews of adverse effects did not include unpublished data. J Clin Epidemiol. 2016;77:125–33.CrossRefPubMedGoogle Scholar
- 11.Mayo-Wilson E, Li T, Fusco N. Dickersin K; MUDS investigators. Practical guidance for using multiple data sources in systematic reviews and meta-analyses (with examples from the MUDS study). Res Synth Methods. 2018;9(1):2–12.CrossRefPubMedGoogle Scholar
- 12.Center for Drug Evaluation and Research. New drugs at FDA: CDER’s new molecular entities and new therapeutic biological products. https://www.fda.gov/Drugs/DevelopmentApprovalProcess/DrugInnovation/. Accessed 7 Dec 2017.
- 13.Ross JS, Tse T, Zarin DA, Xu H, Zhou L, Krumholz HM. Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ. 2012;344:d7292.CrossRefPubMedPubMedCentralGoogle Scholar
- 14.U.S. Food and Drug Administration. IND safety reporting. 21 CFR §312.32(a).Google Scholar
- 15.Drugs@FDA. FDA approved drug products. https://www.accessdata.fda.gov/scripts/cder/daf/. Accessed 10 Jul 2017.
- 16.Knepper D, Fenske C, Nadolny P, Bedding A, Gribkova E, Polzer J, Neumann J, Wilson B, Benedict J, Lawton A. Detecting data quality issues in clinical trials: current practices and recommendations. Ther Innovation Regul Sci. 2016;50:15–21.CrossRefGoogle Scholar
- 17.George SL, Buyse M. Data fraud in clinical trials. Clin Investig. 2015;5:161–73.CrossRefGoogle Scholar
- 18.Singh S, Loke YK. Drug safety assessment in clinical trials: methodological challenges and opportunities. Trials. 2012;13:138.CrossRefPubMedPubMedCentralGoogle Scholar
- 19.Zorzela L, Loke YK, Ioannidis JP, Golder S, Santaguida P, Altman DG, et al. PRISMA harms checklist: improving harms reporting in systematic reviews. BMJ. 2016;352:i157.CrossRefPubMedGoogle Scholar