Advertisement

Intensive Care Medicine

, Volume 40, Issue 5, pp 700–722 | Cite as

Registration and design alterations of clinical trials in critical care: a cross-sectional observational study

  • Vijay Anand
  • Damon C. Scales
  • Christopher S. Parshuram
  • Brian P. KavanaghEmail author
Original

Abstract

Purpose

In 2005 the International Committee of Medical Journal Editors issued a requirement that all randomized controlled trials (RCTs) be registered primarily to prevent selective reporting (publication bias). However, registries allow for alterations in study protocol. Changes occurring before (or after) study completion could invalidate the original study intent, leading to publication of misleading conclusions. In RCTs involving critically ill patients, these concerns may be particularly acute because mortality is high and conditions investigated are usually syndromes rather than specific diseases. This study was conducted to estimate the registration rate of RCTs in critical care; and, among registered RCTs, to determine timing of registration and whether sample size or primary outcome were altered.

Methods

We searched the MEDLINE database for RCTs that began after or continued through July 2005. We determined whether each trial had been registered and, for registered trials, compared registry data to data in the published manuscript.

Results

Approximately two-thirds (66 %) of trials were registered. Of these, 66 % of registrations occurred after enrolment had commenced. Overall, 6 % (5/90) of trials appropriately registered a sample size which was unchanged from the interval between registration and publication, and only 12 % (11/90) reported primary outcomes that were both appropriately registered and unchanged.

Conclusions

Non-registration, or registration after trial initiation, are common in RCTs of critically ill patients. Among registered trials important protocol changes are often made between trial commencement and publication. This study identifies and quantifies the extent of this serious—but correctable—problem for RCTs in critically ill patients.

Keywords

Registration Critical care Registry Sample size Primary outcome 

Notes

Conflicts of interest

None.

References

  1. 1.
    Sacks H, Chalmers T, Smith H Jr (1982) Randomized versus historical controls for clinical trials. Am J Med 72:233–240PubMedCrossRefGoogle Scholar
  2. 2.
    Sozu T, Sugimoto T, Hamasaki T (2010) Sample size determination in clinical trials with multiple co-primary binary endpoints. Stat Med 29(21):2169–2179PubMedCrossRefGoogle Scholar
  3. 3.
    De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R et al (2004) Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med 351(12):1250–1251PubMedCrossRefGoogle Scholar
  4. 4.
    Abraham E (2005) The AJRCCM in 2005. Am J Respir Crit Care Med 171(1):1–2CrossRefGoogle Scholar
  5. 5.
    Kirillova O (2012) Results and outcome reporting in ClinicalTrials.gov, what makes it happen? PLoS One 7(6):e37847PubMedCentralPubMedCrossRefGoogle Scholar
  6. 6.
    Mathieu S, Moher D, Altman DG (2009) Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 302(9):977–984PubMedCrossRefGoogle Scholar
  7. 7.
    Silverman HJ (2004) The acute respiratory distress syndrome network controversy: lessons and legacy. Curr Opin Crit Care 10:560–564PubMedCrossRefGoogle Scholar
  8. 8.
    Silverman WA (2004) Personal reflections on lessons learned from randomized trials involving newborn infants from 1951 to 1967. Clin Trials 1:179–184PubMedCrossRefGoogle Scholar
  9. 9.
    Flanagan BM, Philpott S, Strosberg MA (2011) Protecting participants of clinical trials conducted in the intensive care unit. J Intensive Care Med 26(4):237–249PubMedCrossRefGoogle Scholar
  10. 10.
    Halpern SD (2002) Prospective preference assessment: a method to enhance the ethics and efficiency of randomized controlled trials. Control Clin Trials 23(3):274–288PubMedCrossRefGoogle Scholar
  11. 11.
    Ospina-Tascón GA, Büchele GL, Vincent J-L (2008) Multicenter, randomized, controlled trials evaluating mortality in intensive care: doomed to fail? Crit Care Med 36(4):1311–1322PubMedCrossRefGoogle Scholar
  12. 12.
    Hannink G, Gooszen HG, Rovers MM (2013) Comparison of registered and published primary outcomes in randomized clinical trials of surgical interventions. Ann Surg 257(5):818–823PubMedCrossRefGoogle Scholar
  13. 13.
    Milette K, Roseman M, Thombs BD (2011) Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: a systematic review. J Psychosom Res 70(3):205–217PubMedCrossRefGoogle Scholar
  14. 14.
    Zarin DA, Tse T, Ide NC (2005) Trial registration at ClinicalTrials.gov between May and October 2005. N Engl J Med 353(26):2779–2787PubMedCentralPubMedCrossRefGoogle Scholar
  15. 15.
    Aberegg SK, Richards DR, O’Brien JM (2010) Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care 14(2):R77PubMedCentralPubMedCrossRefGoogle Scholar
  16. 16.
    Bassler D, Briel M, Montori VM, Lane M, Glasziou P, Zhou Q et al (2010) Stopping randomized trials early for benefit and estimation of treatment effects. JAMA 303(12):1180–1187PubMedCrossRefGoogle Scholar
  17. 17.
    Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G (2008) Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol 61(3):241–246PubMedCrossRefGoogle Scholar
  18. 18.
    Phua J, Badia JR, Adhikari NK, Friedrich JO, Fowler RA, Singh JM et al (2009) Has mortality from acute respiratory distress syndrome decreased over time? A systematic review. Am J Respir Crit Care Med 179(3):220–227PubMedCrossRefGoogle Scholar
  19. 19.
    Iwashyna TJ (2010) Survivorship will be the defining challenge of critical care in the 21st century. Ann Intern Med 153:204–205PubMedCrossRefGoogle Scholar
  20. 20.
    Kahn JM, Benson NM, Appleby D, Carson SS, Iwashyna TJ (2010) Long-term acute care hospital utilization after critical illness. JAMA 303(22):2253–2259PubMedCentralPubMedCrossRefGoogle Scholar
  21. 21.
    Iwashyna TJ, Ely EW, Smith DM, Langa KM (2010) Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA 304(16):1787–1794PubMedCentralPubMedCrossRefGoogle Scholar
  22. 22.
    Herridge MS, Tansey CM, Matte A, Tomlinson G, Diaz-granados N, Cooper A et al (2011) Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med 364(14):1293–1304Google Scholar
  23. 23.
    Bienvenu OJ, Colantuoni E, Mendez-Tellez PA, Dinglas VD, Shanholtz C, Husain N et al (2012) Depressive symptoms and impaired physical function after acute lung injury: a 2-year longitudinal study. Am J Respir Crit Care Med 185(5):517–524PubMedCentralPubMedCrossRefGoogle Scholar
  24. 24.
    Unroe M, Kahn JM, Carson SS, Govert JA, Martinu T, Sathy SJ et al (2013) One-year trajectories of care and resource utilization for recipients of prolonged mechanical ventilation. Ann Intern Med 153(3):167–175CrossRefGoogle Scholar
  25. 25.
    Silverman H (2011) Protecting vulnerable research subjects in critical care trials: enhancing the informed consent process and recommendations for safeguards. Ann Intensive Care 1(1):8PubMedCentralPubMedCrossRefGoogle Scholar
  26. 26.
    Sekeres M, Gold JL, Chan A-W, Lexchin J, Moher D, Van Laethem MLP et al (2008) Poor reporting of scientific leadership information in clinical trial registers. PLoS One 3(2):e1610PubMedCentralPubMedCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg and ESICM 2014

Authors and Affiliations

  • Vijay Anand
    • 1
  • Damon C. Scales
    • 5
    • 6
    • 7
    • 8
  • Christopher S. Parshuram
    • 2
    • 4
    • 5
    • 8
  • Brian P. Kavanagh
    • 2
    • 3
    • 5
    Email author
  1. 1.Department of Critical Care Medicine, Stollery Children’s HospitalUniversity of AlbertaEdmontonCanada
  2. 2.Department of Critical Care Medicine, Hospital for Sick ChildrenUniversity of TorontoTorontoCanada
  3. 3.Department of Anesthesia, Hospital for Sick ChildrenUniversity of TorontoTorontoCanada
  4. 4.Department of Pediatrics, Hospital for Sick ChildrenUniversity of TorontoTorontoCanada
  5. 5.Interdepartmental Division of Critical CareUniversity of TorontoTorontoCanada
  6. 6.Department of Critical Care Medicine, Sunnybrook Health Sciences CentreUniversity of TorontoTorontoCanada
  7. 7.Department of Medicine, Sunnybrook Health Sciences CentreUniversity of TorontoTorontoCanada
  8. 8.Institute of Health Policy, Management and EvaluationUniversity of TorontoTorontoCanada

Personalised recommendations