Intensive Care Medicine

, Volume 41, Issue 6, pp 1089–1098 | Cite as

Feasibility and utility of the use of real time random safety audits in adult ICU patients: a multicentre study

  • M. BodíEmail author
  • M. Olona
  • M. C. Martín
  • R. Alceaga
  • J. C. Rodríguez
  • E. Corral
  • J. M. Pérez Villares
  • G. Sirgo



The two aims of this study were first to analyse the feasibility and utility (to improve the care process) of implementing a new real time random safety tool and second to explore the efficacy of this tool in core hospitals (those participating in tool design) versus non-core hospitals.


This was a prospective study conducted over a period of 4 months in six adult intensive care units (two of which were core hospitals). Safety audits were conducted 3 days per week during the entire study period to determine the efficacy of the 37 safety measures (grouped into ten blocks). In each audit, 50 % of patients and 50 % of measures were randomized. Feasibility was calculated as the proportion of audits completed over those scheduled and time spent, and utility was defined as the changes in the care process resulting from tool application.


A total of 1323 patient-days were analysed. In terms of feasibility, 87.6 % of the scheduled audits were completed. The average time spent per audit was 34.5 ± 29 min. Globally, changes in the care process occurred in 5.4 % of the measures analysed. In core hospitals, utility was significantly higher in 16 of the 37 measures, all of which were included in good clinical practice guidelines. Most of the clinical changes brought about by the tool occurred in the mechanical ventilation and haemodynamics blocks. Multivariate analyses demonstrated that changes in the care process in each block were associated with the core hospital variable, staffing ratios and severity of patient disease.


Real time safety audits improved the care process and adherence to the clinical practice guidelines and proved to be most useful in situations of high care load and in patients with more severe disease. The effect was greater in core hospitals.


Safety Intensive care unit Critical patients Real time safety audits 



This study was supported by grants from the Fondo de Investigación Sanitaria (Institute of Health Carlos III from Spain, FIS grants, project PI11/02311). The project is endorsed by the Work Group on Planning, Organization and Management of the Spanish Society of Intensive Medicine and was awarded second prize for the best communication at the National Congress of the Spanish Society of Intensive Medicine, 2014.

Supplementary material

134_2015_3792_MOESM1_ESM.pdf (163 kb)
Supplementary material 1 (PDF 162 kb)


  1. 1.
    Merino P, Álvarez J, Martín MC, Alonso A, Gutiérrez I, SYREC study investigators (2012) Adverse events in Spanish intensive care units: the SYREC study. Adverse events in Spanish intensive care units: the SYREC study. Int J Qual Health Care 24:105–113PubMedCrossRefGoogle Scholar
  2. 2.
    Donchin Y, Gopher D, Olin M, Badihi Y, Biesky M, Sprung CL, Pizov R, Cotev S (2003) A look into the nature and causes of human errors in the intensive care unit 1995. Qual Saf Health Care 12:143–147PubMedCentralPubMedCrossRefGoogle Scholar
  3. 3.
    Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR (1999) Why don’t physicians follow clinical practice guidelines?A framework for improvement. JAMA 282:1458–1465PubMedCrossRefGoogle Scholar
  4. 4.
    Ilan R, Fowler RA, Geerts R, Pinto R, Sibbald WJ, Martin CM (2007) Knowledge translation in critical care: factors associated with prescription of commonly recommended best practices for critically ill patients. Crit Care Med 35:1696–1702PubMedCrossRefGoogle Scholar
  5. 5.
    The McDonnell Norms Group (2006) Enhancing the use of clinical guidelines: a social norms perspective. J Am Coll Surg 202:826–836CrossRefGoogle Scholar
  6. 6.
    Ursprung R, Gray JE, Edwards WH, Horbar JD, Nickerson J, Plsek P, Shiono PH, Suresh GK, Goldmann DA (2005) Real time patient safety audits: improving safety every day. Qual Saf Health Care 14:284–289PubMedCentralPubMedCrossRefGoogle Scholar
  7. 7.
    Byrnes MC, Schuerer DJE, Schallom ME, Sona CS, Mazuski JE, Taylor BE, McKenzie W, Thomas JM, Emerson JS, Nemeth JL, Bailey RA, Boyle WA, Buchman TG, Coopersmith CM (2009) Implementation of a mandatory checklist of protocols and objectives improves compliance with a wide range of evidence-based intensive care unit practices. Crit Care Med 37:2775–2781PubMedCrossRefGoogle Scholar
  8. 8.
    Lee L, Girish S, van den Berg E, Leaf A (2009) Random safety audits in the neonatal unit. Arch Dis Child Fetal Neonatal Ed 94:F116–F119PubMedCrossRefGoogle Scholar
  9. 9.
    Centofanti JE, Duan EH, Hoad NC, Swinton ME, Perri D, Waugh L, Cocinero DJ (2014) Use of a daily goals checklist for morning ICU rounds: a mixed-methods study. Crit Care Med 42:1797–1803PubMedCrossRefGoogle Scholar
  10. 10.
    Invaso R (2005) Real time patient safety audits. Qual Saf Health Care 14:464PubMedCentralPubMedCrossRefGoogle Scholar
  11. 11.
    Sirgo Rodríguez G, Olona Cabases M, Martin Delgado MC, Esteban Reboll F, Pobo Peris A, Bodí Saera M, ART-SACC study experts (2014) Audits in real time for safety in critical care: definition and pilot study. Med Intensiva 38:473–482PubMedCrossRefGoogle Scholar
  12. 12.
    Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, Margolis P (2010) The influence of context on quality improvement success in the Elath care: a systematic review of the literature. Milbank Quat 88:500–559CrossRefGoogle Scholar
  13. 13.
    Timsit JF, Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Azoulay E (2014) Year in review in Intensive Care Medicine 2013: III. Sepsis, infections, respiratory diseases, pediatrics. Intensive Care Med 40:471–483PubMedCrossRefGoogle Scholar
  14. 14.
    Azoulay E, Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Timsit JF (2014) Year in review in Intensive Care Medicine 2013: II. Sedation, invasive and noninvasive ventilation, airways, ARDS, ECMO, family satisfaction, end-of-life care, organ donation, informed consent, safety, hematological issues in critically ill patients. Intensive Care Med 40:305–319PubMedCrossRefGoogle Scholar
  15. 15.
    Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Timsit JF, Azoulay E (2014) Year in review in Intensive Care Medicine 2013: I. Acute kidney injury, ultrasound, hemodynamics, cardiac arrest, transfusion, neurocritical care, and nutrition. Intensive Care Med 40:147–159PubMedCrossRefGoogle Scholar
  16. 16.
    Valentin A, Capuzzo M, Guidet B, Moreno RP, Dolanski L, Bauer P, Metnitz PGH (2006) Pateint safety in intensive care: results from the multinacional Sentinel Events Evaluation (SEE) study. Intensive Care Med 32:1591–1598PubMedCrossRefGoogle Scholar
  17. 17.
    Garrouste-Orgeas M, Timsit JF, Vesin A, Schwebel C, Arnodo P, Lefrant JY, Souweine B, Tabah A, Charpentier J, Gontier O, Fieux F, Mourvillier B, Troché G, Reignier J, Dumay MF, Azoulay E, Reignier B, Carlet J, Soufr L (2010) Selected medical errors in the intensive care unit: results of the IATROREF study: parts I and II. Am J Respir Crit Care Med 181:134–142PubMedCrossRefGoogle Scholar
  18. 18.
    Quenot JP, Plantefeve G, Baudel JL, Camilatto I, Bertholet E, Cailliod R, Reignier J, Rigaud JP (2010) Bedside adherence to clinical practice guidelines for enteral nutrition in critically ill patients receiving mechanical ventilation: a prospective, multi-centre, observational study. Crit Care 14:R37PubMedCentralPubMedCrossRefGoogle Scholar
  19. 19.
    Aujoulat I, Jacquemin P, Rietzschel E, Scheen A, Tréfois P, Wens J, Darras E, Hermans MP (2014) Factors associated with clinical inertia: an integrative review. Adv Med Educ Pract 5:141–147PubMedCentralPubMedCrossRefGoogle Scholar
  20. 20.
    Kash BA, Spaulding A, Johnson CE, Gamm L (2014) Success factors for strategic change initiatives: a qualitative study of healthcare administrator´perspectives. J Health Manag 59:65–81Google Scholar
  21. 21.
    Erasmus V, Daha TJ, Brug H, Richardus JH, Behrendt MD, Vos MC, van Beeck EF (2010) Systematic review of studies on compliance with hand hygiene guidelines in hospital care. Infect Control Hosp Epidemiol 31:283–294PubMedCrossRefGoogle Scholar
  22. 22.
    McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA (2003) The quality of health care delivered to adults in the United States. New Engl J Med 348:2635–2645PubMedCrossRefGoogle Scholar
  23. 23.
    McMullin J, Cook D, Griffith L, McDonald E, Clarke F, Guyatt G, Gibson J, Crowther M (2006) Minimizing errors of omission: behavioural re-enforcement of heparin to avert venous emboli: the behave study. Crit Care Med 34:694–699PubMedCrossRefGoogle Scholar
  24. 24.
    Gurses AP, Marsteller JA, Ozok A, Xiao Y, Owens S, Pronovost PJ (2010) Using an interdisciplinary approach to identify factors that affect clinicians´compliance with evidence-based guidelines. Crit Care Med 38:S82–S91CrossRefGoogle Scholar
  25. 25.
    Kiyoshi-Teo H, Cabana MD, Froelicher ES, Blegen MA (2014) Adherence to institution-specific ventilador-associated pneumonia prevention guidelines. Am J Crit Care 23:201–214PubMedCrossRefGoogle Scholar
  26. 26.
    De Becker W (2007) Starting up a continuous renal replacement therapy program on ICU. Contrib Nephrol 156:185–190PubMedGoogle Scholar
  27. 27.
    Honda CK, Freitas FG, Stanich P, Mazza BF, Castro I, Nascente AP, Bafi AT, Azevedo LC, Machado FR (2013) Nurse to bed ratio and nutrition support in critically ill patients. Am J Crit Care 22:71–78CrossRefGoogle Scholar
  28. 28.
    Weingart SN, McL Wilson R, Gibberd RW, Harrison B (2000) Epidemiology of medical error. Br Med J 320:774–777CrossRefGoogle Scholar
  29. 29.
    Tarnow-Mordi WO, Hau C, Warden A, Shearer AJ (2000) Hospital mortality in relation to staff workload: a 4 year study in an adult intensive-care unit. Lancet 356:185–189PubMedCrossRefGoogle Scholar
  30. 30.
    Stone PW, Mooney-Kane C, Larson EL, Horan T, Glance LG, Zwanziger J, Dick AW (2007) Nurse working conditions and patient safety outcome. Med Care 45:571–578PubMedCrossRefGoogle Scholar
  31. 31.
    Kane RL, Shamliyan TA, Mueller C, Duval S, Wilt TJ (2007) The association of registered nurse staffing levels and patient outcome. Systematic review and meta-analysis. Med Care 45:1195–1204PubMedCrossRefGoogle Scholar
  32. 32.
    Ward NS, Read R, Afessa B, Kahn JM (2012) Perceived effects of attending physician workload in academic medical intensive care units: a national survey of training program directors. Crit Care Med 40:400–405PubMedCrossRefGoogle Scholar
  33. 33.
    Afessa B (2006) Intensive care unit physician staffing: seven days a week, 24 hours a day. Crit Care Med 34:894–895PubMedCrossRefGoogle Scholar
  34. 34.
    Dara SI, Afessa B (2005) Intensivist-tobed-ratio: association with outcomes in the medical ICU. Chest 128:567–572PubMedCrossRefGoogle Scholar
  35. 35.
    Weiss CH, Moazed F, McEvoy CA, Singer BD, Szleifer I, Amaral LA, Kwasny M, Watts CM, Persell SD, Baker DW, Sznajder JI, Wunderink RG (2011) Prompting physician to address a daily checklist and process of care and clinical outcomes. Am J Respir Crit Care Med 184:680–686PubMedCentralPubMedCrossRefGoogle Scholar
  36. 36.
    Thomassen O, Storesund A, Softeland E, Brattebo G (2014) The effects of safety checklists in medicine: a systematic review. Acta Anaesthesiol Scand 58:5–18PubMedCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg and ESICM 2015

Authors and Affiliations

  • M. Bodí
    • 1
    • 8
    Email author
  • M. Olona
    • 2
  • M. C. Martín
    • 3
  • R. Alceaga
    • 4
  • J. C. Rodríguez
    • 5
  • E. Corral
    • 6
  • J. M. Pérez Villares
    • 7
  • G. Sirgo
    • 1
  1. 1.Intensive Care Unit, Hospital Universitario Joan XXIII, Instituto de Investigación Sanitaria Pere VirgiliRovira I Virgili UniversityTarragonaSpain
  2. 2.Department of Preventive Medicine, Hospital Universitario Joan XXIII, Instituto de Investigación Sanitaria Pere VirgiliRovira I Virgili UniversityTarragonaSpain
  3. 3.Intensive Care UnitHospital Universitario de TorrejónMadridSpain
  4. 4.Intensive Care UnitHospital Santa TeclaTarragonaSpain
  5. 5.Intensive Care UnitHospital Universitario Marques de ValdecillaSantanderSpain
  6. 6.Intensive Care UnitHospital Universitario Santiago ApostolVitoriaSpain
  7. 7.Neurocritical UnitHospital Universitario Virgen de las NievesGranadaSpain
  8. 8.TarragonaSpain

Personalised recommendations