Abstract
A rapid response system (RRS) may have limited effectiveness when inpatient providers fail to recognize signs of early patient decompensation. We evaluated the impact of an electronic medical record (EMR)-based alerting dashboard on outcomes associated with RRS activation. We used a repeated treatment study in which the dashboard display was successively turned on and off each week for ten 2-week cycles over a 20-week period on the inpatient acute care wards of an academic medical center. The Rapid Response Team (RRT) dashboard displayed all hospital patients in a single view ranked by severity score, updated in real time. The dashboard could be seen within the EMR by any provider, including RRT members. The primary outcomes were the incidence rate ratio (IRR) of all RRT activations, unexpected ICU transfers, cardiopulmonary arrests and deaths on general medical-surgical wards (wards). We conducted an exploratory analysis of first RRT activations. There were 6736 eligible admissions during the 20-week study period. There was no change in overall RRT activations (IRR = 1.14, p = 0.07), but a significant increase in first RRT activations (IRR = 1.20, p = 0.04). There were no significant differences in unexpected ICU transfers (IRR = 1.15, p = 0.25), cardiopulmonary arrests on general wards (IRR = 1.46, p = 0.43), or deaths on general wards (IRR = 0.96, p = 0.89). The introduction of the RRT dashboard was associated with increased initial RRT activations but not overall activations, unexpected ICU transfers, cardiopulmonary arrests, or death. The RRT dashboard is a novel tool to help providers recognize patient decompensation and may improve initial RRT notification.
Similar content being viewed by others
References
Kause, J., Smith, G., Prytherch, D., Parr, M., Flabouris, A., and Hillman, K., A comparison of antecedents to cardiac arrests, deaths and EMergency intensive care admissions in Australia and New Zealand, and the United Kingdom - the ACADEMIA study. Resuscitation. 62:275–282, 2004.
Buist, M. D., Jarmolowski, E., Bernard, S. A., Waxman, B. P., and Anderson, J., Recognising clinical instability in hospital patients before cardiac arrest or unplanned admission to intensive care. A pilot study in a teriary-care hospital. Med. J. Aust. 171:22–25, 1999.
Franklin, C., and Mathew, J., Developing strategies to prevent inhospital cardiac arrest: Analyzing responses of physicians and nurses in the hours before the event. Crit. Care Med. 22:244–247, 1994.
Schein, R. M. H., Hazday, N., Pena, M., Ruben, B. H., and Sprung, C. L., Clinical antecedents to in-hospital cardiopulmonary arrest. Chest. 98:1388–1392, 1990.
Churpek, M. M., Yuen, T. C., Huber, M. T., Park, S. Y., Hall, J. B., and Edelson, D. P., Predicting cardiac arrest on the wards: A nested case-control study. Chest. 141:1170–1176, 2012.
Escobar, G. J., Laguardia, J. C., Turk, B. J., Ragins, A., Kipnis, P., and Draper, D., Early detection of impending physiologic deterioration among patients who are not in intensive care: Development of predictive models using data from an automated electronic medical record. J. Hosp. Med. 7:388–395, 2012.
Andersen, L. W., Kim, W. Y., Chase, M., Berg, K. M., Mortensen, S. J., Moskowitz, A., Novack, V., Cocchi, M. N., Donnino, M. W., Chan, P. S., Bradley, S. M., Edelson, D. P., Faillace, R. T., Geocadin, R., Girotra, S., Merchant, R., Mosesso, V. N., Ornato, J. P., and Peberdy, M. A., The prevalence and significance of abnormal vital signs prior to in-hospital cardiac arrest. Resuscitation. 98:112–117, 2016.
Barwise, A., Thongprayoon, C., Gajic, O., Jensen, J., Herasevich, V., and Pickering, B. W., Delayed rapid response team activation is associated with increased hospital mortality, morbidity, and length of stay in a tertiary care institution. Crit. Care Med. 44:1–10, 2015.
Jones, D., DeVita, M. A., and Bellomo, R., Rapid-Response Teams. N. Engl. J. Med. 365:139–146, 2011.
Sandroni, C., D’Arrigo, S., and Antonelli, M., Rapid response systems: are they really effective? Crit. Care. 19:104, 2015.
Zegers, M., Hesselink, G., Geense, W., and Vincent, C., Evidence-based interventions to reduce adverse events in hospitals : A systematic review of systematic reviews. BMJ Open. 6:1–14, 2016.
Winters, B. D., Weaver, S. J., Pfoh, E. R., Yang, T., Cuong, J., and Dy, S. M., Rapid-response systems as a patient safety strategy: A systematic review. Ann. Intern. Med. 158:417–425, 2013.
DeVita, M. A., Smith, G. B., Adam, S. K., Adams-Pizarro, I., Buist, M., Bellomo, R., Bonello, R., Cerchiari, E., Farlow, B., Goldsmith, D., Haskell, H., Hillman, K., Howell, M., Hravnak, M., Hunt, E. A., Hvarfner, A., Kellett, J., Lighthall, G. K., Lippert, A., Lippert, F. K., Mahroof, R., Myers, J. S., Rosen, M., Reynolds, S., Rotondi, A., Rubulotta, F., and Winters, B., “Identifying the hospitalised patient in crisis”-a consensus conference on the afferent limb of rapid response systems. Resuscitation. 81:375–382, 2010.
Hillman, K., Introduction of the medical emergency team (MET) system: A cluster-randomised controlled trial. Lancet. 365:2091–2097, 2005.
Calzavacca, P., Licari, E., Tee, A., Egi, M., Downey, A., Quach, J., Haase-Fielitz, A., Haase, M., and Bellomo, R., The impact of rapid response system on delayed emergency team activation patient characteristics and outcomes-a follow-up study. Resuscitation. 81:31–35, 2010.
Downey, A. W., Quach, J. L., Haase, M., Haase-Fielitz, A., Jones, D., and Bellomo, R., Characteristics and outcomes of patients receiving a medical emergency team review for acute change in conscious state or arrhythmias. Crit. Care Med. 36:477–481, 2008.
Trinkle, R. M., and Flabouris, A., Documenting rapid response system afferent limb failure and associated patient outcomes. Resuscitation. 82:810–814, 2011.
Subbe, C. P., Kruger, M., Rutherford, P., and Gemmel, L., Validation of a modified early warning score in medical admissions. QJM. 94:521–526, 2001.
Payne, T. H., TenBroek, A. E., Fletcher, G. S., and Labuguen, M. C., Transition from paper to electronic inpatient physician notes. J. Am. Med. Inform. Assoc. 17:108–111, 2010.
Shadish, W. R., Cook, T. D., and Campbell, D. T., Paine. Houghton Mifflin, Boston, 2001.
Charlson, M. E., Pompei, P., Ales, K. L., and MacKenzie, C. R., A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J. Chronic. Dis. 40:373–383, 1987.
Deyo, R. A., Cherkin, D. C., and Ciol, M. A., Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J. Clin. Epidemiol. 45:613–619, 1992.
Lighthall, G. K., Generation of early warnings with smart monitors: The future is all about getting back to the basics. Crit. Care Med. 40:2509–2511, 2012.
Shiloh, A. L., Lominadze, G., Gong, M. N., and Savel, R. H., Early warning/track-and-trigger systems to detect deterioration and improve outcomes in hospitalized patients. Semin. Respir. Crit. Care Med. 37:88–95, 2016.
Jones, D., Lippert, A., DeVita, M., and Hillman, K., What’s new with rapid response systems? Intensive Care Med. 41:315–317, 2015.
Bates, D. W., Saria, S., Ohno-Machado, L., Shah, A., and Escobar, G., Big data in health care: Using analytics to identify and manage high-risk and high-cost patients. Health Aff. (Millwood). 33:1123–1131, 2014.
Bates, D. W., and Zimlichman, E., Finding patients before they crash: The next major opportunity to improve patient safety. BMJ Qual. Saf. 24:1–3, 2015.
Peebles, E., Subbe, C. P., Hughes, P., and Gemmell, L., Timing and teamwork-an observational pilot study of patients referred to a rapid response team with the aim of identifying factors amenable to re-design of a rapid response system. Resuscitation. 83:782–787, 2012.
Henkind, S. J., and Sinnett, J. C., Patient care, square-rigger sailing, and safety. JAMA. 300:1691–1693, 2008.
Schondelmeyer, A. C., Brady, P. W., and Landrigan, C. P., Alarm fatigue: Clearing the air. J. Hosp. Med. 11:153–154, 2016.
Paine, C. W., Goel, V. V., Ely, E., Stave, C. D., Stemler, S., Zander, M., and Bonafide, C. P., Systematic review of physiologic monitor alarm characteristics and pragmatic interventions to reduce alarm frequency. J. Hosp. Med. 11:136–144, 2016.
Escobar, G. J., Turk, B. J., Ragins, A., Ha, J., Hoberman, B., Levine, S. M., Ballesca, M. A., Liu, V., and Kipnis, P., Piloting electronic medical record – Based early detection of inpatient deterioration in community hospitals. J. Hosp. Med. 11:S18–S24, 2016.
Churpek, M. M., Yuen, T. C., and Edelson, D. P., Risk stratification of hospitalized patients on the wards. Chest. 143:1758–1765, 2013.
Kipnis, P., Turk, B. J., Wulf, D. A., Carlos, J., Liu, V., Churpek, M. M., and Escobar, G. J., Development and validation of an electronic medical record- based alert score for detection of inpatient deterioration outside the ICU. J. Biomed. Inform. 64:10–19, 2017.
Kollef, M. H., Chen, Y., Heard, K., Larossa, G. N., Lu, C., Martin, N. R., Martin, N., Micek, S. T., and Bailey, T., A randomized trial of real-time automated clinical deterioration alerts sent to a rapid response team. J. Hosp. Med. 9:5–10, 2014.
Kollef, M. H., Heard, K., Chen, Y., Lu, C., Martin, N., and Bailey, T., Mortality and length of stay trends following implementation of a rapid response system and real-time automated clinical deterioration alerts. Am. J. Med. Qual. 32:12–18, 2017.
Romero-Brufau, S., Huddleston, J. M., Naessens, J. M., Johnson, M. G., Hickman, J., Morlan, B. W., Jensen, J. B., Caples, S. M., Elmer, J. L., Schmidt, J. A., Morgenthaler, T. I., and Santrach, P. J., Widely used track and trigger scores: Are they ready for automation in practice? Resuscitation. 85:549–552, 2014.
Jones, D., Bellomo, R., and De Vita, M. A., Effectiveness of the medical emergency team: The importance of dose. Crit. Care. 13:313, 2009.
Chen, J., Bellomo, R., Flabouris, A., Hillman, K., and Finfer, S., The relationship between early emergency team calls and serious adverse events. Crit. Care Med. 37:148–153, 2009.
Maharaj, R., Raffaele, I., and Wendon, J., Rapid response systems : A systematic review and meta-analysis. Crit. Care. 19:1–15, 2015.
Winters, B. D., and Pronovost, P. J., Rapid response systems : Should we still question their implementation ? J. Hosp. Med. 8:278–281, 2013.
Ricciardi, R., Roberts, P. L., Read, T. E., Baxter, N. N., Marcello, P. W., and Schoetz, D. J., Mortality rate after nonelective hospital admission. Arch. Surg. 146:545–551, 2011.
Acknowledgements
The authors wish to thank Abdelhak Abdou, Tom Payne, Christy McKinney, and Peter Tarczy-Hornoch, for invaluable contributions to the study.
Funding sources
The investigation was supported by National Library of Medicine Sponsored Medical Informatics Fellowship LM007442–07.
Author information
Authors and Affiliations
Contributions
GF participated in the study design, data acquisition, analysis and interpretation of results, and drafting of the manuscript. BA conceived of the study and designed the intervention. BA also participated in the data acquisition, data interpretation, and revisions of the manuscript. AW participated in the study design, data acquisition, data interpretation, and manuscript revisions. RJ participated in the data acquisition, data interpretation, and manuscript revisions. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Financial disclosures and conflicts of interest
The authors whose names are listed above certify that they have NO affiliations with or involvement in any organization or entity with any financial interest (such as honoraria; educational grants; participation in speakers’ bureaus; membership, employment, consultancies, stock ownership, or other equity interest; and expert testimony or patent-licensing arrangements), or non-financial interest (such as personal or professional relationships, affiliations, knowledge or beliefs) in the subject matter or materials discussed in this manuscript.
Additional information
This article is part of the Topical Collection on Systems-Level Quality Improvement
Rights and permissions
About this article
Cite this article
Fletcher, G.S., Aaronson, B.A., White, A.A. et al. Effect of a Real-Time Electronic Dashboard on a Rapid Response System. J Med Syst 42, 5 (2018). https://doi.org/10.1007/s10916-017-0858-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-017-0858-5