Skip to main content

Advertisement

Log in

Using telephone call rates and nurse-to-patient ratios as measures of resilient performance under high patient flow conditions

  • Original Article
  • Published:
Cognition, Technology & Work Aims and scope Submit manuscript

Abstract

Patient admissions, discharges, and transfers are high work demand activities that have been associated with 30-day readmissions and increased patient mortality. Most mitigation strategies target peak demand, but variable demand may be more significant. Self-organizing holarchic open systems (SOHOs) and resilience engineering frameworks may explain system behavior, but a few quantitative studies of resilient organizational performance have been published. We used three measures to explore SOHO and resilience engineering constructs. We collected hourly data over 2 years, from five inter-related units in a cardiovascular disease division of a metropolitan teaching hospital. Our results show that information flows (inbound, outbound, answered, and unanswered telephone calls) representing anticipatory management are related to patient flows (patient admissions discharges and transfers) and nurse-staffing levels (nurse-to-patient ratios). We also found overall system stability despite high patient flow effects in lower level units. Unexpectedly, the time to recovery from high patient flow events lasted up to 7 days. We conclude that constructs proposed by resilience engineering can be quantified using simple measures collated within routine operations. The application of nonlinear statistical analyses can uncover important insights about resilient performance that may assist managers in better preparing for managing and recovering from unexpected variation in patient flow.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Agency for Healthcare Research and Quality (2017) HCUP fast stats—trends in inpatient stays. http://www.hcupus.ahrq.gov/faststats/NationalTrendsServlet?measure1=01&characteristic1=01&time1=10&measure2=02&characteristic2=01&time2=10&expensionInfoState=hide&dataTabl;esState=hide&definitionsState=hide&exportState=hide. Accessed 1 Apr 2018

  • Aiken LH, Cimotti JP, Sloane DM, Smith HL, Flynn L, Neff DF (2011) The effects of nurse staffing and nurse education on patient deaths in hospitals with different nurse work environments. Med Care 49(12):1047–1053

    Article  Google Scholar 

  • Allen T, Giampietro M (2014) Holons, creaons, genons, in hierarchy theory: where we have gone. Ecol Model 293:31–41

    Article  Google Scholar 

  • Ball JE, Murrells T, Rafferty AM, Morrow E, Griffiths P (2013) ‘Care Left undone’ during nursing shifts: associations with work load and perceived quality of care. Br J Qual Saf. https://doi.org/10.1136/bmjas-2012-001767

    Google Scholar 

  • Ball JE, Bruyneel L, Aiken LH, Sermeus W, Sloan DM, Rafferty AM, Lindquist R, Tishelman C, Griffiths P. RN4Cast Consortium (2017) Post-operative mortality, missed care and nurse staffing in nine countries: a cross-sectional study. Int J Nurs Stud. https://doi.org/10.1016/j.ijnurstu.2017.08.004

    Google Scholar 

  • Bergström J, Van Winsen R, Henriqson E (2015) On the rationale of resilience in the domain of safety: a literature review. Reliab Eng Syst Saf 141:131–141

    Article  Google Scholar 

  • Birkland TA, Waterman S (2009) The politics and policy challenges of disaster recovery. In: Nemeth C, Hollnagel E, Dekker S (eds) Resilience perspectives volume 2: preparation and restoration. Ashgate Publishing Limited, Surrey

    Google Scholar 

  • Blay N, Roche MA, Duffield C, Gallagher R (2017) Intrahospital transfers and the impact on nursing workload. J Clin Nurs 26(23–24):4822–4829

    Article  Google Scholar 

  • Buerhaus PI, DesRoches C, Donelan K, Hess R (2009) Registered nurses’ perceptions of nurse staffing ratios and new hospital payment regulations. Nurs Econ 27(6):372–376

    Google Scholar 

  • Callier FM, Desoer CA (1991) Linear system theory. Springer, New York

    Book  MATH  Google Scholar 

  • Centers for Medicare and Medicaid Services (CMS) (2018) National Health Expenditure data. https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/NationalHealthExpendData/NationalHealthAccountsProjected.html. Accessed 1 Apr 2018

  • Cho E, Sloane DM, Kim EY, Kim S, Choi M, Less HS, Aiken LH (2015) Effects of nurse staffing, work environments and education on patient mortality: an observational study. Int J Nurs Stud 52(2):535–542

    Article  Google Scholar 

  • Cleveland RB, Cleveland WS, McRae JE, Terpenning I (1990) STL: a seasonal-trend decomposition procedure based on loess. J Off Stat 6:3–73

    Google Scholar 

  • Collier J (2008) Simulating autonomous anticipation: the importance of Dubois’ conjecture. BioSystems 91:346–354

    Article  Google Scholar 

  • Dabney BW, Kalisch BJ (2015) Nurse staffing levels and patient-reported missed nursing care. J Nurs Qual 30(4):306–312

    Article  Google Scholar 

  • De Regt A, Siegel AW, Schraagen JM (2016) Toward quantifying metrics of rail-system resilience: identification and analysis of performance weak resilience signals. Cognit Technol Work 18:319–331

    Article  Google Scholar 

  • Dort T, Schecroun N, Standaert B (2018) Improving the hospital quality of care during winter periods by optimizing budget allocation between rotavirus vaccination and bed expansion. Appl Health Econ Health Policy 16(1):123–132

    Article  Google Scholar 

  • Duffield CM, Roche MA, Dimitrelis S, Homer C, Buchan J (2015) Instability in patient and nurse characteristics, unit complexity and patient and system outcomes. J Adv Nurs 71(6):1288–1298

    Article  Google Scholar 

  • Durbin J, Koopman SJ (2012) Time series analysis by state space methods, 2nd edn. Oxford University Press, Oxford

    Book  MATH  Google Scholar 

  • Enjalbert S, Vanderhaegen F (2017) A hybrid reinforced learning system to estimate resilience indicators. Eng Appl Artif Intell 64:295–301

    Article  Google Scholar 

  • Eurostat (2018) Healthcare expenditure statistics. http://ec.europa.eu/eurostat/statistics-explained/index.php/Healthcare_expenditure_statistics#Healthcare_expenditure. Accessed 14 Apr 2018 (ISSN: 2443 8219)

  • Fairbanks RJ, Perry S, Bond W, Wears RL (2013) Separating resilience from success. In: Hollnagel E, Braithwaite J, Wears RL (eds) Resilient health care. Ashgate, Burlington

    Google Scholar 

  • Fairbanks RJ, Wears RL, Woods DD, Hollnagel E, Plsek P, Cook RI (2014) Resilience and resilience engineering in health care. Jt Comm J Qual Patient Saf 40(8):376–383

    Article  Google Scholar 

  • Hansen RN, Pham AT, Boing EA, Lovelace B, Wan GJ, Miller TE (2017) Comparative analysis of length of stay and hospitalization costs, opioid use and discharge status among spine surgery patients with postoperative pain management including intravenous version oral acetaminophen. Curr Med Res Opin 33(5):943–948

    Article  Google Scholar 

  • Hollnagel E (2012) FRAM: the Functional Resonance Analysis Method. CRC Press, Boca Raton

    Google Scholar 

  • Hollnagel E, Nemeth CP, Dekker S (2008) Resilience engineering perspectives, volume 1: remaining sensitive the possibility of failure. Ashgate Publishing, Aldershot

    Google Scholar 

  • Hollnagel E, Paries J, Woods DD, Wreathall J (2011) Resilience engineering in practice: a guidebook. Ashgate Publishing Limited, Surrey

    Google Scholar 

  • Hollnagel E, Braithwaite J, Wears RL (eds) (2013) Resilient health care. Ashgate, Burlington

    Google Scholar 

  • Jennings BM, Sandlowski M, Higgins MK (2013) Turning over patient turnover: an ethnographic study of admissions, discharges and transfers. Res Nurs Health 36(6):554–566

    Article  Google Scholar 

  • Kaboli PJ, Go JT, Hockenberry J, Glasgow JM, Johnson SR, Rosenthal GE, Jones MP, Vaughan-Sarrazin M (2012) Associations between reduced hospital length of stay and 30-day readmission rate and mortality: 14-year experience in 129 Veterans Affairs Hospitals. Annu Intern Med 157(12):837–845

    Article  Google Scholar 

  • Kalisch BJ, Landstron G, Williams RA (2009) Missed nursing care: errors of omission. Nurs Outlook 57:3–9

    Article  Google Scholar 

  • Kalisch BJ, Xie B, Dabney BW (2014) Patient-reported missed nursing care correlated with adverse events. Am J Med Qual 29(5):415–422

    Article  Google Scholar 

  • Kay JJ (2000) Ecosystems as self-organising holarchic open systems: narratives and the second law of thermodynamics. In: Jorgensen SE, Muller F (eds) Handbook of ecosystem theories and management. Lewis Publishers, Boca Raton

    Google Scholar 

  • Kiekkas P, Sakellaropoulos GC, Brokalaki H, Manolis E, Samios A, Skartsani C, Baltopoulos GI (2008) Association between nursing workload and mortality of intensive care unit patients. J Nurs Scholarsh 40(4):385–390

    Article  Google Scholar 

  • Koestler A (1968) The ghost in the machine. MacMillan, London

    Google Scholar 

  • Koestler A (1978) Janus: a summing up. Random House, New York

    Google Scholar 

  • Kugler PN, Shaw RE, Vicente KJ, Kinsella-Shaw J (1990) Inquiry into intentional systems I: issues in ecological physics. Psychol Res 52:98–121

    Article  Google Scholar 

  • Lay E, Branlat M, Woods Z (2015) A practitioner’s experiences operationalizing resilience engineering. Reliab Eng Syst Saf 141:63–73

    Article  Google Scholar 

  • Lengnick-Hall CA, Beck TE (2009) Resilience capacity and strategic agility: prerequisites for thriving in a dynamic environment. In: Nemeth C, Hollnagel E, Dekker S (eds) Resilience perspectives volume 2: preparation and restoration. Ashgate Publishing Limited, Surrey

    Google Scholar 

  • Leonard J, Hieken TJ, Hussein M, Marmswen WS, Sawyer M, Osborn J, Bingener J (2015) Delineation of factors associated with prolonged length of stay after laparoscopic ventral hernia repair leads to a clinical pathway and improves quality of care. Surg Endosc. https://doi.org/10.1007/s00464-015-4391-7

    Google Scholar 

  • Litvak E, Buerhaus PI, Davidoff F, Long MC, McManus ML, Berwick DM (2005) Managing unnecessary variability in patient demand to reduce nursing stress and improve patient safety. Jt Comm J Qual Patient Saf 31(6):330–338

    Article  Google Scholar 

  • Ljungberg D, Lundh V (2013) Resilience engineering within ATM—development adaption and application of the resilience analysis grid (RAG). http://www.diva-portal.org/smash/get/diva2:694400/FULLTEXT01.pdf. Accessed 15 Apr 2018

  • McHugh MD, Berez J, Small DS (2013) Hospitals with higher nurse staffing had lower odds of readmissions penalties than hospitals with lower staffing. Health Aff 10:1740–1747

    Article  Google Scholar 

  • Mendonca D (2008) Measures of resilient performance. In: Hollnagel E, Nemeth CP, Dekker S. (eds) Resilience engineering perspectives. Vol. 1: remaining sensitive to the possibility of failure. Ashgate, Burlington

    Google Scholar 

  • Miller A (2004) A work domain analysis framework for modeling patients as the system at the core of medical intensive care units. Cognit Technol Work. 6:207–222

    Article  Google Scholar 

  • Miller A, Buerhaus P (2013) Supporting ICU charge nurse decision making in a rapidly changing healthcare climate. Jt Comm J Qual Patient Saf 39(1):38–47

    Article  Google Scholar 

  • Miller A, Xiao Y (2007) Multi-level strategies to achieve resilience for an organization operating at capacity a case study at a trauma centre. Cognit Technol Work 9:51–66

    Article  Google Scholar 

  • Miller A, Weinger MB, Buerhaus P, Dietrich MS (2010) Care coordination in intensive care units: communicating across information spaces. Hum Factors 51(3):354–367

    Article  Google Scholar 

  • Needleman J, Buerhaus P, Pankratz S, Leibson CL, Stevens SR, Harris M (2011) Nurse staffing and impatient hospital mortality. N Engl J Med 364:1037–1045

    Article  Google Scholar 

  • Nemeth C (2009) The ability to adapt. In: Nemeth D, Hollnagel E, Dekker S (eds) Resilience perspectives volume 2: preparation and restoration. Ashgate Publishing Limited, Surrey

    Google Scholar 

  • Ouedraogo KA, Enjalbert S, Vanderhaegen F (2013) How to learn from the resilience of human–machine systems. Eng Appl Artif Intell 26:24–34

    Article  Google Scholar 

  • Patriarca R, Bergström J, Di Gravio G, Costantino F (2018) Resilience engineering: current results and future challenges. Saf Sci 102:79–100

    Article  Google Scholar 

  • Pavard B, Dugdale J, Saoud NB-B, Darcy S, Salembier P (2008) Underlying concepts in robustness and resilience and their use in designing socio-technical systems. In: Hollnagel E, Nemeth CP, Dekker S. (eds) Resilience engineering perspectives. Vol. 1: remaining sensitive to the possibility of failure. Ashgate, Burlington

    Google Scholar 

  • R Core Team (2013) R: a language and environment for statistical computing. Vienna, Austria. http://www.R-project.org/. Accessed 20 Apr 2018

  • Radner R (1993) The organization of decentralized information processing. Econometrica 61(5):1109–1146

    Article  MATH  Google Scholar 

  • Rasmussen J, Pejtersen AM, Goodstein LP (1994) Cognitive systems engineering. Wiley, New York

    Google Scholar 

  • Righi AW, Saurin TA, Wachs P (2015) A systematic literature review of resilience engineering: research areas and a research agenda proposal. Reliab Eng Syst Saf 141:142–152

    Article  Google Scholar 

  • Robson R (2015) Everyday clinical work in complex adaptive systems. In: Wears RL, Hollnagel E, Braithwaite J (eds) Resilient health care vol. 2: the resilience of everyday clinical work. Ashgate, Burlington

    Google Scholar 

  • Ross AJ, Anderson JE, Kodate N, Thompson K. Cox A, Malik R (2014) Inpatient diabetes care: complexity, resilience and quality of care. Cognit Technol Work 16:91–102

    Article  Google Scholar 

  • Shekelle PG (2013) Nurse–patient ratios as a patient safety strategy. Ann Intern Med 158:404–409

    Article  Google Scholar 

  • Simon HA (2002) Near decomposability and the speed of evolution. Ind Corp Change 11(3):587–599

    Article  Google Scholar 

  • Simpson KR, Lyndon A (2017) Consequences of delayed, unfinished, or missed nursing care during labor and birth. J Perinat Neonatal Nurs 31(1):32–40

    Article  Google Scholar 

  • Smith A (2017) Trade mandated ratios for collaboration. Nurs Manag 48(11):38–43

    Article  Google Scholar 

  • Stalpers D, de Brouwer BJM, Kalijouw MJ, Schuurmans MJ (2015) Associations between characteristics of nurse work environments and five nurse-sensitive patient outcomes in hospitals: a systematic review. Int J Nurs Stud 52(4):817–835

    Article  Google Scholar 

  • Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG et al (2009) Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. Br Med J 338:b2393. https://doi.org/10.1136/bmj.b2393

    Article  Google Scholar 

  • Unruh LY, Fottler MD (2006) Patient turn-over and nursing staff adequacy. Health Serv Res 41:599–612

    Article  Google Scholar 

  • Vicente K (1999) Cognitive systems engineering: toward safe, productive and healthy computer-based work. Lawrence Erlbaum Associates, Mahwah

    Google Scholar 

  • Wears RL, Hollnagel E, Braithwaite J (eds) (2015) Resilient health care vol. 2: the resilience of everyday clinical work. Ashgate, Burlington

    Google Scholar 

  • Westrum R (2006) Chap. 5. A typology of resilience situations. In: Hollnagel E, Woods DD, Leveson N. (eds) Resilience engineering: concepts and precepts. Ashgate Publishing Limited, Surrey

    Google Scholar 

  • Woods DD (2015) Four concepts for resilience and the implications for the future of resilience engineering. Reliab Eng Syst Saf 141:5–9

    Article  Google Scholar 

  • Wreathall J (2009) Measuring resilience. In: Nemeth D, Hollnagel E, Dekker S (eds) Resilience perspectives volume 2: preparation and restoration. Ashgate Publishing Limited, Surrey

    Google Scholar 

  • Wreathall J (2011) Monitoring—a critical ability in resilience engineering. In: Hollnagel E, Paries J, Woods DD, Wreathall J (eds) Resilience engineering in practice: a guidebook. Ashgate Publishing Limited, Surrey

    Google Scholar 

  • Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J R Stat Soc Ser B 67:301–320

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This project was in funded in part by the Patient-Centered Outcomes Research Institute (PCORI) Grant #: 1IP2PI000072-01. The authors also acknowledge the involvement of Mr. Eric Porterfield, Ms. Robin Steaben, MSN, RN, Ms. Sheila Thompson RN, and Mr. David Matthews without whose support this project would not have been completed. We also thank our reviewers or their positive comments and suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anne Miller.

Appendices

Appendix 1: Glossary of abbreviations

ADT::

Admissions, discharges, and transfers

CVICU::

Cardiovascular intensive care unit

GDP::

Gross domestic product

LoS::

Length of stay

NPR::

Nurse-to-patient ratio

SD::

Standard deviation

SOHO::

Self-organizing holarchic open system

VHVI::

Vanderbilt Heart and Vascular Institute

Appendix 2: Elastic net modeling

We apply optimization techniques to observe the interdependent relations between variables. The variables included in the model are NPR, ADTs, to inbound, outbound, answered, and unanswered calls for each unit, adding up to a total of 36 variables.

We defined a vector with the 30 variables denoted as y and let y_t denote the vector values at time t (so y_t e.g., 34-by-1). We then solved for the coefficient matrix A (34-by-34) in the following optimization problem:

$${\text{Minimize}}_{A,b} \|y\_t-A\times{\text{ }}y\_{(t-1)}-b{\text{ }}\|^2,$$

where b is a 30-by-1 constant vector, and e_t is a time-invariant 30-by-1 vector of error terms with mean zero and a positive semi-definite contemporaneous covariance matrix. With this error term, we expect A to have many nonzero elements. This can make it hard to interpret. Therefore, instead of solving this naïve formulation, we improved the objective function, so that the solution for A has a limited number of nonzero elements. A penalty term is thus added to the naïve formulation to provide the following elastic net formulation:

$$\begin{aligned}&{\text{Minimize }}_{A,b}\|y\_t{\text{ }}-{\text{ }}A\times y\_(t - 1)-{\text{ }}b{\text{ }}\|^2+{\text{ }}alpha{\text{ }} \times {\text{ }}lambda{\text{ }} \\&\quad\times {\text{ }}\|\text{vec}(A)\|_1{\text{ }}+{\text{ }}\left( {1 - alpha} \right){\text{ }} \times {\text{ }}gamma{\text{ }} \times {\text{ }}\|\text{vec}(A)\|^2,\end{aligned}$$

where the parameter alpha adjusts for the trade-off between penalties on the L-1 loss and the L-2 loss. Lambda and gamma are the two parameters that control the penalties of the two losses, respectively.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Miller, A., Aswani, A., Zhou, M. et al. Using telephone call rates and nurse-to-patient ratios as measures of resilient performance under high patient flow conditions. Cogn Tech Work 21, 225–236 (2019). https://doi.org/10.1007/s10111-018-0498-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10111-018-0498-7

Keywords

Navigation