Abstract
Background
Recent studies have investigated disruptions to surgical process via observation. We developed the Disruptions in Surgery Index (DiSI) to assess operating room professionals’ self-perceptions of disruptions that affect surgical processes.
Materials
The DiSI assesses individual issues, operating room environment, communication, coordination/situational awareness, patient-related disruptions, team cohesion, and organizational issues. Sixteen surgeons, 26 nurses, and 20 anesthetists/operating departmental practitioners participated. Participants judged for themselves and for their colleagues how often each disruption occurs, its contribution to error, and obstruction of surgical goals.
Results
We combined the team cohesion and organizational disruptions to improve reliability. All participants judged that individual issues, operating room environment, and communication issues affect others more often and more severely than one’s self. Surgeons reported significantly fewer disruptions than nurses or anesthetists.
Conclusion
Although operating room professionals acknowledged disruptions and their impact, they attributed disruptions related to individual performance and attitudes more to their colleagues than to themselves. The cross-professional discrepancy in perceived disruptions (surgeons perceiving fewer than the other two groups) suggests that attempts to improve the surgical environment should always start with thorough assessment of the views of all its users. DiSI is useful in that it differentiates between the frequency and the severity of disruptions. Further research should explore correlations of DiSI-assessed perceptions and other observable measures.
Similar content being viewed by others
References
Calland J, Guerlain S, Adams R et al (2002) A systems approach to surgical safety. Surg Endosc 16:1005–1014
Vincent C, Moorthy K, Sarker SK et al (2004) Systems approaches to surgical quality and safety: from concept to measurement. Ann Surg 239:475–482
Martin JA, Regehr G, Reznick R et al (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278
Moorthy K, Munz Y, Sarker SK et al (2003) Objective assessment of technical skills in surgery. Br Med J 327:1032–1037
Fried GM, Feldman LS (2008) Objective assessment of technical performance. World J Surg 32:156–160
Fletcher G, Flin R, McGeorge P et al (2003) Anaesthetists’ Non-Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth 90:580–588
Yule S, Flin R, Paterson-Brown S et al (2006) Non-technical skills for surgeons. A review of the literature. Surgery 139:140–149
Yule S, Flin R, Paterson-Brown S et al (2006) Development of a rating system for surgeons’ non-technical skills. Med Educ 40:1098–1104
Saegert S, Winkel GH (1990) Environmental psychology. Ann Rev Psychol 41:441–477
Sundstrom E, Bell PA, Busby PL et al (1996) Environmental psychology 1989–1994. Ann Rev Psychol 47:485–512
Healey AN, Sevdalis N, Vincent CA (2006) Measuring intraoperative interference from distraction and interruption observed in the operating theatre. Ergonomics 49:589–604
Sevdalis N, Healey AN, Vincent CA (2007) Distracting communications in the operating theatre. J Eval Clin Practice 13:390–394
Healey AN, Primus CP, Koutantji M (2007) Quantifying distraction and interruption in urological surgery. Qual Saf Health Care 16:135–139
Alvarez G, Coiera E (2005) Interruptive communication patterns in the intensive care unit ward round. Int J Med Inform 74:791–796
Chisholm CD, Dornfeld AM, Nelson DR, Cordell WH (2001) Work interrupted: a comparison of workplace interruptions in emergency departments and primary care offices. Ann Emerg Med 38:146–151
Woloshynowych M, Davis R, Brown R, Vincent CA (2007) Communication patterns in a UK emergency department. Ann Emerg Med 50:407–413
Brixey JJ, Tang Z, Robinson DJ et al (2008) Interruptions in a level one trauma center: a case study. Int J Med Inform 77:235–241
Undre S, Sevdalis N, Healey AN et al (2006) Teamwork in the operating theatre: cohesion or confusion? J Eval Clin Pract 12:182–189
Makary MA, Sexton JB, Freischlag JA et al (2006) Operating room teamwork among physicians and nurses: teamwork in the eye of the beholder. J Am Coll Surg 202:746–752
Lingard L, Espin S, Whyte S et al (2004) Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Health Care 13:330–334
Lingard L, Garwood S, Poenaru D (2004) Tensions influencing operating room team function: does institutional context make a difference? Med Educ 38:691–699
Katz JD (2007) Conflict and its resolution in the operating room. J Clin Anesth 19:152–158
Undre S, Healey AN, Darzi A et al (2006) Observational assessment of surgical teamwork: a feasibility study. World J Surg 30:1774–1783
Undre S, Sevdalis N, Healey AN et al (2007) Observational assessment of surgical teamwork: refinement and application to urological surgery. World J Surg 31:1373–1381
Sevdalis N, Davis R, Koutantji M et al (2008) Reliability of a revised NOTECHS scale for use in surgical teams. Am J Surg (in press)
Eby LT, Dobbins GH (1997) Collectivistic orientation in teams: an individual and group-level analysis. J Organ Behav 18:275–295
Dukes KA (2005) Cronbach’s Alpha. Encyclopedia of biostatistics, 2nd edn. Wiley InterScience. Available at: http://www.mrw.interscience.wiley.com/emrw/9780470011812/eob/article/b2a13018/current/html
Wetzel CM, Kneebone RL, Woloshynowych M et al (2006) The effects of stress on surgical performance. Am J Surg 191:5–10
Arora S, Sevdalis N, Nestel D et al (2008) Managing intra-operative stress: what do surgeons want from a crisis training programme? Am J Surg (in press)
Acknowledgment
The authors thank Ms. Sonal Arora for her useful feedback on previous drafts of the present paper.
Author information
Authors and Affiliations
Corresponding author
Appendix: Full Analysis of Variance (ANOVA)
Appendix: Full Analysis of Variance (ANOVA)
The following factors (independent variables) were included in the ANOVA:
-
Group (surgical versus anesthetic versus nursing); measured between-subjects
-
Disruption type (individual issues versus operating room environment versus communication versus coordination/situational awareness versus patient-related disruptions versus team/organizational issues); measured within-subjects
-
Target (self versus others); measured within-subjects
Because both between- and within-subjects factors were included in the analysis, this was a mixed-model ANOVA.
(i) Disruption frequency
-
Main effect of target (F(1, 38) = 12.41, p < 0.01): the frequency of all disruptions was estimated higher for others than for the self.
-
Interaction between target and disruption type (F(5, 190) = 4.43, p < 0.01): the breaking down of the interaction into “self” versus “other” differences across the six disruption types revealed that the participants judged that others are more frequently affected than themselves by individual disruptions (t(50) = 4.14, p < 0.001), by disruptions in the operating room environment (t(50) = 4.07, p < 0.001), and by communication issues (t(53) = 3.21, p < 0.01). The remaining disruptions (i.e., coordination/situational awareness, patient-related disruptions, and team/organizational disruptions) were judged to affect everyone in the operating room equally often.
-
Main effect of group (F(2, 38) = 4.4, p < 0.05): surgeons estimated lower frequencies for all disruptions (M surgeons = 25%; SE = 5%) than nurses (M nurses = 42%; SE = 4%; p < 0.01) or anesthetists/operating departmental practitioners (M anaesthetists/ODPs = 37%; SE = 4%; p < 0.05).
(ii) Disruption contribution to error
-
Main effect of target (F(1, 36) = 6.20, p < 0.05): the disruptions were judged to be contributing to others’ errors more than to errors of one’s own.
-
Main effect of disruption type (F(5, 180) = 16.68, p < 0.001): patient-related disruptions were judged as more serious contributors to error than all other disruptions (all pair-wise ps < 0.01) and communication issues were judged as less serious contributors than all disruptions except team/organizational disruptions (all pair-wise ps < 0.05).
-
Interaction between Target and Disruption type (F(5, 180) = 4.79, p < 0.001): the breaking down of the interaction into “self” versus “others” differences across the six disruption types revealed that the participants judged others as more vulnerable than themselves to error resulting from individual disruptions (t(51) = 3.99, p < 0.001), from disruptions in the operating room environment (t(53) = 3.36, p < 0.01), and from communication issues (t(58) = 2.46, p < 0.05). The three remaining disruptions were judged as contributing equally to errors for everyone in the operating room.
(iii) Goal obstruction by disruption
-
Main effect of disruption type (F(5, 180) = 13.04, p < 0.001): patient-related disruptions were judged as more serious contributors to error than all other disruptions (all pair-wise ps < 0.01), and team/organizational disruptions were judged as less serious contributors than all disruptions except communication issues (all pair-wise ps < 0.05).
-
Interaction between target and disruption type (F(5, 180) = 5.77, p < 0.001): the breaking down of the interaction into “self” versus “others” differences across the six disruption types revealed that the participants judged that the goals of the procedure are more affected for others than they are for themselves by individual issues (t(53) = 3.51, p < 0.01), by disruptions in the operating room environment (t(54) = 2.21, p < 0.05), and by communication problems (t(59) = 2.49, p < 0.05). No such differences were obtained for the remaining three disruptions.
Rights and permissions
About this article
Cite this article
Sevdalis, N., Forrest, D., Undre, S. et al. Annoyances, Disruptions, and Interruptions in Surgery: The Disruptions in Surgery Index (DiSI). World J Surg 32, 1643–1650 (2008). https://doi.org/10.1007/s00268-008-9624-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00268-008-9624-7