Making a Difference Through Improving Teamwork in the Operating Room: A Systematic Review of the Evidence on What Works
- 2.5k Downloads
Surgical patients are at risk of harm from avoidable adverse events, many of which are at least in part attributable to failures in teamwork and communication. We undertook a systematic review of studies of interventions to improve teamwork and communication in the operating room (OR) that measured an outcome important for patient care in the clinical environment. We found good evidence to support several interventions: structured approaches to information sharing between OR team members; ongoing programmes of team training; and organisational changes to support team function. Many studies demonstrated improved team function in the clinical environment, improved OR processes, and/or improved patient outcomes. This review identified successful approaches to improving teamwork and communication in the OR and provided recommendations for practice.
KeywordsMultidisciplinary Interprofessional Teamwork Operating room Anaesthesiology Communication
Every year millions of people are disabled or die because of adverse events in hospital. A recent study puts the number of adverse events at approximately 10 % of hospitalisations globally, or 42.7 million incidents annually. For patients, this equates to 23 million years lost through disability or death every year . Reducing potentially avoidable harm in hospitalised patients must be a key focus for advancing the quality of medical care for this century.
There is abundant evidence that failures in teamwork and communication contribute to these millions of adverse events. The operating room (OR) is a high-acuity, complex, and error-prone environment that is vulnerable to adverse events, and we now have considerable evidence that failures in teamwork and communication in the OR are frequent and affect patient care: an analysis of recordings of six complex operations found one communication failure every 8 min , and an observational study found communication failures in approximately 30 % of team exchanges, with a third of these resulting in effects that could threaten patient safety . Communication between surgeons and anaesthesiologists has been evaluated as poor in a number of studies [4, 5, 6].
Professional ‘tribalism’ may account for some of these communication and teamwork difficulties . OR team members often have limited understanding of the roles and capabilities of those from different disciplines [8, 9], which may cause conflict and hinder the achievement of team goals. Furthermore, OR staff may not always have insight into their lack of awareness: an interview-based study found that OR professionals tended to overrate their own understanding of their colleagues’ roles relative to the understanding that colleagues attributed to them, and this was especially a tendency among surgeons .
Operating room team members may have limited insight into their own impact on team dynamics. In one study, surgeons, nurses and anaesthesiologists independently rated three video-based scenarios for the three professions’ level of tension, responsibility for creating tension, and responsibility for resolution. The three professions rated tension levels of the various scenarios similarly, but often rated their own profession as having relatively less responsibility than the others for creating and resolving tension .
Model for effective teams
Underpinning mechanisms for effective teamwork
Shared mental models
A common understanding among the team of the tasks, goals, and capabilities of the team, which allows for coordinated organisation of activities
The shared belief that team members will perform their roles and protect the interests of their teammates
The exchange of information that is directed from a sender to a receiver and confirmed or read-back by the receiver
Dimensions of effective teamwork
Ability to direct and coordinate the activities of the other team members, assess team performance, assign tasks, develop team knowledge, skills, and abilities, motivate team members, plan and organise, and establish a positive atmosphere
Mutual performance monitoring
Ability to develop common understanding of the team environment and apply appropriate strategies to accurately monitor teammate performance
Ability to anticipate other team members’ needs through accurate knowledge about their responsibilities. This includes the ability to shift workload among members to achieve balance during periods of high workload or pressure
Ability to adjust strategies based on information gathered from the environment including how the team is managing the situation. Altering a course of action or team member task allocation in response to changing conditions [internal or external]
Propensity to take other’s behaviour into account during group interactions and the belief in the importance of the team’s goal over the individual members’ goal
We have identified that adverse events are common and contribute significantly to poor outcomes for patients; we have identified that teamwork and communication are key contributors to these adverse events; we have a theoretical model of what effective teams look like.
We were interested in finding out, from the perspective of anaesthesiologists, what interventions to improve teamwork and communication in the OR had evidence supporting their effectiveness.
To this end, we undertook a systematic review of studies that evaluated interventions to improve teamwork and communication in the OR that had measured the impact of the intervention on the way teams functioned in the OR, on processes in the OR, or on patient outcomes. Our focus was on studies that demonstrated an effect in the clinical environment.
Method: Looking for Evidence
We conducted a search of the MEDLINE [Ovid] database on 15 August 2013 using the search strategy: [(team$ or interprofessional or multidisciplinary or interdisciplinary) and (“operating room” or theatre or “surgical suite”)]. We limited the findings to articles published since 2003. This resulted in identifying 1,242 articles. From these we excluded case reports, articles that were not in English, not set in the OR, or reported only on technical procedures. Articles were included if the title mentioned “safety” or “errors” or “briefing” or “checklists” or “communication” or “team training” or another team process. After this, 287 articles remained, 13 of which were duplicates.
Articles that did not include the anaesthesia team, included only one OR subteam, or were not set in the OR (i.e. we excluded PACU, ward, nursing team only, surgical team only).
Letters, opinion pieces, or commentary on primary studies.
Articles that reported measurement tools only.
Articles that assessed only knowledge, not attitudes or behaviour (measurements of changes in attitudes were included but post-test knowledge reports were not).
Articles that did not evaluate an intervention in comparative fashion (i.e. we excluded post-intervention descriptive studies if there were no control or pre-intervention data).
Articles that did not report data from the clinical setting (i.e. post-course, end-of-day evaluations were excluded).
Studies that did not report a teamwork process (or attitude), OR process, or patient outcome.
We included seven additional articles we were aware of from other sources. A check of the reference lists of all included articles plus 13 review articles discovered in the course of the search identified a further nine articles. In total we included 46 articles in the review.
Each article was then reviewed and the following recorded: author, year, intervention category (checklist, briefing, team training, other), site, design, OR specialty, study population, number of participants, the intervention, the comparison group, length of follow-up, teamwork process measured, medical management process measured, and patient outcome.
Results: What Works
Studies of interventions to improve teamwork fell into four main categories: briefing protocols (6 studies), checklists (17 studies), inter-professional team training (20 studies), and organisational change (3 studies).
Briefing of the OR team prior to beginning a case enables the development of a shared team mental model about the goals for surgery and any potential difficulties, and it allows the different team members to contribute to decision-making and plan ahead. There is good evidence that preoperative briefings improve communication between team members and save the lives of patients.
A preoperative briefing checklist or protocol can improve team attitudes towards safety  and decrease delays and breakdowns in communication between team members [13, 14] with significant reductions in observed failures in communication [15, 16∙]. Furthermore, briefings can reduce the rate of non-routine surgical events  and disruptions to surgery , and there is a suggestion that the incidence of wrong-site surgery is decreased .
Factors contributing to the success of programmes to introduce briefing into the OR include engagement of OR leaders and managers, an extended period of implementation, engaging OR team members in the development of the items to be included in the briefing, video modelling of ideal implementation, and in-theatre prompting and feedback on the use of the briefing during the introductory phase [16∙, 18, 19].
The Veterans’ Health Administration (VHA) instituted a comprehensive programme of team training that includes a briefing component. Evaluation of this intervention suggests that compliance with the briefing is directly related to patient mortality. Where the degree to which a facility had embraced briefings was rated on a four-point scale, they found 6 lives per 10,000 could be saved for every point improvement on the scale. If OR teams changed their practices from no or limited briefing and adopted a high-quality preoperative briefing, this could save two lives for every 1,000 operative patients [20∙∙].
Checklists can structure information sharing and, like briefings, aid the development of shared team mental models, identify errors and omissions, and improve communication between health professionals. The WHO Surgical Safety Checklist (WHO SSC) [21∙] was designed for use within the OR. One aim, amongst others, was to improve teamwork. The Checklist includes items requiring introduction of team members and their roles, and invites expressions of concern. The Surgical Patient Safety System (SURPASS) checklist [22∙∙] extends beyond the OR to include the entire surgical patient journey. Substantial benefits for patients from both checklists have been reported.
The WHO SSC [21∙, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32] has been evaluated in longitudinal studies comparing pre- and post-implementation, and in between-hospital comparisons. Significant reductions in deaths and complication rates have been reported. A controlled trial of the SURPASS checklist at six intervention and five control hospitals in The Netherlands found complication rates decreased from 27.3 per 100 patients to 16.7 (a 38.9 % reduction) in the intervention hospitals and mortality also significantly declined (1.5–0.8 %). There was no change in the control hospitals [22∙∙]. Better checklist compliance was associated with lower rates of complications [22∙∙]. This result is supported by studies on the WHO SSC [21∙, 27, 30, 31, 32] where the aggregate mortality rate (pre-intervention 19,417 patients, post-intervention 16,499 patients) decreased from 2.81 to 2.24 %. Decreases in complications after WHO SSC introduction ranged from 10.6 to 59.0 % [21∙, 27, 30, 32].
The use of checklists has been associated with an increase in compliance with various important actions: antibiotic timing [18, 27] and DVT prophylaxis [18, 33]; patient identity checks ; and frequency of sign-in, time-out, and sign-out [23, 35]. Checklists appear to improve communication between the anaesthesiologist and surgeon preoperatively  and improve the self-reported safety climate or teamwork attitudes [24, 25, 26].
The specific components of these checklists necessary to achieve their potential benefits are unclear. It may be that staff become more attuned to a culture of safety when checklists are employed, or that sharing of names and roles facilitates the development of the team. However, despite the compelling evidence on the effectiveness of checklists, compliance with checklist completion is often low .
Interprofessional team training interventions have been shown to have significant positive effects on OR processes, teamwork attitudes, and team processes, with some evidence of improved patient outcomes. Improved OR processes include reduced incorrect surgical counts ; more timely antibiotic administration, DVT prophylaxis, and beta-blockade [37, 38]; and reduced technical and procedural errors, and increased compliance with briefings, checklists, and time-out [38, 39, 40, 41]. Team training has also been shown to reduce OR room turnover time , increase the percentage of cases starting on time, and reduce case delays [37, 39, 42].
Teamwork training can also improve teamwork processes in the OR and staff attitudes towards safety [36, 39, 42, 43, 44, 45]. Reduced communication errors  and improved scores for communication between team members  have been reported. Scores for teamwork in OR teams have also been shown to improve in some studies. McCulloch et al.  found significant improvements in scores on a validated teamwork in the OR rating tool (NOTECHS) using a pre-/post-intervention study design, although this hasn’t been convincingly replicated in other studies . One of the difficulties with such studies is the reliability of the measurement tools, and the variable clinical challenges, team composition, and surgical context in the OR.
There is some evidence supporting reduced patient mortality and morbidity following team training interventions [20∙∙, 37, 39, 43, 46, 47]. One study demonstrated reduction in the rate of retained foreign bodies . However, other studies have reported no change to morbidity and mortality statistics , and some of the positive findings have been in multimodal interventions, which included a range of interventions including the introduction of briefing and debriefing checklists [20∙∙].
Some common features are apparent in effective team training interventions. The VHA team training programme [20∙∙] and the Team STEPPS programme  are both very comprehensive, targeting all of the elements in Salas’ model of teamwork. The training is led by senior clinical staff and is conducted with all multidisciplinary members of the OR team together. The educational methods involve active participation in role plays and video modelling of good teamwork. The VHA intervention is sustained with quarterly follow-up calls to each site and is mandated top-down, but with local site flexibility.
Finally, team training using simulation has shown improvement, 1 year after an interactive workshop, in the perception that all OR personnel are working as a team in cardiac surgery . No other simulation studies in our search reported an impact in the clinical OR post-training.
Observation and analysis of how OR teams function can also suggest strategies for improvement. We found three studies that described an organisational change: one study of a process redesign, one introducing structured communication protocols, and one evaluating an intervention on team composition.
One study prospectively observed the workflow of OR team members and changes were implemented where inefficiencies were observed. Workflow diagrams were used to highlight inefficiencies and identify critical moments of overload where brief backup from other personnel was needed. The redesign resulted in decreased OR turnaround time .
In cardiac surgery, the aviation industry’s ‘sterile cockpit’, where communications are protocol-based during take-off and landing, provided the basis for a structured communication protocol for eight critical events in cardiopulmonary bypass. Importantly ‘call-back’ of all exchanges was instituted as a standard procedure. These structured communication protocols, including closed-loop communication, reduced communication breakdowns significantly .
Having a fixed team throughout the day, rather than having team members come and go, seems to improve teamwork. In two hospitals performing bariatric surgery, roster changes were made to keep team composition stable throughout the day. This intervention improved the perceptions of teamwork and safety climate and decreased operative time .
It is clear that many of the above interventions have the potential to improve patient safety. Briefings, use of checklists such as the WHO SSC and SURPASS, team training and well-informed organisational changes can improve OR processes and team function, and reduce harm to patients. Successful interventions often target one or more aspects of the theoretical model for effective teams [11∙] (Table 1). Different interventions can each target different aspects of teamwork, so a multimodal approach would seem most likely to be effective.
A shared team mental model, i.e. a shared understanding of the plan and goals and each person’s responsibilities, is crucial for good team function and is supported by preoperative briefings and checklists. Mutual performance monitoring is supported by checklists, ensuring that all members are aware the others have completed their tasks. This invites backup behaviour and builds mutual trust. Closed-loop communication is directly targeted in several interventions, most notably the introduction of communication protocols in cardiac surgery . Outside of the OR, similar findings are being reported with unanticipated improvements in patient morbidity and mortality from interventions where the whole multidisciplinary patient care team meets every day to discuss and agree on the concerns and plan for care for the patient .
The effects of some of these interventions appear to decay. Forse et al.  observed over 4 years, where processes at first improved then started to revert. Halverson et al.  noted decreases in briefing compliance over time. Nurok et al.  found that the effect was not sustained, although some studies report that effects increase with time as the interventions become institutionalised [20∙]. This suggests a need for on-going monitoring and evaluation.
Given the disparate nature of the studies included, we did not undertake a quantitative meta-analysis. Some studies measuring similar outcome variables used different measurement tools, such as the American College of Surgeons National Surgical Quality Improvement Programme list of postoperative complications in several studies of the WHO checklist, whereas the Dutch National Surgical Adverse Event Registration System was used to evaluate the SURPASS Checklist.
Many researchers have described interventions to improve teamwork and communication. Of note, simulation-based team training is well established in anaesthesia. It was therefore somewhat surprising that only one simulation-based study met our criteria for inclusion. This is likely to reflect the difficulty of collecting the evidence in the clinical environment rather than the value of such interventions. While there is evidence that behaviours in the simulated environment do reflect those in the clinical environment [55, 56], the focus of this review was restricted to measurable changes to processes or team function in the clinical environment or to patient outcome.
Simulation-based studies have added observational evidence on communication failures and errors to guide interventions [57, 58], have successfully taught strategies to improve communication and teamwork , have demonstrated improved teamwork and information sharing in the simulation environment [60, 61, 62], and have facilitated the development and validation of instruments to measure teamwork in the clinical environment [63, 64]. Also, a recent simulation study suggested that crisis checklists increase adherence to lifesaving processes of care .
Simulation can provide a powerful trigger to challenge assumptions, identify deficiencies in communication, and change attitudes. Simulation could potentially lay the groundwork for a more team-oriented approach to clinical practice and facilitate the introduction of processes such as checklists and briefings.
The nature of much teamwork research in the OR means that studies are predominantly pre- and post-intervention studies, frequently with data collected by self-report. Such studies are at risk of bias from confounding factors, a lack of blinding, and influences such as the Hawthorne effect. Many of the studies we report possess an inherent risk of bias that could affect the interpretation of results. Nevertheless, we believe there are several key well-constructed studies reported here, which offer relatively unambiguous evidence for the benefits of teamwork interventions. These interventions include checklists, briefings, and sophisticated team training programmes.
No amount of protocols or skills training will work, or have a sustained effect, if the culture of the OR is such that team members—or even one team member—fail to engage. It seems likely that a multimodal and multidisciplinary approach is needed to both develop the skills and organisational structure required to support teamwork and, importantly, to develop a culture committed to reducing patient harm by embracing a team-based approach to care of surgical patients. Anaesthesiologists have led the way in interventions to improve patient safety and are well placed to provide leadership in the OR to implement evidenced-based strategies to improve teamwork and communication.
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
- 11.∙ Salas E, Sims D, Burke C. Is there a “Big Five” in Teamwork? Small Group Res. 2005;36:555–599. Eduardo Salas is a world expert on effective teamwork across a number of industries. His model of the components of effective teamwork serves as a useful framework within which to target and evaluate team training interventions in healthcare. Google Scholar
- 12.DeFontes J, Surbida S. Preoperative safety briefing project. Permanente J. 2004;8:21–7.Google Scholar
- 16.∙ Lingard L, Regehr G, Orser B, Reznick R, Baker GR, Doran D, et al. Evaluation of a preoperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication. Arch Surg. 2008;143:12–17. Given that root cause analysis links communication errors to adverse events, this study demonstrates a possible mechanism through which team briefings may lower adverse events. It demonstrates a significant reduction in communication failures after the introduction of case briefings. Google Scholar
- 20.∙∙ Neily J, Mills PD, Young-Xu Y, Carney BT, West P, Berger DH, et al. Association between implementation of a medical team training program and surgical mortality. JAMA. 2010;304:1693–1700. This large study of 108 Veterans Health Administration Hospitals provides a controlled demonstration of the association between a mandated team training programme and decreased surgical mortality. The sheer size of this study makes its conclusions about the generalisability of team training effectiveness hard to ignore. Google Scholar
- 21.∙ Haynes AB, Weiser TG, Berry WR, Lipsitz S, Breizat A-HS, Dellinger EP, et al. A surgical safety checklist to reduce morbidity and mortality in a global population. NEJM. 2009;360:491–499. This is the first study to demonstrate the association between the WHO Surgical Safety Checklist and reduced surgical mortality. It does so across eight locations globally. Google Scholar
- 22.∙∙ de Vries EN, Prins HA, Crolla RMPH, den Outer AJ, van Andel G, van Helden SH, et al. Effect of a comprehensive surgical safety system on patient outcomes. NEJM. 2010;363:1928–1937. This study demonstrates the effectiveness of a comprehensive surgical safety checklist in reducing surgical complications. This is a significant study that addresses some shortcomings of the WHO Surgical Safety Checklist study (Haynes 2009) by including control hospitals where no reduction in complications was demonstrated. The fact this study took place in The Netherlands diminishes the weight of criticisms claiming that checklists only have their effect in hospitals where standard of care is poor. Google Scholar
- 23.Abdel-Rehim S, Morritt A, Perks G. WHO surgical checklist and its practical application in plastic surgery. Plast Surg Int 2011. 2011;2011:579579.Google Scholar
- 25.Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-HS, Dellinger EP, et al. Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention. BMJ Qual Saf. 2011;20:102–7.PubMedCrossRefGoogle Scholar
- 49.Stevens L, Cooper JB, Raemer D, Schneider R, Frankel A, Berry WR, et al. Educational program in crisis management for cardiac surgery teams including high realism simulation. Cardiothorac Surg Educ Train. 2012;144:17–24.Google Scholar
- 51.Wadhera RK, Parker SH, Burkhart HM, Greason KL, Neal JR, Levenick KM, et al. Is the “sterile cockpit” concept applicable to cardiovascular surgery critical intervals or critical events? The impact of protocol-driven communication during cardiopulmonary bypass. J Thoracic Cardiovasc Surg. 2010;139:312–9.CrossRefGoogle Scholar
- 52.Stepaniak PS, Heij C, Buise MP, Mannaerts GHH, Smulders JF, Nienhuijs SW. Bariatric surgery with operating room teams that stayed fixed during the day: a multicenter study analyzing the effects on patient outcomes, teamwork and safety climate, and procedure duration. Anesth Analg. 2012;115:1384–92.PubMedCrossRefGoogle Scholar
- 53.Stein J, Mohan A, Payne C, Castle B, Burleson M, Methvin A, et al. Mortality reduction associated with structure, process, and management redesign of a hospital medicine unit. Society of Hospital Medicine Abstract Issue; April 1–4; San Diego 2012.Google Scholar
- 54.Nurok M, Lipsitz S, Satwicz P, Kelly A, Frankel A. A novel method for reproducibly measuring the effects of interventions to improve emotional climate, indices of team skills and communication, and threat to patient outcome in a high-volume thoracic surgery center. Arch Surg. 2010;145:489–95.PubMedCrossRefGoogle Scholar
- 55.Weller J, Torrie J, Shulruf B, Henderson R, Merry A, Henderson K, et al. The validity of simulation for team training for patient safety in anaesthesia: an observational study comparing team interactions in the operating room and the simulated environment. In: WFSA, editor. 15th WFSA World Congress of Anaesthesiologists; Buenos Aires2012.Google Scholar
- 59.Weller J, Torrie J, Boyd M, Frengley R, Garden S, Ng WL, et al. Improving team information sharing with a structured call-out in anaesthetic emergencies: a randomised controlled trial. Brit J Anaesth. 2014 (in press).Google Scholar
- 64.Cook D, Zendejas B, Hamstra S, Hatala R, Brydges R. What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Adv Health Sci Educ. 2013.Google Scholar