Skip to main content

Advertisement

SpringerLink
Log in

Comprehensive Literature Search to Identify Assessment Tools for Operating Room Nontechnical Skills to Determine Common Critical Components

  • Original research
  • Published:
Medical Science Educator Aims and scope Submit manuscript

Abstract

Background

Effective use of nontechnical skills (NTS) contributes to the provision of safe, quality care in the fast-paced, dynamic setting of the operating room (OR). Inter-professional education of NTS to OR team members can improve performance. Such training requires the accurate measurement of NTS in order to identify gaps in their utilization by OR teams. Although several instruments for measuring OR NTS exist in the literature, each tool tends to define specific NTS differently.

Aim

We aimed to determine commonalities in defined measurements among existing OR NTS tools.

Methods

We undertook a comprehensive literature review of assessment tools for OR NTS to determine the critical components common to these instruments. A PubMed search of the literature from May 2009 to May 2019 combined various combinations of keywords and Medical Subject Headings (MeSH) related to the following subjects: teamwork, teams, assessment, debriefing, surgery, operating room, nontechnical, communication. From this start, articles were selected describing specific instruments. Three reviewers then identified the common components measured among these assessment tools. Reviewers collated kin constructs within each instrument using frequency counts of similarly termed and conceptualized components.

Results

The initial PubMed search produced 119 articles of which 24 articles satisfied the inclusion criteria. Within these articles, 10 assessment tools evaluated OR NTS. Kin constructs were grouped into six NTS categories in the following decreasing frequency order: communication, situation awareness, teamwork, leadership, decision making, and task management/decision making (equal).

Conclusion

NTS OR assessment tools in the literature have a variety of kin constructs related to the specific measured components within the instruments. Such kin constructs contain thematic cohesion across six primary NTS groupings with some variation in scale and scope. Future plans include using this information to develop an easy-to-use assessment tool to assist with debriefing in the clinical environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Hull L, Arora S, Kassab E, Kneebone R, Sevdalis N. Observational teamwork assessment for surgery: content validation and tool refinement. J Am Coll Surg. 2011;212(2):234–243.e1-5.

    Article  Google Scholar 

  2. Mishra A, Catchpole K, McCulloch P. The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre. Qual Saf Health Care. 2009;18(2):104–8.

    Article  Google Scholar 

  3. Spanager L, Beier-Holgersen R, Dieckmann P, Konge L, Rosenberg J, Oestergaard D. Reliable assessment of general surgeons’ non-technical skills based on video-recordings of patient simulated scenarios. Am J Surg. 2013;206(5):810–7.

    Article  Google Scholar 

  4. Mitchell L, Flin R, Yule S, Mitchell J, Coutts K, Youngson G. Development of a behavioural marker system for scrub practitioners’ non-technical skills (SPLINTS system). J Eval Clin Pract. 2013;19(2):317–23.

    Article  Google Scholar 

  5. Gawande AA, Zinner MJ, Studdert DM, Brennan TA. Analysis of errors reported by surgeons at three teaching hospitals. Surgery. 2003;133(6):614–21.

    Article  Google Scholar 

  6. McCulloch P, Mishra A, Handa A, Dale T, Hirst G, Catchpole K. The effects of aviation-style non-technical skills training on technical performance and outcome in the operating theatre. Qual Saf Health Care. 2009;18(2):109–15.

    Article  Google Scholar 

  7. Phitayakorn R, Minehart R, Pian-Smith MC, et al. Practicality of intraoperative teamwork assessments. J Surg Res. 2014;190(1):22–8.

    Article  Google Scholar 

  8. Fischer MM, Tubb CC, Brennan JA, Soderdahl DW, Johnson AE. Implementation of TeamSTEPPS at a Level-1 Military Trauma Center: The San Antonio Military Medical Center Experience. US Army Med Dep J. 2015:75–9.

  9. Lyk-Jensen HT, Jepsen RM, Spanager L, Dieckmann P, Ostergaard D. Assessing Nurse Anaesthetists’ Non-Technical Skills in the operating room. Acta Anaesthesiol Scand. 2014;58(7):794–801.

    Article  Google Scholar 

  10. Nicksa GA, Anderson C, Fidler R, Stewart L. Innovative approach using interprofessional simulation to educate surgical residents in technical and nontechnical skills in high-risk clinical scenarios. JAMA Surg. 2015;150(3):201–7.

    Article  Google Scholar 

  11. Glarner CE, McDonald RJ, Smith AB, et al. Utilizing a novel tool for the comprehensive assessment of resident operative performance. J Surg Educ. 2013;70(6):813–20.

    Article  Google Scholar 

  12. Sharma B, Mishra A, Aggarwal R, Grantcharov TP. Non-technical skills assessment in surgery. Surg Oncol. 2011;20(3):169–77.

    Article  Google Scholar 

  13. Catchpole KR, Dale TJ, Hirst DG, Smith JP, Giddings TA. A multicenter trial of aviation-style training for surgical teams. J Patient Saf. 2010;6(3):180–6.

    Article  Google Scholar 

  14. Rao R, Dumon KR, Neylan CJ, Morris JB, Riddle EW, Sensenig R, et al. Can simulated team tasks be used to improve nontechnical skills in the operating room? J Surg Educ. 2016;73(6):e42-7.

  15. Dedy NJ, Fecso AB, Szasz P, Bonrath EM, Grantcharov TP. Implementation of an effective strategy for teaching nontechnical skills in the operating room: a single-blinded nonrandomized trial. Ann Surg. 2016;263(5):937–41.

    Article  Google Scholar 

  16. Yule S, Parker SH, Wilkinson J, McKinley A, MacDonald J, Neill A, et al. Coaching non-technical skills improves surgical residents’ performance in a simulated operating room. J Surg Educ. 2015;72(6):1124–30.

    Article  Google Scholar 

  17. Pena G, Altree M, Field J, Sainsbury D, Babidge W, Hewett P, et al. Nontechnical skills training for the operating room: A prospective study using simulation and didactic workshop. Surgery. 2015;158(1):300–9.

  18. Beard JD, Marriott J, Purdie H, Crossley J. Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. Health Technol Assess. 2011;15(1):i–xxi 1-162.

    Article  Google Scholar 

  19. Spanager L, Konge L, Dieckmann P, Beier-Holgersen R, Rosenberg J, Oestergaard D. Assessing trainee surgeons’ nontechnical skills: five cases are sufficient for reliable assessments. J Surg Educ. 2015;72(1):16–22.

    Article  Google Scholar 

  20. Spanager L, Lyk-Jensen HT, Dieckmann P, Wettergren A, Rosenberg J, Ostergaard D. Customization of a tool to assess Danish surgeons non-technical skills in the operating room. Dan Med J. 2012;59(11):A4526.

    Google Scholar 

  21. Yule S, Paterson-Brown S, Maran N, Rowley D. Development of a rating system for surgeons’ non-technical skills. Med Educ. 2006;40:1098–104.

    Article  Google Scholar 

  22. Nguyen N, Elliott JO, Watson WD, Dominguez E. Simulation improves nontechnical skills performance of residents during the perioperative and intraoperative phases of surgery. J Surg Educ. 2015;72(5):957–63.

    Article  Google Scholar 

  23. Dedy NJ, Szasz P, Louridas M, Bonrath EM, Husslein H, Grantcharov TP. Objective structured assessment of nontechnical skills: Reliability of a global rating scale for the in-training assessment in the operating room. Surgery. 2015;157(6):1002–13.

    Article  Google Scholar 

  24. Gardner AK, Russo MA, Jabbour II, Kosemund M, Scott DJ. Frame-of-reference training for simulation-based intraoperative communication assessment. Am J Surg. 2016;212(3):548–551.e2.

    Article  Google Scholar 

  25. Undre S, Sevdalis N, Healey AN, Darzi S, Vincent CA. Teamwork in the operating theatre: cohesion or confusion? J Eval Clin Pract. 2006;12(2):182–9.

    Article  Google Scholar 

  26. Boet S, Pigford AA, Fitzsimmons A, Reeves S, Triby E, Bould MD. Interprofessional team debriefings with or without an instructor after a simulated crisis scenario: An exploratory case study. J Interprof Care. 2016;30(6):717–25.

    Article  Google Scholar 

  27. Kim J, Neilipovitz D, Cardinal P, Chiu M. A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as "CRM simulator study IB"). Simul Healthc. 2009;4(1):6–16.

    Article  Google Scholar 

  28. Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med. 2006;34(8):2167–74.

    Article  Google Scholar 

  29. Flin R, Mitchell L, McLeod B. Non-technical skills of the scrub practitioner: the SPLINTS system. ORNAC J. 2014;32(3):33–8.

    Google Scholar 

  30. Rhee AJ, Valentin-Salgado Y, Eshak D, Feldman D, Kischak P, Reich DL, et al. Team training in the perioperative arena: a methodology for implementation and auditing behavior. Am J Med Qual. 2017;32(4):369–75.

  31. Department of Defense Patient Safety Program, Agency for Healthcare Research and Quality (AHRQ). TeamSTEPPS 2.0 pocket guide: team strategies & tools to enhance performance and patient safety. 2013;AHRQ Pub. No. 14-0001-2 Replaces AHRQ Pub. No. 06-0020-2 Revised December 2013.

  32. Salas E, Sims DE, Burke CS. Is there a big five in teamwork? Small Group Res. 2005;36:555–99.

    Article  Google Scholar 

  33. Robertson ER, Hadi M, Morgan LJ, Pickering SP, Collins G, New S, et al. Oxford NOTECHS II: a modified theatre team non-technical skills scoring system. PLoS One. 2014;9(3):e9e0320.

  34. Salas E. Saving Lives With Teamwork: Guidance From Team Science. http://www.vtoxford.org/meetings/AMQC/Handouts2014/Day1A_20_SalasCarrollUmoren_Fri_PRECONSavingLives.pdf. Accessed 15 Oct 2019.

  35. Paige JT, Garbee DD, Kozmenko V, Yu Q, Kozmenko L, Yang T, et al. Getting a head start: high-fidelity, simulation-based operating room team training of interprofessional students. J Am Coll Surg. 2014;218(1):140–9.

Download references

Funding

This work was made possible through the generous support from a Medical Education Scholarship, Research, and Evaluation (MESRE) grant from the Southern Group on Educational Affairs (SGEA) of the Association of American Medical Colleges (AAMC) awarded in 2016.

Author information

Authors and Affiliations

  1. School of Nursing, LSU Health New Orleans Health Sciences Center, 1900 Gravier Street, New Orleans, LA, 70112, USA

    Deborah D. Garbee & Laura S. Bonanno

  2. Department of Surgery, LSU Health New Orleans Health Sciences Center, 1542 Tulane Avenue, Room 734, New Orleans, LA, 70112, USA

    Camille L. Rogers & John T. Paige

  3. John P. Ische Library, LSU Health New Orleans Health Sciences Center, 533 Bolivar Street, New Orleans, LA, 70112, USA

    Kathryn E. Kerdolff

Authors
  1. Deborah D. Garbee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Laura S. Bonanno
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Camille L. Rogers
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kathryn E. Kerdolff
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. John T. Paige
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Camille L. Rogers.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflicts of interest.

Ethical Approval

N/A

Informed Consent

N/A

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Garbee, D.D., Bonanno, L.S., Rogers, C.L. et al. Comprehensive Literature Search to Identify Assessment Tools for Operating Room Nontechnical Skills to Determine Common Critical Components. Med.Sci.Educ. 31, 81–89 (2021). https://doi.org/10.1007/s40670-020-01117-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40670-020-01117-6

Keywords

Search

Navigation