World Journal of Surgery

, Volume 34, Issue 2, pp 353–361

Development and Evaluation of an Observational Tool for Assessing Surgical Flow Disruptions and Their Impact on Surgical Performance

  • Sarah E. Henrickson Parker
  • Aaron A. Laviana
  • Rishi K. Wadhera
  • Douglas A. Wiegmann
  • Thoralf M. SundtIII

DOI: 10.1007/s00268-009-0312-z

Cite this article as:
Parker, S.E.H., Laviana, A.A., Wadhera, R.K. et al. World J Surg (2010) 34: 353. doi:10.1007/s00268-009-0312-z



Many researchers have previously explored the correlation between surgical flow disruptions and adverse events in cardiac surgery; however, there is no reliable tool to prospectively categorize surgical flow disruptions and the conditions that predispose a surgical team to adverse events.


Two independent raters of different medical and human factors expertise observed 12 cardiovascular operations and iteratively designed a surgical flow disruption tool (SFDT) to characterize surgical flow disruptions and the latent factors that contribute to adverse events. Categories to characterize surgical flow disruptions were created based on human factors models of human error. After the design period, both raters observed ten surgical cases using the tool to assess validity and inter-rater reliability.


Rating agreement (weighted kappa) for each category across the ten surgeries was moderate to very high, resulting in strong inter-rater reliability for each category on the surgical flow disruption tool. Use of the SFDT was simple and clear for observers of diverse backgrounds, including human factors experts and medical personnel.


This research depicts the development and utility of a tool to analyze surgical flow disruptions in the cardiovascular operating room with satisfactory inter-rater reliability. This tool is an important first step in systematically categorizing and measuring surgical flow disruptions and their impact on patient safety in the operating room.

Copyright information

© Société Internationale de Chirurgie 2009

Authors and Affiliations

  • Sarah E. Henrickson Parker
    • 1
  • Aaron A. Laviana
    • 2
  • Rishi K. Wadhera
    • 3
    • 4
  • Douglas A. Wiegmann
    • 5
  • Thoralf M. SundtIII
    • 6
  1. 1.School of Psychology, College of Life Sciences and Medicine, Kings CollegeUniversity of AberdeenAberdeenScotland, UK
  2. 2.Georgetown University School of MedicineWashingtonUSA
  3. 3.Institute of Public Health, School of Clinical MedicineUniversity of CambridgeCambridgeUK
  4. 4.Mayo Medical School, Mayo ClinicRochesterUSA
  5. 5.Department of Industrial and Systems EngineeringUniversity of Wisconsin-MadisonMadisonUSA
  6. 6.Division of Cardiovascular SurgeryMayo ClinicRochesterUSA