Skip to main content
SpringerLink
Log in

Workload assessment of surgeons: correlation between NASA TLX and blinks

  • Published:
Surgical Endoscopy Aims and scope Submit manuscript

Abstract

Background

Blinks are known as an indicator of visual attention and mental stress. In this study, surgeons’ mental workload was evaluated utilizing a paper assessment instrument (National Aeronautics and Space Administration Task Load Index, NASA TLX) and by examining their eye blinks. Correlation between these two assessments was reported.

Methods

Surgeons’ eye motions were video-recorded using a head-mounted eye-tracker while the surgeons performed a laparoscopic procedure on a virtual reality trainer. Blink frequency and duration were computed using computer vision technology. The level of workload experienced during the procedure was reported by surgeons using the NASA TLX.

Results

A total of 42 valid videos were recorded from 23 surgeons. After blinks were computed, videos were divided into two groups based on the blink frequency: infrequent group (≤6 blinks/min) and frequent group (more than 6 blinks/min). Surgical performance (measured by task time and trajectories of tool tips) was not significantly different between these two groups, but NASA TLX scores were significantly different. Surgeons who blinked infrequently reported a higher level of frustration (46 vs. 34, P = 0.047) and higher overall level of workload (57 vs. 47, P = 0.045) than those who blinked more frequently. The correlation coefficients (Pearson test) between NASA TLX and the blink frequency and duration were −0.17 and 0.446.

Conclusion

Reduction of blink frequency and shorter blink duration matched the increasing level of mental workload reported by surgeons. The value of using eye-tracking technology for assessment of surgeon mental workload was shown.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Tendick F, Jennings RW, Tharp G, Stark L (1993) Sensing and manipulation problems in endoscopic surgery: experiment, analysis, and observation. Presence 2:66–81

    Google Scholar 

  2. Keehner MM, Tendick F, Meng MV et al (2004) Spatial ability, experience, and skill in laparoscopic surgery. Am J Surg 188:71–75

    Article  PubMed  Google Scholar 

  3. Cuschieri A (1995) Visual displays and visual perception in minimal access surgery. Semin Laparosc Surg 13:209–214

    Google Scholar 

  4. Berguer R, Chen J, Smith WD (2003) A comparison of the physical effort required for laparoscopic and open surgical techniques. Arch Surg 138:967–970

    Article  PubMed  Google Scholar 

  5. Berguer R, Smith WD, Chung YH (2001) Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surg Endosc 15:1204–1207

    Article  PubMed  CAS  Google Scholar 

  6. Klein MI, Warm JS, Riley MA, Matthews G, Gaitonde K, Donovan JF (2008) Perceptual distortions produce multidimensional stress profiles in novice users of an endoscopic surgery simulator. Hum Factors 50:291–300

    Article  PubMed  Google Scholar 

  7. Carswell CM, Clarke D, Seales WB (2005) Assessing mental workload during laparoscopic surgery. Surg Innov 12:80–90

    Article  PubMed  Google Scholar 

  8. Cao CG (2007) Guiding navigation in colonoscopy. Surg Endosc 21:480–484

    Article  PubMed  CAS  Google Scholar 

  9. O’Connor A, Schwaitzberg SD, Cao CG (2008) How much feedback is necessary for learning to suture? Surg Endosc 22:1614–1619

    Article  PubMed  Google Scholar 

  10. Stefanidis D, Haluck R, Pham T et al (2007) Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center. Surg Endosc 21:1158–1164

    Article  PubMed  Google Scholar 

  11. Zheng B, Cassera MA, Martinec DV, Spaun GO, Swanstrom LL (2010) Measuring mental workload during the performance of advanced laparoscopic tasks. Surg Endosc 24:45–50

    Article  PubMed  Google Scholar 

  12. Ryu K, Myung R (2005) Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. Int J Ind Ergon 35:991–1009

    Article  Google Scholar 

  13. Andreassi JL (2000) Psychophysiology: human behavior and physiological response, 4th edn. Lawrence Erlbaum Associates, London

    Google Scholar 

  14. Marshall SP (2007) Identifying cognitive state from eye metrics. Aviat Space Environ Med 78:B165–B175

    PubMed  Google Scholar 

  15. Caffier PP, Erdmann U, Ullsperger P (2003) Experimental evaluation of eye-blink parameters as a drowsiness measure. Eur J Appl Physiol 89:319

    Article  PubMed  Google Scholar 

  16. Benedetto S, Pedrotti M, Minin L, Baccino T, Re A, Montanari R (2011) Driver workload and eye blink duration. Transp Res F 14:199–208

    Article  Google Scholar 

  17. Smith P, Shah M, Lobo NDV (2000) Monitoring Head/Eye Motion for Driver Alertness with One Camera. In: Proceedings of the 15th international conference on pattern recognition (ICPR’00), Barcelona, Spain, 3–7 September 2000

  18. Veltman JA, Gaillard AWK (1998) Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41:656–669

    Article  PubMed  CAS  Google Scholar 

  19. Zheng B, Tien G, Atkins SM et al (2011) Surgeon’s vigilance in the operating room. Am J Surg 201:673–677

    Article  PubMed  Google Scholar 

  20. Jiang X, Tien G, Huang D, Zheng B, Atkins SM (2012) Capturing eye blinks from video-based eye-tracking. Behav Res Methods (accepted). Paper ID: BR-Org-12-012

  21. Berguer R, Smith W (2006) An ergonomic comparison of robotic and laparoscopic technique: the influence of surgeon experience and task complexity. J Surg Res 134:87–92

    Article  PubMed  Google Scholar 

  22. Howard SK, Gaba DM (2004) Trainee fatigue: are new limits on work hours enough? CMAJ 170:975–976

    Article  PubMed  Google Scholar 

  23. Dexter F, Epstein RH (2006) Holiday and weekend operating room on-call staffing requirements. Anesth Analg 103:1494–1498

    Article  PubMed  Google Scholar 

  24. Zheng B, Rieder E, Cassera MA et al (2012) Quantifying mental workloads of surgeons performing natural orifice transluminal endoscopic surgery (NOTES) procedures. Surg Endosc. doi:10.1007/s00464-011-2038-x

Download references

Acknowledgments

We thank the Canadian Natural Sciences and Engineering Research Council (NSERC) and the Royal College of Physicians and Surgeons in Canada (RCPSC) Medical Education Research Grant for funding this project.

Disclosures

Dr. Neely Panton receives funds from Ethicon Endo-Surgery for fellow education and is on the scientific advisory board of Ethicon Endo-Surgery. Dr. Bin Zheng, Xianta Jiang, Geoffrey Tien, Dr. Adam Meneghetti, and Dr. Stella Atkins have no conflicts of interest or financial ties to disclose.

Author information

Authors and Affiliations

  1. Department of Surgery, 3-002F Li Ka Shing Centre for Health Research Innovation, University of Alberta, 8440-112 St. NW, Edmonton, AB, Canada

    Bin Zheng

  2. Computing Science, Simon Fraser University, Burnaby, BC, Canada

    Xianta Jiang, Geoffrey Tien & M. Stella Atkins

  3. Department of Surgery, University of British Columbia, Vancouver, BC, Canada

    Adam Meneghetti & O. Neely M. Panton

Authors
  1. Bin Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xianta Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Geoffrey Tien
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Adam Meneghetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. O. Neely M. Panton
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. M. Stella Atkins
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Zheng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zheng, B., Jiang, X., Tien, G. et al. Workload assessment of surgeons: correlation between NASA TLX and blinks. Surg Endosc 26, 2746–2750 (2012). https://doi.org/10.1007/s00464-012-2268-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00464-012-2268-6

Keywords

Search

Navigation