Abstract
Purpose
Laparoscopic surgery requires complex surgical skills; hence, surgeons require regular training to improve their surgical techniques. The quantitative assessment of a surgeon’s skills and the provision of feedback are important processes for conducting effective training. The aim of this study was to develop an inexpensive training system that provides automatic technique evaluation and feedback.
Methods
We detected the instrument using image processing of commercial web camera images and calculated the motion analysis parameters (MAPs) of the instrument to quantify performance features. Upon receiving the results, we developed a method of evaluating the surgeon’s skill level. The feedback system was developed using MAPs-based radar charts and scores for determining the skill level. These methods were evaluated using the videos of 38 surgeons performing a suturing task.
Results
There were significant differences in MAPs among surgeons; therefore, MAPs can be effectively used to quantify a surgeon’s performance features. The results of skill evaluation and feedback differed greatly between skilled and unskilled surgeons, and it was possible to indicate points of improvement for the procedure performed in this study. Furthermore, the results obtained for certain novice surgeons were similar to those obtained for skilled surgeons.
Conclusion
This system can be used to assess the skill level of surgeons, independent of the years of experience, and provide an understanding of the individual’s current surgical skill level effectively. We conclude that our system is useful as an inexpensive laparoscopic training system that might aid in skill improvement.
Similar content being viewed by others
References
Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. Am J Surg 199(1):115–120
Stefanidis D, Hope WW, Korndorffer JR Jr, Markley S, Scott DJ (2010) Initial laparoscopic basic skills training shortens the learning curve of laparoscopic suturing and is cost-effective. J Am Coll Surg 210(4):436–440
Scott DJ, Young WN, Tesfay ST, Frawley ST, Rege ST, Jones ST (2001) Laparoscopic skills training. Am J Surg 182(2):137–142
Ahmed A, Ishman SL, Laeeq K, Bhatti NI (2013) Assessment of improvement of trainee surgical skills in the operating room for tonsillectomy. Laryngoscope 123(7):1639–1644
Uemura M, Tomikawa M, Kumashiro R, Miao T, Souzaki R, Ieiri S, Ohuchida K, Lefor AT, Hashizume M (2014) Analysis of hand motion differentiates expert and novice surgeons. J Surg Res 188(1):8–13
Sugino T, Kawahira H, Nakamura R (2014) Surgical task analysis of simulated laparoscopic cholecystectomy with a navigation system. Int J Comput Assist Radiol Surg 9(5):825–836
Sy Chung, Landsittel D, Chon Ch, Ng Ch, Fuchs Ch (2005) Laparoscopic skills training using a webcam trainer. J Urol 173(1):180–183
Beard JH, Akoko L, Mwanga A, Mkony C, O’Sullivan P (2014) Manual laparoscopic skills development using a low-cost trainer box in Tanzania. J Surg Educ 71(1):85–90
Suzuki K, Nakamura R, Sugino T (2014) Surgical instruments trajectory analysis for training of endoscopic surgery. Trans Jpn Soc Med Biol Eng 52(suppl):O-267–O-268
Yamaguchi T, Suzuki K, Nakamura R (2016) Development of a visualization and quantitative assessment system of laparoscopic surgery skill based on trajectory analysis from USB camera image. Int J Comput Assist Radiol Surg 11(suppl):S254–256
Kaehler A, Bradski G (2008) Learning OpenCV. O’reilly Media
Horn BKP, Schunck BG (1981) Determining optical flow. Artif Intell 17(1–3):185–203
Brunelli R (2009) Template matching techniques in computer vision: theory and practice. Wiley, Hoboken
Morita S, Yamazawa K, Terazawa M, Yokoya N (2005) Networked remote surveillance system using omnidirectional image sensors. Ins IEICE Trans Inf Syst 88(5):864–875 (in Japanese)
Ward JH Jr (1963) Hierarchical grouping to optimize an objective function. J Am Stat Assoc 58(301):236–244
Krupa A, Gangloff J, Doignon C, de Mathelin MF, Morel G, Leroy J, Soler L, Marescaux J (2003) Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual "servoing". IEEE T Robot Autom 9:842–853
Tonet O, Ramesh TU, Megali G, Dario P (2006) Tracking endoscopic instruments without localizer: image analysis-based approach. Stud Health Technol Inform 119:544–549
Speidel S, Delles M, Gutt C, Dillmann R (2006) Tracking of instruments in minimally invasive surgery for surgical skill analysis. Med Imag Augment Real 4091:148–155
Voros S, Long J, Cinquin P (2006) Automatic localization of laparoscopic instruments for the visual servoing of an endoscopic camera holder. Med Image Comput Comput Assist Interv 4190:535–542
Bouarfa L, Akman O, Schneider A, Jonker PP, Dankelman J (2011) In vivo real-time tracking of surgical instruments in endoscopic video. Minim Invasive Ther Allied Technol 21:129–134
Climent J, Marés P (2004) Automatic instrument localization in laparoscopic surgery. Electron Lett Comput Vis Image Anal 4:21–31
Zia A, Sharma Y, Bettadapura V, Sarin LS, Ploetz T, Clements AM, Essa AI (2016) Automated video-based assessment of surgical skills for training and evaluation in medical schools. Int J Comput Assist Radiol Surg 11(9):1623–1636
Ahmidi N, Tao L, Sefati S, Gao Y, Lea C, Haro BB, Zappella L, Khudanpur S, Vidal R, Hager GD (2017) A dataset and benchmarks for segmentation and recognition of gestures in robotic surgery. IEEE Trans Biomed Eng 64(9):2025–2041
Oropesa I, Sanchez-Gonzalez P, Chmarra MK, Lamata P, Fernandez A, Sanchez-Margallo JA, Jansen FW, Dankelman J, Sánchez-Margallo FM, Gómez EJ (2013) EVA: laparoscopic instrument tracking based on endoscopic video analysis for psychomotor skills assessment. Surg Endosc 27:1029–1039
Raju A, Wang S, Huang J. (2016) M2CAI surgical tool detection challenge report. http://camma.u-strasbg.fr/m2cai2016/reports/Raju-Tool.pdf
Sahu M, Mukhopadhyay A, Szengel A, Zachow S (2016) Tool and phase recognition using contextual CNN features. arXiv:1610.08854
Hogle NJ, Liu Y, Ogden RT, Fowler DL (2014) Evaluation of surgical fellows’ laparoscopic performance using global operative assessment of laparoscopic skills (GOALS). Surg Endosc 28:1284–1290
Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113
Kurashima Y, Feldman LS, Al-Sabah S, Kaneva PA, Fried GM, Vassiliou MC (2011) A tool for training and evaluation of laparoscopic inguinal hernia repair: the global operative assessment of laparoscopic skills-groin hernia (GOALS-GH). Am J Surg 201:54–61
Matsuda T, Kanayama H, Ono Y, Kawauchi A, Mizoguchi H, Nakagawa K, Iwamura M, Shigeta M, Habuchi T, Terachi T (2014) Reliability of laparoscopic skills assessment on video: 8-year results of the endoscopic surgical skill qualification system in Japan. J Endourol 28:1374–1378
Dath D, Regehr G, Birch D, Schlachta C, Poulin E, Mamazza J, Reznick R, Macrae HM (2004) Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills. Surg Endosc 18:1800–1804
Satava RM, Cuschieri A, Hamdorf J (2003) Metrics for objective assessment. Surg Endosc 17:220–226
Korndorffer JR Jr, Dunne JB, Sierra R, Stefanidis D, Touchard CL, Scott DJ (2005) Simulator training for laparoscopic suturing using performance goals translates to the operating room. J Am Coll Surg 201:23–29
Acknowledgements
This research was partly supported by the Japan Science and Technology Agency, PRESTO (No. JPMJPR16D9). T. Yamaguchi acknowledges financial support from Frontier Science Program of Graduate School of Science and Engineering, Chiba University.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Rights and permissions
About this article
Cite this article
Yamaguchi, T., Nakamura, R. Laparoscopic training using a quantitative assessment and instructional system. Int J CARS 13, 1453–1461 (2018). https://doi.org/10.1007/s11548-018-1771-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-018-1771-1