Simulation in laparoscopic surgery: a concurrent validity study for FLS
- 225 Downloads
Current assessments using the fundamentals of laparoscopic surgery (FLS) tasks are labour intensive and depend heavily on expert raters. Hand motion analysis may offer an alternative method of objective evaluation of FLS performance.
The aim of this study was to assess whether a correlation exists between the expert rated assessments of the FLS tasks and computer-based assessment of motion efficiency using the Imperial College surgical assessment device (ICSAD).
We recruited 26 volunteer subjects who were stratified into three experience groups: juniors (PGY1–3) (N = 13), seniors (PGY4,5) (N = 7) and staff surgeons (N = 6). All subjects performed four FLS tasks: (1) peg transfer, (2) pattern cut, (3) endoloop and (4) intracorporeal suturing. Performance was assessed by both standard FLS expert rating and motion analysis using ICSAD. Group differences were analyzed using the Kruskal–Wallis test, and Spearman coefficient analyses were employed to compare FLS and ICSAD scores.
FLS expert-derived scores discriminated effectively between experience groups for all tasks (p < 0.05). Motion efficiency scores discriminated between experience groups for tasks 1, 3 and 4 for number of movements (p < 0.05), tasks 1 and 4 for total distance (p < 0.05) and tasks 1, 2, 3 and 4 for total time (p < 0.005). There was a significant correlation between total FLS expert scores and the motion efficiency metrics of total distance, number of movements and total time (Spearman coefficient and p values of 0.81, < 0.001; 0.76; < 0.001; and 0.93, < 0.001, respectively).
There is a high correlation between FLS standard scoring and motion efficiency metrics. The use of ICSAD for the objective assessment of FLS tasks may in the future offer an adjunctive method of evaluation. ICSAD metrics are potentially less labour intensive due to the instant and fully automated computerized scoring that it provides.
KeywordsEducation Training Endoscopy
- 4.SAGES FLS program. Available at www.flsprogram.org. Accessed September 10, 2007
- 5.McCluney AL, Cao J, Polyhronopoulos GN, Stanbridge DD, Feldman LS, Fried GM (2007) Automated ProMIS Simulator metrics predict readiness for FLS certification SAGES 2007 Education/Outcomes - P279Google Scholar
- 10.Taffinder NJ, Smith S, Mair J (1999) Can a computer measure surgical precision? Reliability, validity and feasibility of the ICSAD. Surg Endosc 13(suppl 1):81Google Scholar
- 16.Fitts PM, Posner MI (1967) Learning and skilled performance in human performance. Brock-Cole, BelmontGoogle Scholar
- 17.McCluney AL, Feldman LS, Fried GM (2006) Validation of the ProMIS hybrid simulator using a standard set of laparoscopic tasks. SAGES 2006 Education/Outcomes-P237Google Scholar
- 23.Dubrowski A, Larmer JC, Leming JK, Brydges R, Carnahan H, Park J (2006) Quantification of process measures in laparoscopic suturing. Surg Endosc Oct 9 [Epub ahead of print] Avaliable at http://www.springerlink.com/content/100368/ Accessed September 5 2007