Construct validity of the ProMIS laparoscopic simulator
Laparoscopic surgery challenges both the surgical novice and experienced open surgeon with unique psychomotor adaptations. Surgical skills assessment has historically relied on subjective opinion and case experience. Objective performance metrics have stimulated much interest in surgical education over the last decade and proficiency-based simulation has been proposed as a paradigm shift in surgical skills training. New assessment tools must be subjected to scientific validation. This study examined the construct validity of a hybrid laparoscopic simulator with in-built motion tracking technology.
Volunteers were recruited from four experience groups (consultant surgeon, senior trainee, junior trainee, medical student). All subjects completed questionnaires and three tasks on the ProMIS laparoscopic simulator (laparoscope orientation, object positioning, sharp dissection). Motion analysis data was obtained via optical tracking of instrument movements. Objective metrics included time, path length (economy of movement), smoothness (controlled handling) and observer-recorded penalty scores.
One hundred and sixty subjects completed at least one of the three tasks. Significant group differences were confirmed for number of years qualified, age and case experience. Significant differences were found between experts and novices in all three tasks. Sharp dissection was the strongest discriminator of four recognised laparoscopic skill groups: consultants outperformed students and juniors in all three performance metrics and objective penalty score (p < 0.05), and only accuracy of dissection did not distinguish them from senior trainees (p = 0.261). Seniors dissected faster, more efficiently and more accurately than juniors and students (p < 0.05).
ProMIS provides a construct valid laparoscopic simulator and is a feasible tool to assess skills in a cross-section of surgical experience groups. ProMIS has the potential to objectively measure pre-theatre dexterity practice until an agreed proficiency level of dexterity is achieved. Future work should now examine whether training to expert criterion levels on ProMIS correlates with actual operative performance.
KeywordsLaparoscopy Simulation Training Validity Assessment
- 3.Heath RM, Gate T, Halloran C, Callaghan M, Paraoan M, Blair SD (2005) The European Working Time Directive ‘triple whammy’: hitting surgical trainees where it hurts. Br J Surg 92(Supp 1):113Google Scholar
- 4.Modernising Medical Careers: the response of the four UK Health Ministers to the consultation on Unfinished Business: Proposals for Reform of the Senior House Officer Grade. 26-2-0003Google Scholar
- 5.UK Health Departments. Modernising Medical Careers: the next steps. 15-4-2004. London, Department of HealthGoogle Scholar
- 6.http://www.iscp.ac.uk. 2006
- 13.Streiner D, Norman G (1989) Health measurement scales. New York, Oxford University PressGoogle Scholar
- 17.Royal College of Surgeons of England (2006) Inquiry into independent sector treatment centres. Ann R Coll Surg 88(Suppl):116–119Google Scholar
- 18.Cruelty to Animals Act. 39 and 40 Vict, 1–8. 1876. Ch77Google Scholar
- 25.Smith CD, Tung P (1998) Assessing laparoscopic manipulative skill: beyond the stopwatch. Surg Endosc 12:492Google Scholar
- 26.Schmidt R, Wrisberg C (2000) Motor Learning and Performance. Champaign, IL, Human KineticsGoogle Scholar
- 39.Chaudhry A, Sutton C, Wood J, Stone R, McCloy R (1999) Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. Ann R Coll Surg 81:281–286Google Scholar