Face and construct validation of a virtual peg transfer simulator
- 373 Downloads
The Fundamentals of Laparoscopic Surgery (FLS) trainer box is now established as a standard for evaluating minimally invasive surgical skills. A particularly simple task in this trainer box is the peg transfer task which is aimed at testing the surgeon’s bimanual dexterity, hand–eye coordination, speed, and precision. The Virtual Basic Laparoscopic Skill Trainer (VBLaST©) is a virtual version of the FLS tasks which allows automatic scoring and real-time, subjective quantification of performance without the need of a human proctor. In this article we report validation studies of the VBLaST© peg transfer (VBLaST-PT©) simulator.
Thirty-five subjects with medical background were divided into two groups: experts (PGY 4–5, fellows, and practicing surgeons) and novices (PGY 1–3). The subjects were asked to perform the peg transfer task on both the FLS trainer box and the VBLaST-PT© simulator; their performance was evaluated based on established metrics of error and time. A new length of trajectory (LOT) metric has also been introduced for offline analysis. A questionnaire was used to rate the realism of the virtual system on a 5-point Likert scale.
Preliminary face validation of the VBLaST-PT© with 34 subjects rated on a 5-point Likert scale questionnaire revealed high scores for all aspects of simulation, with 3.53 being the lowest mean score across all questions. A two-tailed Mann–Whitney test performed on the total scores showed significant (p = 0.001) difference between the groups. A similar test performed on the task time (p = 0.002) and the LOT (p = 0.004) separately showed statistically significant differences between the experts and the novices (p < 0.05). The experts appear to be traversing shorter overall trajectories in less time than the novices.
VBLaST-PT© showed both face and construct validity and has promise as a substitute for the FLS for training peg transfer skills.
KeywordsVirtual reality Surgical training Face validity Construct Laparoscopy Length of trajectory
The authors gratefully acknowledge the support of this study by NIH/NIBIB (Grant No. 5R01EB010037). They also thank Alex Derevianko of Massachusetts General Hospital (MGH) for helping conduct the experiments and Saurabh Dargar of Rensselaer Polytechnic Institute for helping during the hardware design phase.
Venkata S. Arikatla, Dr. Ganesh Sankaranarayanan, Woojin Ahn, Amine Chellali, John Hwabejire, Marc DeMoya, Steven Schwaitzberg, Daniel B. Jones, Suvranu De, and Caroline Cao have no conflicts of interest or financial ties to disclose.
- 10.Zilles CB, Salisbury JK (1995) A constraint-based god-object method for haptic display. IEEE/RSJ Int Conf Intell Robots Syst 3:146–151Google Scholar
- 14.Epona Medical | LAP-X. Laparoscopy training. Available at http://www.lapx.eu/en/lapx.html. Accessed 13 May 2012
- 17.Pitzul KB, Grantcharov TP, Okrainec A (2012) Validation of three virtual reality Fundamentals of Laparoscopic Surgery (FLS) modules. Stud Health Technol Inf 173:349–355Google Scholar
- 21.Verner L, Oleynikov D, Holtmann S, Haider H, Zhukov L (2003) Measurements of the level of surgical expertise using flight path analysis from da Vinci robotic surgical system. Stud Health Technol Inf 94:373–378Google Scholar
- 22.Rosen J, MacFarlane M, Richards C, Hannaford B, Sinanan M (1999) Surgeon-tool force/torque signatures—evaluation of surgical skills in minimally invasive surgery. Stud Health Technol Inf 62:290–296Google Scholar
- 24.Kowalewski TM, Rosen J, Chang L, Sinanan MN, Hannaford B (2004) Optimization of a vector quantization codebook for objective evaluation of surgical skill. Stud Health Technol Inf 98:174–179Google Scholar