Abstract
Background
The skills required for laparoscopic surgery are amenable to simulator-based training. Several computerized devices are now available. We hypothesized that the LAPSIM simulator can be shown to distinguish novice from experienced laparoscopic surgeons, thus establishing construct validity.
Methods
We tested residents of all levels and attending laparoscopic surgeons. The subjects were tested on eight software modules. Pass/fail (P/F), time (T), maximum level achieved (MLA), tissue damage (TD), motion, and error scores were compared using the t-test and analysis of variance.
Results
A total of 54 subjects were tested. The most significant difference was found when we compared the most (seven attending surgeons) and least experienced (10 interns) subjects. Grasping showed significance at P/F and MLA (p < 0.03). Clip applying was significant for P/F, MLA, motion, and errors (p < 0.02). Laparoscopic suturing was significant for P/F, MLA, T, TD, as was knot error (p < 0.05). This finding held for novice, intermediate, and expert subjects (p < 0.05) and for suturing time between attending surgeons and residents (postgraduate year [PGY] 1-4) (p < 0.05).
Conclusions
LAPSIM has construct validity to distinguish between expert and novice laparoscopists. Suture simulation can be used to discriminate between individuals at different levels of residency and expert surgeons.
Similar content being viewed by others
References
DJ Anastakis G Regehr RK Reznick M Cusimano J Murnaghan M Brown C Hutchison (1999) ArticleTitleAssessment of technical skills transfer from the bench training model to the human model Am J Surg 177 167–170 Occurrence Handle10.1016/S0002-9610(98)00327-4 Occurrence Handle1:STN:280:DyaK1M3hvFamug%3D%3D Occurrence Handle10204564
HR Champion AG Gallagher (2003) ArticleTitleSurgical simulation - a good idea whose time has come Br J Surg 90 767–768 Occurrence Handle10.1002/bjs.4187 Occurrence Handle1:STN:280:DC%2BD3szlsVSksA%3D%3D Occurrence Handle12854098
AM Derossis M Antoniuk GM Fried (1999) ArticleTitleEvaluation of laparoscopic skills: a 2-year follow-up during residency training Can J Surg 42 293–296 Occurrence Handle1:STN:280:DyaK1MzovVKhsA%3D%3D Occurrence Handle10459330
LS Feldman SE Hagarty G Ghitulescu D Stanbridge GM Fried (2004) ArticleTitleRelationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents J Am Coll Surg 198 105–110 Occurrence Handle10.1016/j.jamcollsurg.2003.08.020 Occurrence Handle14698317
LS Feldman V Sherman GM Fried (2004) ArticleTitleUsing simulators to assess laparoscopic competence: ready for widespread use? Surgery 135 28–42 Occurrence Handle10.1016/S0039-6060(03)00155-7 Occurrence Handle14694298
SA Fraser DR Klassen LS Feldman GA Ghitulescu D Stanbridge GM Fried (2003) ArticleTitleEvaluating laparoscopic skills: setting the pass/fail score for the MISTELS system Surg Endosc 17 964–967 Occurrence Handle10.1007/s00464-002-8828-4 Occurrence Handle1:STN:280:DC%2BD3s3nvFaqtw%3D%3D Occurrence Handle12658417
AG Gallagher N McClure J McGuigan I Crothers J Browning (1999) ArticleTitleVirtual reality training in laparoscopic surgery: a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR) Endoscopy 31 310–313 Occurrence Handle10.1055/s-1999-15 Occurrence Handle1:STN:280:DyaK1Mzgt12msw%3D%3D Occurrence Handle10376458
AG Gallagher EM Ritter RM Satava (2003) ArticleTitleFundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training Surg Endosc 17 1525–1529 Occurrence Handle10.1007/s00464-003-0035-4 Occurrence Handle1:STN:280:DC%2BD3sngs1OnsA%3D%3D Occurrence Handle14502403
AG Gallagher R Cowie I Crothers JA Jordan-Black RM Satava (2003) ArticleTitlePicSOr: an objective test of perceptual skill that predicts laparoscopic technical skill in three initial studies of laparoscopic performance Surg Endosc 17 1468–1471 Occurrence Handle10.1007/s00464-002-8569-4 Occurrence Handle1:STN:280:DC%2BD2c7ks1OntA%3D%3D Occurrence Handle12802664
AG Gallagher AB Lederman K McGlade RM Satava CD Smith (2004) ArticleTitleDiscriminative validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) using criteria levels based on expert performance Surg Endosc 18 660–665 Occurrence Handle10.1007/s00464-003-8176-z Occurrence Handle1:STN:280:DC%2BD2c3nslSgsw%3D%3D
A Hyltander E Liljegren PH Rhodin H Lonroth (2002) ArticleTitleThe transfer of basic skills learned in a laparoscopic simulator to the operating room Surg Endosc . 1324–1328 Occurrence Handle10.1007/s00464-001-9184-5 Occurrence Handle11988802
EJ Keyser AM Derossis M Antoniuk HH Sigman GM Fried (2000) ArticleTitleA simplified simulator for the training and evaluation of laparoscopic skills Surg Endosc 14 149–153 Occurrence Handle10.1007/s004649900088 Occurrence Handle1:STN:280:DC%2BD3c7isVSqtg%3D%3D Occurrence Handle10656949
SN Kothari BJ Kaplan EJ DeMaria TJ Broderick RC Merrell (2002) ArticleTitleTraining in laparoscopic suturing skills using a new computer-based virtual reality simulator (MIST-VR) provides results comparable to those with an established pelvic trainer system J Laparoendosc Adv Surg Tech A 12 167–173 Occurrence Handle10.1089/10926420260188056 Occurrence Handle12184901
AK Madan CT Frantzides N Shervin CL Tebbit (2003) ArticleTitleAssessment of individual hand performance in box trainers compared to virtual reality trainers Am Surg 69 1112–1114 Occurrence Handle14700302
Y Munz BD Kumar K Moorthy S Bann A Darzi (2004) ArticleTitleLaparoscopic virtual reality and box trainers: is one superior to the other? Surg Endosc 18 485–494 Occurrence Handle10.1007/s00464-003-9017-9 Occurrence Handle1:STN:280:DC%2BD2c3gtleruw%3D%3D Occurrence Handle14752633
JH Peters GM Fried LL Swanstrom NJ Soper LF Sillin B Schirmer K Hoffman (2004) ArticleTitleDevelopment and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery Surgery 135 21–27 Occurrence Handle10.1016/S0039-6060(03)00156-9 Occurrence Handle14694297
EM Ritter DA McClusky SuffixIII AB Lederman AG Gallagher CD Smith (2003) ArticleTitleObjective psychomotor skills assessment of experienced and novice flexible endoscopists with a virtual reality simulator J Gastrointest Surg 7 871–877 Occurrence Handle10.1016/S1091-255X(03)00148-3 Occurrence Handle14592660
NE Seymour AG Gallagher SA Roman MK O’Brien VK Bansal DK Andersen RM Satava (2002) ArticleTitleVirtual reality training improves operating room performance: results of a randomized, double-blinded study Ann Surg 236 458–463 Occurrence Handle10.1097/00000658-200210000-00008 Occurrence Handle12368674
RS Sidhu ED Grober LJ Musselman RK Reznick (2004) ArticleTitleAssessing competency in surgery: where to begin? Surgery 135 6–20 Occurrence Handle10.1016/S0039-6060(03)00154-5 Occurrence Handle1:STN:280:DC%2BD3snhtFaltg%3D%3D Occurrence Handle14694296
P Strom A Kjellin L Hedman E Johnson T Wredmark L Fellander-Tsai (2003) ArticleTitleValidation and learning in the Procedicus KSA virtual reality surgical simulator Surg Endosc 17 227–231 Occurrence Handle10.1007/s00464-002-9078-1 Occurrence Handle1:STN:280:DC%2BD3s%2Fms12ktg%3D%3D Occurrence Handle12399848
L Villegas BE Schneider MP Gallery DB Jones (2003) ArticleTitleLaparoscopic skills training Surg Endosc 17 1879–1888 Occurrence Handle10.1007/s00464-003-8172-3 Occurrence Handle1:STN:280:DC%2BD2c%2FosVShsg%3D%3D Occurrence Handle14577030
KR Wanzel M Ward RK Reznick (2002) ArticleTitleTeaching the surgical craft: from selection to certification Curr Probl Surg 39 573–659 Occurrence Handle12037512
KR Wanzel SJ Hamstra MF Caminiti DJ Anastakis ED Grober Reznick (2003) ArticleTitleVisual-spatial ability correlates with efficiency of hand motion and successful surgical performance Surgery 134 750–757 Occurrence Handle10.1016/S0039-6060(03)00248-4 Occurrence Handle14639352
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Duffy, A.J., Hogle, N.J., McCarthy, H. et al. Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19, 401–405 (2005). https://doi.org/10.1007/s00464-004-8202-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-004-8202-9