Abstract
Background
The content validity of currently available inanimate simulation models is questionable, because some tasks seem too far from clinical reality. The aim of this study was to validate a simulation model with six tasks commonly used in clinical practice (6-TSM) for the acquisition of psychomotor skills in minimally invasive surgery (MIS).
Methods
This was a prospective randomized trial comparing the 6-TSM to a previously described three-task training method (3-TTM). All first, second, and third postgraduate year surgical residents were eligible. The 6-TSM included clipping and dividing of a vessel, excision of lesion, appendectomy, mesh repair, suturing perforation, and hand-sewn anastomosis. The outcome measures of 6-TSM included accuracy error, tissue damage, sliding knot, leak, operating time, and dangerous movements. After completion of training, 6-TSM and 3-TTN residents were tested by the Minimally Invasive Surgical Trainer—Virtual Reality (MIST-VR). Criterion-related and construct validity, responsiveness, test–retest, and interrater reliability were assessed.
Results
During six months, 17 residents underwent training with the 6-TSM or the 3-TTM as allocated. The mean duration of training with 6-TSM and 3-TTM was similar (7.8 vs 8.1 h). The criterion-related validity of the 6-TSM was shown by significantly increased skill improvement in the 6-TSM residents, as compared with the 3-TTM residents at MIST-VR. Construct validity the of 6-TSM was shown by the finding that the experts’ baseline was superior to the residents’ baseline. The responsiveness of the 6-TSM was shown by the significantly increased skill improvement of the 6-TSM residents in sliding knot, leak, and operating time. The test–retest reliability of the 6-TSM was good (> 0.80), except for accuracy error and dangerous movements (Cronbach’s intraclass correlation coefficient α: 0.57, p < 0.0001; 0.62, p < 0.0001, respectively). The interrater reliability of the 6-TSM was good (>0.80) except for leak (Kendall’s concordance coefficient tau_b:0.76, p = 0.06 for hand-sewn anastomosis) and dangerous movements (tau_b:0.72, p = 0.08 for suturing perforation and tau_b:0.68, p = 0.10 for hand-sewn anastomosis). The perresident cost for 6-TSM was $769.
Conclusions
The 6-TSM is a valid and reliable learning tool for surgical residents’ acquisition of laparoscopic motor skills.
Similar content being viewed by others
References
C Begg M Cho S Eastwood R Horton D Moher I Olkin R Pitkin D Rennie KF Schulz D Simel DF Stroup (1996) ArticleTitleImproving the quality of reporting of randomized controlled trials: the CONSORT statement JAMA 276 637–639 Occurrence Handle10.1001/jama.276.8.637 Occurrence Handle1:STN:280:BymA28bmvFM%3D Occurrence Handle8773637
R Bergamaschi A Dicko (2000) ArticleTitleInstruction versus passive observation: a randomized research study on laparoscopic suture skills Surg Laparosc Endosc Perc Tech 10 319–322 Occurrence Handle10.1097/00019509-200010000-00012 Occurrence Handle1:STN:280:DC%2BD3M7gtFGhuw%3D%3D
JY Chung JM Sackier (1998) ArticleTitleA method of objectively evaluating improvements in laparoscopic skills Surg Endosc 12 1111–1116 Occurrence Handle10.1007/s004649900795 Occurrence Handle1:STN:280:DyaK1czosVCmtA%3D%3D Occurrence Handle9716762
A Cuschieri Z Szabo (1995) Tissue approximation in endoscopic surgery ISIS Medical Media Oxford 64
AM Derossis GM Fried M Abrahamowicz HH Sig-man JS Barkun JL Meakins (1998) ArticleTitleDevelopment of a model for training and evaluation of laparoscopic skills Am J Surg 175 482–487
GM Fried AM Derossis J Bothwell HH Sigman (1999) ArticleTitleComparison of laparoscopic performance in vivo with performance measured in a laparoscopic simulator Surg Endosc 13 1077–1081 Occurrence Handle10.1007/s004649901176 Occurrence Handle1:STN:280:DC%2BD3c%2FivVCjtw%3D%3D Occurrence Handle10556441
AG Gallagher EM Ritter RM Satava (2003) ArticleTitleFundamental principles of validation and reliability: rigorous science for the assessment of surgical education and training Surg Endosc 17 1525–1529 Occurrence Handle10.1007/s00464-003-0035-4 Occurrence Handle1:STN:280:DC%2BD3sngs1OnsA%3D%3D Occurrence Handle14502403
WS Halsted (1904) ArticleTitleThe training of the surgeon Bull Johns Hopkins Hosp 15 267–276
K Harold B Mathews CL Bachus B Pratt T Heniford (2002) ArticleTitleProspective randomized evaluation of surgical resident proficiency with laparoscopic suturing following course introduction Surg Endosc 16 1729–1731 Occurrence Handle10.1007/s00464-002-8832-8 Occurrence Handle1:STN:280:DC%2BD38jis1Cjug%3D%3D Occurrence Handle12140636
S Mackay P Morgan V Datta A Chang A Darzi (2002) ArticleTitlePractice distribution in procedural skills training: a randomized controlled trial Surg Endosc 16 957–961 Occurrence Handle10.1007/s00464-001-9132-4 Occurrence Handle1:STN:280:DC%2BD38vgvFGmtw%3D%3D Occurrence Handle12163963
U Mattern P Waller (1998) ArticleTitleInstruments for minimally invasive surgery: principles of ergonomic handles Surg Endosc 13 174–182 Occurrence Handle10.1007/s004649900934
WCS Meng SPY Kwok KL Leung CC Chung WY Lau AK Li (1996) ArticleTitleOptimal position of working ports in laparoscopic surgery: an in vitro study Surg Laparosc Endosc 6 278–281 Occurrence Handle10.1097/00019509-199608000-00006 Occurrence Handle1:STN:280:BymH3sjosVQ%3D Occurrence Handle8840449
RV O’Toole RR Playter TM Krummel WC Blank NH Cornelius WR Roberts WJ Bell M Raibert (1999) ArticleTitleMeasuring and developing suturing technique with a virtual reality surgical simulator J Am Coll Surg 189 114–127 Occurrence Handle10.1016/S1072-7515(99)00076-9 Occurrence Handle1:STN:280:DyaK1MzivVWktg%3D%3D Occurrence Handle10401747
A Park DB Witzke (2002) ArticleTitleTraining and educational approaches to minimally invasive surgery: state of the art Semin Laparosc Surg. 9 198–205 Occurrence Handle10.1053/slas.2002.36468 Occurrence Handle12522776
RK Reznick (1999) ArticleTitleVirtual reality surgical simulators: feasible but valid? J Am Coll Surg 189 127–128 Occurrence Handle10.1016/S1072-7515(99)00077-0 Occurrence Handle1:STN:280:DyaK1MzivVWktw%3D%3D Occurrence Handle10401748
JC Rosser LE Rosser RS Salvagi (1997) ArticleTitleSkill acquisition and assessment for laparoscopic surgery Arch Surg 132 200–204 Occurrence Handle1:STN:280:ByiC1MvkvV0%3D Occurrence Handle9041927
JC Rosser SuffixJr LE Rosser RS Savalgi (1998) ArticleTitleObjective evaluation of a laparoscopic surgical skill program for residents and senior surgeons Arch Surg 133 657–661 Occurrence Handle10.1001/archsurg.133.6.657 Occurrence Handle9637467
NE Seymour AG Gallagher SA Roman MK O’Brien VK Bansal DK Andersen RM Satava (2002) ArticleTitleVirtual reality training improves operating room performance: results of a randomized, double-blinded study Ann Surg 236 458–463 Occurrence Handle10.1097/00000658-200210000-00008 Occurrence Handle12368674
N Taffinder C Sutton RJ Fishwick IC McManus A Darzi (1998) ArticleTitleValidation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomized controlled studies using the MIST VR laparoscopic simulator Stud Health Technol Inform 50 124–130 Occurrence Handle1:STN:280:DyaK1c3mt1ahtQ%3D%3D Occurrence Handle10180527
V Velanovich SR Vallance JR Gusz FV Tapia MA Harkabus (1996) ArticleTitleQuality-of-life scale for gastroesophageal reflux disease J Am Coll Surg 183 217–224 Occurrence Handle1:STN:280:BymA2sfnsFU%3D Occurrence Handle8784314
L Villegas BE Schneider MP Gallery DB Jones (2003) ArticleTitleLaparoscopic skills training Surg Endosc 17 1879–1888 Occurrence Handle10.1007/s00464-003-8172-3 Occurrence Handle1:STN:280:DC%2BD2c%2FosVShsg%3D%3D Occurrence Handle14577030
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Uchal, M., Raftopoulos, Y., Tjugum, J. et al. Validation of a six-task simulation model in minimally invasive surgery. Surg Endosc 19, 109–116 (2005). https://doi.org/10.1007/s00464-004-8145-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-004-8145-1