Surgical Endoscopy

, Volume 23, Issue 7, pp 1476–1482 | Cite as

Validation of laparoscopic surgical skills training outside the operating room: a long road

  • N. J. Hogle
  • L. Chang
  • V. E. M. Strong
  • A. O. U. Welcome
  • M. Sinaan
  • R. Bailey
  • D. L. Fowler



Surgical skills training outside the operating room is beneficial. The best methods have yet to be identified. The authors aimed to document the predictive validity of simulation training in three different studies.


Study 1 was a prospective, randomized, multicenter trial comparing performance in the operating room after training on a laparoscopic simulator and after no training. The Global Operative Assessment of Laparoscopic Skills (GOALS) was used to evaluate operative performance. Study 2 retrospectively reviewed the operative performance of junior residents before and after implementation of a laparoscopic skills training curriculum. Operative time was the variable used to determine resident improvement. Study 3 was a prospective, randomized trial evaluating intern operative performance of laparoscopic cholecystectomy in a porcine model before and after training on a simulator. Operative performance was assessed using GOALS.


All three studies failed to demonstrate predictive validity. With GOALS used as the assessment tool, no difference was found between trained and untrained residents in studies 1 and 3. In study 2, the trained group took significantly longer to complete a laparoscopic cholecystectomy than the untrained group.


No correlation was found between the three types of training outside the operating room, and no improved operative performance was observed. Possible explanations include too few subjects, training introduced too late in the learning curve, and training criteria that were too easy. Additionally, simulator training focuses on precision, which may actually increase task time. Awareness of these issues can improve the design of future studies.


General surgery training Laparoscopic skills Laparoscopic surgery Negative results Simulator training Virtual reality training 


  1. 1.
    Jordan JA, Gallagher AG, McGuigan J, McClure N (2001) Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc 15:1080–1084CrossRefPubMedGoogle Scholar
  2. 2.
    Kumar U, Gill IS (2006) Learning curve in human laparoscopic surgery. Curr Urol Rep 7:120–124CrossRefPubMedGoogle Scholar
  3. 3.
    Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30:617–620CrossRefPubMedGoogle Scholar
  4. 4.
    Halstead W (1906) The training of the surgeon. Bull Johns Hopkins Hosp 15:267–275Google Scholar
  5. 5.
    Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements in 2005Google Scholar
  6. 6.
    Fried GM (1994) General surgery residency training: a time for change? Can J Surg 37:261–262PubMedGoogle Scholar
  7. 7.
    Fried GM (2006) Lessons from the surgical experience with simulators: incorporation into training and utilization in determining competency. Gastrointest Endosc Clin North Am 16:425–434CrossRefGoogle Scholar
  8. 8.
    Bass BL (2007) Fundamental changes in general surgery residency training. Am Surg 73:109–113PubMedGoogle Scholar
  9. 9.
    Rogers DA, Elstein AS, Bordage G (2001) Improving continuing medical education for surgical techniques: applying the lessons learned in the first decade of minimal access surgery. Ann Surg 233:159–166CrossRefPubMedGoogle Scholar
  10. 10.
    Stefanidis D, Korndorffer JR Jr, Markley S, Sierra R, Heniford BT, Scott DJ (2007) Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? J Am Coll Surg 205:307–313CrossRefPubMedGoogle Scholar
  11. 11.
    Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314CrossRefPubMedGoogle Scholar
  12. 12.
    Ahlberg G, Heikkinen T, Iselius L, Leijonmarck CE, Rutqvist J, Arvidsson D (2002) Does training in a virtual reality simulator improve surgical performance? Surg Endosc 16:126–129CrossRefPubMedGoogle Scholar
  13. 13.
    Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST-VR). Endoscopy 31:310–313CrossRefPubMedGoogle Scholar
  14. 14.
    Kolkman W, Van de Put MA, Van den Hout WB, Trimbos JB, Jansen FW (2007) Implementation of the laparoscopic simulator in a gynecological residency curriculum. Surg Endosc 21:1363–1368CrossRefPubMedGoogle Scholar
  15. 15.
    Rosser JC Jr, Rosser LE, Savalgi RS (1998) Objective evaluation of a laparoscopic surgical skill program for residents and senior surgeons. Arch Surg 133:657–661CrossRefPubMedGoogle Scholar
  16. 16.
    Stovall DW, Fernandez AS, Cohen SA (2006) Laparoscopy training in United States obstetric and gynecology residency programs. J Soc Laparoendosc Surg 10:11–15Google Scholar
  17. 17.
    Chaer RA, Derubertis BG, Lin SC, Bush HL, Karwowski JK, Birk D, Morrissey NJ, Faries PL, McKinsey JF, Kent KC (2006) Simulation improves resident performance in catheter-based intervention: results of a randomized, controlled study. Ann Surg 244:343–352PubMedGoogle Scholar
  18. 18.
    Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112CrossRefPubMedGoogle Scholar
  19. 19.
    Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMedGoogle Scholar
  20. 20.
    Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463 discussion 463–454CrossRefPubMedGoogle Scholar
  21. 21.
    Boyd KB, Olivier J, Salameh JR (2006) Surgical residents’ perception of simulation training. Am Surg 72:521–524PubMedGoogle Scholar
  22. 22.
    Seymour NE (2008) VR to OR: a review of the evidence that virtual reality simulation improves operating room performance. World J Surg 32:182–188CrossRefPubMedGoogle Scholar
  23. 23.
    Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, Committee SF (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27CrossRefPubMedGoogle Scholar
  24. 24.
    Lentz GM, Mandel LS, Goff BA (2005) A six-year study of surgical teaching and skills evaluation for obstetric/gynecologic residents in porcine and inanimate surgical models. Am J Obstet Gynecol 193:2056–2061CrossRefPubMedGoogle Scholar
  25. 25.
    Goff B, Mandel L, Lentz G, Vanblaricom A, Oelschlager AM, Lee D, Galakatos A, Davies M, Nielsen P (2005) Assessment of resident surgical skills: is testing feasible? Am J Obstet Gynecol 192:1331–1338 discussion 1338–1340CrossRefPubMedGoogle Scholar
  26. 26.
    Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12:1117–1120CrossRefPubMedGoogle Scholar
  27. 27.
    Adrales GL, Chu UB, Hoskins JD, Witzke DB, Park AE (2004) Development of a valid, cost-effective laparoscopic training program. Am J Surg 187:157–163CrossRefPubMedGoogle Scholar
  28. 28.
    Derossis AM, Antoniuk M, Fried GM (1999) Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg 42:293–296PubMedGoogle Scholar
  29. 29.
    Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193:774–783CrossRefPubMedGoogle Scholar
  30. 30.
    Reznick R, Regehr G, MacRae H, Martin J, McCulloch W (1997) Testing technical skill via an innovative “bench station” examination. Am J Surg 173:226–230CrossRefPubMedGoogle Scholar
  31. 31.
    Aggarwal R, Tully A, Grantcharov T, Larsen CR, Miskry T, Farthing A, Darzi A (2006) Virtual reality simulation training can improve technical skills during laparoscopic salpingectomy for ectopic pregnancy. BJOG Int J Obstet Gynaecol 113:1382–1387CrossRefGoogle Scholar
  32. 32.
    Duffy A, Hogle N, McCarthy H, Lew J, Egan A, Christos P, Fowler D (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMedGoogle Scholar
  33. 33.
    Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191:28–32CrossRefPubMedGoogle Scholar
  34. 34.
    van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21:1413–1417CrossRefPubMedGoogle Scholar
  35. 35.
    Chang L, Hogle NJ, Moore BB, Graham MJ, Sinanan MN, Bailey R, Fowler DL (2007) Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov 14:122–126CrossRefPubMedGoogle Scholar
  36. 36.
    Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246:771–779CrossRefPubMedGoogle Scholar
  37. 37.
    Brunner WC, Korndorffer JR Jr, Sierra R, Massarweh NN, Dunne JB, Yau CL, Scott DJ (2004) Laparoscopic virtual reality training: are 30 repetitions enough? J Surg Res 122:50–156CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • N. J. Hogle
    • 1
  • L. Chang
    • 2
  • V. E. M. Strong
    • 3
  • A. O. U. Welcome
    • 1
  • M. Sinaan
    • 4
  • R. Bailey
    • 5
  • D. L. Fowler
    • 1
  1. 1.Department of Surgery, College of Physicians and SurgeonsColumbia UniversityNew YorkUSA
  2. 2.Department of SurgeryVirginia Mason Medical CenterSeattleUSA
  3. 3.Memorial Sloan-Kettering Cancer CenterGastric and Mixed Tumor ServiceNew YorkUSA
  4. 4.Department of SurgeryUniversity of WashingtonSeattleUSA
  5. 5.Department of SurgeryUniversity of Miami HospitalMiamiUSA

Personalised recommendations