Skip to main content
Log in

Validation of laparoscopic surgical skills training outside the operating room: a long road

  • Published:
Surgical Endoscopy Aims and scope Submit manuscript

Abstract

Background

Surgical skills training outside the operating room is beneficial. The best methods have yet to be identified. The authors aimed to document the predictive validity of simulation training in three different studies.

Methods

Study 1 was a prospective, randomized, multicenter trial comparing performance in the operating room after training on a laparoscopic simulator and after no training. The Global Operative Assessment of Laparoscopic Skills (GOALS) was used to evaluate operative performance. Study 2 retrospectively reviewed the operative performance of junior residents before and after implementation of a laparoscopic skills training curriculum. Operative time was the variable used to determine resident improvement. Study 3 was a prospective, randomized trial evaluating intern operative performance of laparoscopic cholecystectomy in a porcine model before and after training on a simulator. Operative performance was assessed using GOALS.

Results

All three studies failed to demonstrate predictive validity. With GOALS used as the assessment tool, no difference was found between trained and untrained residents in studies 1 and 3. In study 2, the trained group took significantly longer to complete a laparoscopic cholecystectomy than the untrained group.

Conclusions

No correlation was found between the three types of training outside the operating room, and no improved operative performance was observed. Possible explanations include too few subjects, training introduced too late in the learning curve, and training criteria that were too easy. Additionally, simulator training focuses on precision, which may actually increase task time. Awareness of these issues can improve the design of future studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Jordan JA, Gallagher AG, McGuigan J, McClure N (2001) Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc 15:1080–1084

    Article  CAS  PubMed  Google Scholar 

  2. Kumar U, Gill IS (2006) Learning curve in human laparoscopic surgery. Curr Urol Rep 7:120–124

    Article  PubMed  Google Scholar 

  3. Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30:617–620

    Article  CAS  PubMed  Google Scholar 

  4. Halstead W (1906) The training of the surgeon. Bull Johns Hopkins Hosp 15:267–275

    Google Scholar 

  5. Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements in 2005

  6. Fried GM (1994) General surgery residency training: a time for change? Can J Surg 37:261–262

    CAS  PubMed  Google Scholar 

  7. Fried GM (2006) Lessons from the surgical experience with simulators: incorporation into training and utilization in determining competency. Gastrointest Endosc Clin North Am 16:425–434

    Article  Google Scholar 

  8. Bass BL (2007) Fundamental changes in general surgery residency training. Am Surg 73:109–113

    PubMed  Google Scholar 

  9. Rogers DA, Elstein AS, Bordage G (2001) Improving continuing medical education for surgical techniques: applying the lessons learned in the first decade of minimal access surgery. Ann Surg 233:159–166

    Article  CAS  PubMed  Google Scholar 

  10. Stefanidis D, Korndorffer JR Jr, Markley S, Sierra R, Heniford BT, Scott DJ (2007) Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? J Am Coll Surg 205:307–313

    Article  PubMed  Google Scholar 

  11. Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314

    Article  PubMed  Google Scholar 

  12. Ahlberg G, Heikkinen T, Iselius L, Leijonmarck CE, Rutqvist J, Arvidsson D (2002) Does training in a virtual reality simulator improve surgical performance? Surg Endosc 16:126–129

    Article  CAS  PubMed  Google Scholar 

  13. Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST-VR). Endoscopy 31:310–313

    Article  CAS  PubMed  Google Scholar 

  14. Kolkman W, Van de Put MA, Van den Hout WB, Trimbos JB, Jansen FW (2007) Implementation of the laparoscopic simulator in a gynecological residency curriculum. Surg Endosc 21:1363–1368

    Article  CAS  PubMed  Google Scholar 

  15. Rosser JC Jr, Rosser LE, Savalgi RS (1998) Objective evaluation of a laparoscopic surgical skill program for residents and senior surgeons. Arch Surg 133:657–661

    Article  PubMed  Google Scholar 

  16. Stovall DW, Fernandez AS, Cohen SA (2006) Laparoscopy training in United States obstetric and gynecology residency programs. J Soc Laparoendosc Surg 10:11–15

    Google Scholar 

  17. Chaer RA, Derubertis BG, Lin SC, Bush HL, Karwowski JK, Birk D, Morrissey NJ, Faries PL, McKinsey JF, Kent KC (2006) Simulation improves resident performance in catheter-based intervention: results of a randomized, controlled study. Ann Surg 244:343–352

    PubMed  Google Scholar 

  18. Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112

    Article  PubMed  Google Scholar 

  19. Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405

    Article  CAS  PubMed  Google Scholar 

  20. Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463 discussion 463–454

    Article  PubMed  Google Scholar 

  21. Boyd KB, Olivier J, Salameh JR (2006) Surgical residents’ perception of simulation training. Am Surg 72:521–524

    PubMed  Google Scholar 

  22. Seymour NE (2008) VR to OR: a review of the evidence that virtual reality simulation improves operating room performance. World J Surg 32:182–188

    Article  PubMed  Google Scholar 

  23. Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, Committee SF (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27

    Article  PubMed  Google Scholar 

  24. Lentz GM, Mandel LS, Goff BA (2005) A six-year study of surgical teaching and skills evaluation for obstetric/gynecologic residents in porcine and inanimate surgical models. Am J Obstet Gynecol 193:2056–2061

    Article  PubMed  Google Scholar 

  25. Goff B, Mandel L, Lentz G, Vanblaricom A, Oelschlager AM, Lee D, Galakatos A, Davies M, Nielsen P (2005) Assessment of resident surgical skills: is testing feasible? Am J Obstet Gynecol 192:1331–1338 discussion 1338–1340

    Article  PubMed  Google Scholar 

  26. Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12:1117–1120

    Article  CAS  PubMed  Google Scholar 

  27. Adrales GL, Chu UB, Hoskins JD, Witzke DB, Park AE (2004) Development of a valid, cost-effective laparoscopic training program. Am J Surg 187:157–163

    Article  CAS  PubMed  Google Scholar 

  28. Derossis AM, Antoniuk M, Fried GM (1999) Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg 42:293–296

    CAS  PubMed  Google Scholar 

  29. Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193:774–783

    Article  PubMed  Google Scholar 

  30. Reznick R, Regehr G, MacRae H, Martin J, McCulloch W (1997) Testing technical skill via an innovative “bench station” examination. Am J Surg 173:226–230

    Article  CAS  PubMed  Google Scholar 

  31. Aggarwal R, Tully A, Grantcharov T, Larsen CR, Miskry T, Farthing A, Darzi A (2006) Virtual reality simulation training can improve technical skills during laparoscopic salpingectomy for ectopic pregnancy. BJOG Int J Obstet Gynaecol 113:1382–1387

    Article  CAS  Google Scholar 

  32. Duffy A, Hogle N, McCarthy H, Lew J, Egan A, Christos P, Fowler D (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405

    Article  CAS  PubMed  Google Scholar 

  33. Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191:28–32

    Article  PubMed  Google Scholar 

  34. van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21:1413–1417

    Article  CAS  PubMed  Google Scholar 

  35. Chang L, Hogle NJ, Moore BB, Graham MJ, Sinanan MN, Bailey R, Fowler DL (2007) Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov 14:122–126

    Article  PubMed  Google Scholar 

  36. Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246:771–779

    Article  PubMed  Google Scholar 

  37. Brunner WC, Korndorffer JR Jr, Sierra R, Massarweh NN, Dunne JB, Yau CL, Scott DJ (2004) Laparoscopic virtual reality training: are 30 repetitions enough? J Surg Res 122:50–156

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to D. L. Fowler.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hogle, N.J., Chang, L., Strong, V.E.M. et al. Validation of laparoscopic surgical skills training outside the operating room: a long road. Surg Endosc 23, 1476–1482 (2009). https://doi.org/10.1007/s00464-009-0379-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00464-009-0379-5

Keywords

Navigation