Advertisement

Surgical Endoscopy

, Volume 32, Issue 1, pp 413–420 | Cite as

Simulation-based mastery learning for endoscopy using the endoscopy training system: a strategy to improve endoscopic skills and prepare for the fundamentals of endoscopic surgery (FES) manual skills exam

  • E. Matthew RitterEmail author
  • Zachary A. Taylor
  • Kathryn R. Wolf
  • Brenton R. Franklin
  • Sarah B. Placek
  • James R. KorndorfferJr.
  • Aimee K. Gardner
Article

Abstract

Introduction

The fundamentals of endoscopic surgery (FES) program has considerable validity evidence for its use in measuring the knowledge, skills, and abilities required for competency in endoscopy. Beginning in 2018, the American Board of Surgery will require all candidates to have taken and passed the written and performance exams in the FES program. Recent work has shown that the current ACGME/ABS required case volume may not be enough to ensure trainees pass the FES skills exam. The aim of this study was to investigate the feasibility of a simulation-based mastery-learning curriculum delivered on a novel physical simulation platform to prepare trainees to pass the FES manual skills exam.

Methods

The newly developed endoscopy training system (ETS) was used as the training platform. Seventeen PGY 1 (10) and PGY 2 (7) general surgery residents completed a pre-training assessment consisting of all 5 FES tasks on the GI Mentor II. Subjects then trained to previously determined expert performance benchmarks on each of 5 ETS tasks. Once training benchmarks were reached for all tasks, a post-training assessment was performed with all 5 FES tasks.

Results

Two subjects were lost to follow-up and never returned for training or post-training assessment. One additional subject failed to complete any portion of the curriculum, but did return for post-training assessment. The group had minimal endoscopy experience (median 0, range 0–67) and minimal prior simulation experience. Three trainees (17.6%) achieved a passing score on the pre-training FES assessment. Training consisted of an average of 48 ± 26 repetitions on the ETS platform distributed over 5.1 ± 2 training sessions. Seventy-one percent achieved proficiency on all 5 ETS tasks. There was dramatic improvement demonstrated on the mean post-training FES assessment when compared to pre-training (74.0 ± 8 vs. 50.4 ± 16, p < 0.0001, effect size = 2.4). The number of ETS tasks trained to proficiency correlated moderately with the score on the post-training assessment (r = 0.57, p = 0.028). Fourteen (100%) subjects who trained to proficiency on at least one ETS task passed the post-training FES manual skills exam.

Conclusions

This simulation-based mastery learning curriculum using the ETS is feasible for training novices and allows for the acquisition of the technical skills required to pass the FES manual skills exam. This curriculum should be strongly considered by programs wishing to ensure that trainees are prepared for the FES exam.

Keywords

Simulation FES Mastery learning Flexible endoscopy Colonoscopy Education 

Notes

Funding

The Funding was provided by Society of American Gastrointestinal and Endoscopic Surgeons and Henry M. Jackson Foundation (Grant No. 64438).

Compliance with ethical standards

Disclosures

Dr. Ritter receives research support from the Henry M. Jackson Foundation for the Advancement of Military Medicine. Dr. Gardner has ownership interest in SurgWise Consulting, LLC. Dr. Korndorffer receives honoraria from Becton Dickinson Medical. Drs. Wolf, Taylor, Franklin, and Placek have nothing to disclose.

References

  1. 1.
    Mueller CL, Kaneva P, Fried GM, Feldman LS, Vassiliou MC (2014) Colonoscopy performance correlates with scores on the FES manual skills test. Surg Endosc 28:3081–3085CrossRefPubMedGoogle Scholar
  2. 2.
    Poulose BK, Vassiliou MC, Dunkin BJ, Mellinger JD, Fanelli RD, Martinez JM, Hazey JW, Sillin LF, Delaney CP, Velanovich V, Fried GM, Korndorffer JR Jr, Marks JM (2014) Fundamentals of endoscopic surgery cognitive examination: development and validity evidence. Surg Endosc 28:631–638CrossRefPubMedGoogle Scholar
  3. 3.
    Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P, Lyons C, Korndorffer JR Jr, Ujiki M, Velanovich V, Kochman ML, Tsuda S, Martinez J, Scott DJ, Korus G, Park A, Marks JM (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28:704–711CrossRefPubMedGoogle Scholar
  4. 4.
    The American Board of Surgery Inc (2014) Flexible endoscopy curriculum for general surgery residents. http://www.absurgery.org/xfer/abs-fec.pdf
  5. 5.
    Gardner AK, Scott DJ, Willis RE, Van Sickle K, Truitt MS, Uecker J, Brown KM, Marks JM, Dunkin BJ (2017) Is current surgery resident and GI fellow training adequate to pass FES? Surg Endosc 31:352–358CrossRefPubMedGoogle Scholar
  6. 6.
    Ahlberg G, Hultcrantz R, Jaramillo E, Lindblom A, Arvidsson D (2005) Virtual reality colonoscopy simulation: a compulsory practice for the future colonoscopist? Endoscopy 37:1198–1204CrossRefPubMedGoogle Scholar
  7. 7.
    Barsuk JH, Cohen ER, Caprio T, McGaghie WC, Simuni T, Wayne DB (2012) Simulation-based education with mastery learning improves residents’ lumbar puncture skills. Neurology 79:132–137CrossRefPubMedPubMedCentralGoogle Scholar
  8. 8.
    Barsuk JH, Cohen ER, McGaghie WC, Wayne DB (2010) Long-term retention of central venous catheter insertion skills after simulation-based mastery learning. Acad Med 85:S9–12CrossRefPubMedGoogle Scholar
  9. 9.
    Barsuk JH, Cohen ER, Potts S, Demo H, Gupta S, Feinglass J, McGaghie WC, Wayne DB (2014) Dissemination of a simulation-based mastery learning intervention reduces central line-associated bloodstream infections. BMJ Qual Saf 23:49–56CrossRefGoogle Scholar
  10. 10.
    Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463 (discussion 463–454)CrossRefPubMedPubMedCentralGoogle Scholar
  11. 11.
    Wayne DB, Barsuk JH, O’Leary KJ, Fudala MJ, McGaghie WC (2008) Mastery learning of thoracentesis skills by internal medicine residents using simulation technology and deliberate practice. J Hosp Med 3:48–54CrossRefPubMedGoogle Scholar
  12. 12.
    Wayne DB, Butter J, Siddall VJ, Fudala MJ, Wade LD, Feinglass J, McGaghie WC (2006) Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice. J Gen Intern Med 21:251–256CrossRefPubMedPubMedCentralGoogle Scholar
  13. 13.
    Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112CrossRefPubMedGoogle Scholar
  14. 14.
    Rosenthal ME, Ritter EM, Goova MT, Castellvi AO, Tesfay ST, Pimentel EA, Hartzler R, Scott DJ (2010) Proficiency-based fundamentals of laparoscopic surgery skills training results in durable performance improvement and a uniform certification pass rate. Surg Endosc 24:2453–2457CrossRefPubMedGoogle Scholar
  15. 15.
    Scott DJ, Ritter EM, Tesfay ST, Pimentel EA, Nagji A, Fried GM (2008) Certification pass rate of 100% for fundamentals of laparoscopic surgery skills after proficiency-based training. Surg Endosc 22:1887–1893CrossRefPubMedGoogle Scholar
  16. 16.
    Ritter EM, Cox TC, Trinca KD, Pearl JP (2013) Simulated colonoscopy objective performance evaluation (SCOPE): a non-computer-based tool for assessment of endoscopic skills. Surg Endosc 27:4073–4080CrossRefPubMedGoogle Scholar
  17. 17.
    Trinca KD, Cox TC, Pearl JP, Ritter EM (2014) Validity evidence for the simulated colonoscopy objective performance evaluation scoring system. Am J Surg 207:218–225CrossRefPubMedGoogle Scholar
  18. 18.
    Block JHBB, Carroll JB (1971) Mastery learning theory and practice. Holt Rinehart Winsto, Inc, New YorkGoogle Scholar
  19. 19.
    Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB (2009) Use of simulation-based education to reduce catheter-related bloodstream infections. Arch Intern Med 169:1420–1423CrossRefPubMedGoogle Scholar
  20. 20.
    Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA 3rd, Ramel S, Smith CD, Arvidsson D (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193:797–804CrossRefPubMedGoogle Scholar
  21. 21.
    Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg 199:115–120CrossRefPubMedGoogle Scholar
  22. 22.
    Zendejas B, Cook DA, Bingener J, Huebner M, Dunn WF, Sarr MG, Farley DR (2011) Simulation-based mastery learning improves patient outcomes in laparoscopic inguinal hernia repair: a randomized controlled trial. Ann Surg 254:502–509 (discussion 509–511)CrossRefPubMedGoogle Scholar
  23. 23.
    Cook DA, Brydges R, Zendejas B, Hamstra SJ, Hatala R (2013) Mastery learning for health professionals using technology-enhanced simulation: a systematic review and meta-analysis. Acad Med 88:1178–1186CrossRefPubMedGoogle Scholar
  24. 24.
    McGaghie WC (2015) When I say… mastery learning. Med Educ 49:558–559CrossRefPubMedGoogle Scholar
  25. 25.
    McGaghie WC, Barsuk JH, Wayne DB (2015) AM last page: mastery learning with deliberate practice in medical education. Acad Med 90:1575CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science + Business Media, LLC (outside the USA) 2017

Authors and Affiliations

  1. 1.Department of Surgery at the Uniformed Services University of the Health Sciences and the Walter Reed National Military Medical Center, and National Capital Region Simulation ConsortiumBethesdaUSA
  2. 2.Department of SurgeryTulane University School of MedicineNew OrleansUSA
  3. 3.Baylor College of MedicineHoustonUSA

Personalised recommendations