Simulation-based mastery learning for endoscopy using the endoscopy training system: a strategy to improve endoscopic skills and prepare for the fundamentals of endoscopic surgery (FES) manual skills exam
- 721 Downloads
The fundamentals of endoscopic surgery (FES) program has considerable validity evidence for its use in measuring the knowledge, skills, and abilities required for competency in endoscopy. Beginning in 2018, the American Board of Surgery will require all candidates to have taken and passed the written and performance exams in the FES program. Recent work has shown that the current ACGME/ABS required case volume may not be enough to ensure trainees pass the FES skills exam. The aim of this study was to investigate the feasibility of a simulation-based mastery-learning curriculum delivered on a novel physical simulation platform to prepare trainees to pass the FES manual skills exam.
The newly developed endoscopy training system (ETS) was used as the training platform. Seventeen PGY 1 (10) and PGY 2 (7) general surgery residents completed a pre-training assessment consisting of all 5 FES tasks on the GI Mentor II. Subjects then trained to previously determined expert performance benchmarks on each of 5 ETS tasks. Once training benchmarks were reached for all tasks, a post-training assessment was performed with all 5 FES tasks.
Two subjects were lost to follow-up and never returned for training or post-training assessment. One additional subject failed to complete any portion of the curriculum, but did return for post-training assessment. The group had minimal endoscopy experience (median 0, range 0–67) and minimal prior simulation experience. Three trainees (17.6%) achieved a passing score on the pre-training FES assessment. Training consisted of an average of 48 ± 26 repetitions on the ETS platform distributed over 5.1 ± 2 training sessions. Seventy-one percent achieved proficiency on all 5 ETS tasks. There was dramatic improvement demonstrated on the mean post-training FES assessment when compared to pre-training (74.0 ± 8 vs. 50.4 ± 16, p < 0.0001, effect size = 2.4). The number of ETS tasks trained to proficiency correlated moderately with the score on the post-training assessment (r = 0.57, p = 0.028). Fourteen (100%) subjects who trained to proficiency on at least one ETS task passed the post-training FES manual skills exam.
This simulation-based mastery learning curriculum using the ETS is feasible for training novices and allows for the acquisition of the technical skills required to pass the FES manual skills exam. This curriculum should be strongly considered by programs wishing to ensure that trainees are prepared for the FES exam.
KeywordsSimulation FES Mastery learning Flexible endoscopy Colonoscopy Education
The Funding was provided by Society of American Gastrointestinal and Endoscopic Surgeons and Henry M. Jackson Foundation (Grant No. 64438).
Compliance with ethical standards
Dr. Ritter receives research support from the Henry M. Jackson Foundation for the Advancement of Military Medicine. Dr. Gardner has ownership interest in SurgWise Consulting, LLC. Dr. Korndorffer receives honoraria from Becton Dickinson Medical. Drs. Wolf, Taylor, Franklin, and Placek have nothing to disclose.
- 2.Poulose BK, Vassiliou MC, Dunkin BJ, Mellinger JD, Fanelli RD, Martinez JM, Hazey JW, Sillin LF, Delaney CP, Velanovich V, Fried GM, Korndorffer JR Jr, Marks JM (2014) Fundamentals of endoscopic surgery cognitive examination: development and validity evidence. Surg Endosc 28:631–638CrossRefPubMedGoogle Scholar
- 3.Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P, Lyons C, Korndorffer JR Jr, Ujiki M, Velanovich V, Kochman ML, Tsuda S, Martinez J, Scott DJ, Korus G, Park A, Marks JM (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28:704–711CrossRefPubMedGoogle Scholar
- 4.The American Board of Surgery Inc (2014) Flexible endoscopy curriculum for general surgery residents. http://www.absurgery.org/xfer/abs-fec.pdf
- 14.Rosenthal ME, Ritter EM, Goova MT, Castellvi AO, Tesfay ST, Pimentel EA, Hartzler R, Scott DJ (2010) Proficiency-based fundamentals of laparoscopic surgery skills training results in durable performance improvement and a uniform certification pass rate. Surg Endosc 24:2453–2457CrossRefPubMedGoogle Scholar
- 18.Block JHBB, Carroll JB (1971) Mastery learning theory and practice. Holt Rinehart Winsto, Inc, New YorkGoogle Scholar
- 20.Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA 3rd, Ramel S, Smith CD, Arvidsson D (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193:797–804CrossRefPubMedGoogle Scholar