Video-based coaching in surgical education: a systematic review and meta-analysis
In the era of competency-based surgical education, VBC has gained increased attention and may enhance the efficacy of surgical education. The objective of this systematic review was to summarize the existing evidence of video-based coaching (VBC) and compare VBC to traditional master-apprentice-based surgical education.
We performed a systematic review and meta-analysis of randomized controlled trials (RCT) assessing VBC according to the PRISMA and Cochrane guidelines. The MEDLINE, EMBASE, and COCHRANE and Researchgate databases were searched for eligible manuscripts. Standard mean difference (SMD) of performance scoring scales was used to assess the effect of VBC versus traditional training without VBC (control).
Of 627 studies identified, 24 RCTs were eligible and evaluated. The studies included 778 surgical trainees (n = 386 VBC vs. n = 392 control). 13 performance scoring scales were used to assess technical competence; OSATS-GRS was the most common (n = 15). VBC was provided preoperative (n = 11), intraoperative (n = 1), postoperative (n = 10), and perioperative (n = 2). The majority of studies were unstructured, where identified coaching frameworks were PRACTICE (n = 1), GROW (n = 2) and Wisconsin Coaching Framework (n = 1). There was an effect on performance scoring scales in favor of VBC coaching (SMD 0.87, p < 0.001). In subgroup analyses, the residents had a larger relative effect (SMD 1.13; 0.61–1.65, p < 0.001) of VBC compared to medical students (SMD 0.43, 0.06–0.81, p < 0.001). The greatest source of potential bias was absence of blinding of the participants and personnel (n = 20).
Video-based coaching increases technical performance of medical students and surgical residents. There exist significant study and intervention heterogeneity that warrants further exploration, showing the need to structure and standardize video-based coaching tools.
KeywordsSurgical training Surgical education Video-based coaching (VBC) OSATS GOALS
Standard mean difference
We thank Dr Alameddine for providing additional unpublished data to the survey.
KMA had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: KMA, KB, DI, DSK, RK. Acquisition, analysis, or interpretation of data: KMA, KB, DSK. Drafting of the manuscript: KMA. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: KMA. Administrative, technical, or material support: KMA, RK. Study supervision: RK.
No external funding.
Compliance with ethical standards
Drs. Augestad, Butt, Ignjatovic, Keller and Kiran have no conflicts of interest or financial ties to disclose.
- 4.Jackson PG, Tarpley J (2009) How long does it take to train a surgeon? BMJ 339:1–3Google Scholar
- 5.Bilimoria KY, Chung JW, Hedges LV, Dahlke AR, Love R, Cohen ME, Tarpley J, Mellinger J, Mahvi DM, Kelz RR, Ko CY, Hoyt DB, Lewis FH (2015) Development of the flexibility in duty hour requirements for surgical trainees (FIRST) trial protocol: a national cluster-randomized trial of resident duty hour policies. JAMA Surg 151:273. https://doi.org/10.1001/jamasurg.2015.4990 CrossRefGoogle Scholar
- 11.Celentano V, Smart N, McGrath J, Cahill RA, Spinelli A, Obermair A, Hasegawa H, Lal P, Almoudaris AM, Hitchins CR, Pellino G, Browning MG, Ishida T, Luvisetto F, Cingiloglu P, Gash K, Harries R, Harji D, Di Candido F, Cassinotti E, McDermott FD, Berry JEA, Battersby NJ, Platt E, Campain NJ, Keeler BD, Boni L, Gupta S, Griffith JP, Acheson AG, Cecil TD, Coleman MG (2018) LAP-VEGaS practice guidelines for reporting of educational videos in laparoscopic surgery. Ann Surg 268:920–926. https://doi.org/10.1097/SLA.0000000000002725 CrossRefPubMedGoogle Scholar
- 15.Moher D (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 151:264. https://doi.org/10.7326/0003-4819-151-4-200908180-00135 CrossRefGoogle Scholar
- 16.Cummings PC (2011) Arguments for and against standardized mean differences (effect sizes). JAMA Pediatr 165:1–5Google Scholar
- 26.Backstein D, Agnidis Z (2005) Effectiveness of repeated video feedbackin the acquisition of a surgical technical skill. Can J Surg 48:1–6Google Scholar
- 35.Karam MD, Thomas GW, Koehler DM, Westerlind BO, Lafferty PM, Ohrt GT, Marsh JL, Van Heest AE, Anderson DD (2015) Surgical coaching from head-mounted video in the training of fluoroscopically guided articular fracture surgery. J Bone Joint Surg Am 97:1031–1039. https://doi.org/10.2106/JBJS.N.00748 CrossRefPubMedGoogle Scholar
- 37.Pape-Koehler C, Immenroth M, Sauerland S, Lefering R, Lindlohr C, Toaspern J, Heiss M (2013) Multimedia-based training on Internet platforms improves surgical performance: a randomized controlled trial. Surg Endosc 27:1737–1747. https://doi.org/10.1111/j.1445-2197.2008.04828.x CrossRefPubMedPubMedCentralGoogle Scholar
- 45.Lwin AT, Lwin T, Naing P, Oo Y, Kidd D, Cerullo M, Posen J, Hlaing K, Yenokyan G, Thinn KK, Soe ZW, Stevens KA (2017) Self-directed interactive video-based instruction versus instructor-led teaching for myanmar house surgeons: a randomized, noninferiority trial. J Surg Educ. https://doi.org/10.1016/j.jsurg.2017.06.004 CrossRefPubMedGoogle Scholar
- 47.Xeroulis GJ, Park J, Moulton C-A, Reznick RK, LeBlanc V, Dubrowski A (2007) Teaching suturing and knot-tying skills to medical students: a randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery 141:442–449. https://doi.org/10.1016/j.surg.2006.09.012 CrossRefPubMedGoogle Scholar
- 50.Zevin B, Bonrath EM, Aggarwal R, Dedy NJ, Ahmed N, Grantcharov TP (2013) Development, feasibility, validity, and reliability of a scale for objective assessment of operative performance in laparoscopic gastric bypass surgery. J Am Coll Surg 216:955–965.e8. https://doi.org/10.1016/j.jamcollsurg.2013.01.003 CrossRefPubMedGoogle Scholar
- 54.Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Outcomes/epidemiology/socioecnomics global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187:247–252. https://doi.org/10.1016/j.juro.2011.09.032 CrossRefPubMedGoogle Scholar
- 56.Miskovic D, Wyles SM, Carter F, Coleman MG, Hanna GB (2010) Development, validation and implementation of a monitoring tool for training in laparoscopic colorectal surgery in the English National Training Program. Surg Endosc 25:1136–1142. https://doi.org/10.1007/s00464-008-0088-5 CrossRefPubMedGoogle Scholar
- 58.Miskovic D, Ni M, Wyles SM, Kennedy RH, Francis NK, Parvaiz A, Cunningham C, Rockall TA, Gudgeon AM, Coleman MG, Hanna GB (2013) Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg 257:476–482. https://doi.org/10.1097/SLA.0b013e318275b72a CrossRefPubMedGoogle Scholar
- 59.Greenberg CC, Ghousseini HN, Pavuluri Quamme SR, Beasley HL, Frasier LL, Brys NA, Dombrowski JC, Wiegmann DA, Wisconsin Surgical Coaching Program (2017) A statewide surgical coaching program provides opportunity for continuous professional development. Ann Surg 267:868–873. https://doi.org/10.1097/SLA.0000000000002341 CrossRefGoogle Scholar