Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills
- 374 Downloads
Decision making on the competency of surgical trainees to perform laparoscopic procedures has been hampered by the lack of reliable methods to evaluate operative performance. The goal of this study was to develop a feasible and reliable method of evaluation.
Twenty-nine senior surgical residents were videotaped performing a low anterior resection and a Nissen fundoplication in a pig. Ten blinded laparoscopists rated the videos independently on two scales. Rating time was minimized by allowing raters to fast-forward through the tapes at their discretion. Interrater reliability and the time required to rate a procedure were assessed.
Rating time per procedure was a median of 15 min (range, 6–40). The mean interrater reliability for the two scales was 0.74.
The use of videotapes of operations enabled multiple raters to assess a performance reliably and shortened assessment times by 80%. This assessment technique shows potential as a means of evaluating the performance of advanced laparoscopic procedures by surgical trainees.
KeywordsTechnical skills assessment Laparoscopic skills Nissen fundoplication Resident performance Surgical education
This work was supported by United States Surgical Corporation through a grant from the Center for Excellence in Surgical Education, Research, and Teaching Foundation at the Association for Surgical Education.
- 4.Hamford, JM, Hall, JC 2000Acquiring surgical skillsBr J Surg872837Google Scholar
- 9.Reznick, R, Taylor, B, Maudsley, R, Ruedy, J, Cohen, R, Chalmers, A, Newman, C 1991In-training evaluation—it’s more than just a formAnn R Coll Physicians Surg Can24415420Google Scholar
- 11.Richards R (1999) Why do we need to assess competence? In: Surgical competence: challenges of assessment in training and practice. (Ed.) Jackson, B.Proceedings of a conference held at the Queen Elizabeth II Conference Centre by the Royal College of Surgeons of England, Nov. 2, 1999Google Scholar
- 15.Streiner, DL 1985Global rating scalesNeufeld, VRNorman, GR eds. Assessing clinical competenceSpringerNew York119141Google Scholar