Surgical Endoscopy

, Volume 18, Issue 12, pp 1800–1804

Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills

  • D. Dath
  • G. Regehr
  • D. Birch
  • C. Schlachta
  • E. Poulin
  • J. Mamazza
  • R. Reznick
  • H. M. MacRae
Original article

Abstract

Background

Decision making on the competency of surgical trainees to perform laparoscopic procedures has been hampered by the lack of reliable methods to evaluate operative performance. The goal of this study was to develop a feasible and reliable method of evaluation.

Methods

Twenty-nine senior surgical residents were videotaped performing a low anterior resection and a Nissen fundoplication in a pig. Ten blinded laparoscopists rated the videos independently on two scales. Rating time was minimized by allowing raters to fast-forward through the tapes at their discretion. Interrater reliability and the time required to rate a procedure were assessed.

Results

Rating time per procedure was a median of 15 min (range, 6–40). The mean interrater reliability for the two scales was 0.74.

Conclusions

The use of videotapes of operations enabled multiple raters to assess a performance reliably and shortened assessment times by 80%. This assessment technique shows potential as a means of evaluating the performance of advanced laparoscopic procedures by surgical trainees.

Keywords

Technical skills assessment Laparoscopic skills Nissen fundoplication Resident performance Surgical education 

Copyright information

© Springer-Verlag 2004

Authors and Affiliations

  • D. Dath
    • 1
  • G. Regehr
    • 2
  • D. Birch
    • 3
  • C. Schlachta
    • 2
  • E. Poulin
    • 2
  • J. Mamazza
    • 2
  • R. Reznick
    • 2
  • H. M. MacRae
    • 2
  1. 1.Department of SurgeryFaculty of Health Sciences, McMaster UniversityHamiltonCanada
  2. 2.Department of surgery and Centre for Research in EducationFaculty of Medicine, University of TorontoToronto, OntarioCanada
  3. 3.Department of SurgeryFaculty of Medicine and Dentistry, University of AlbertaAlbertaCanada

Personalised recommendations