Skip to main content
SpringerLink
Log in

Assessing Operative Performance in Advanced Laparoscopic Colorectal Surgery

  • Published:
World Journal of Surgery Aims and scope Submit manuscript

Abstract

Background

Competent technical skills performance in complex operations is vital for satisfactory patient outcome. Assessing these skills is therefore of paramount importance. In this study we aim to develop and validate a new tool that can assess both generic and specific technical skills in advanced complex laparoscopic colorectal surgery in the operating room.

Methods

Hierarchical task analysis was constructed for generic and specific technical skills on three key advanced laparoscopic colorectal operations (right hemicolectomy, sigmoid colectomy, and anterior resection) after expert discussions. Likert scales were then constructed individually for generic and specific technical skills for each operation using hierarchical task analysis for each operation to identify key elements and steps for each operation. Each operation was assessed independently and blindly by two experienced surgeons.

Results

Eighty-four live real operations performed by six consultants and eight trainees were assessed. Interclass correlation coefficient between the two observers was 0.94 (P ≤ 0.05) for generic technical skills and 0.88 (P ≤ 0.05) for the operation-specific technical skills. Construct validity for both generic and specific technical skills for consultants and trainees was significant using ANOVA (P ≤ 0.05). All consultants therefore consistently performed better in both generic and specific technical skills compared to their trainees.

Conclusions

This new assessment tool of generic and specific technical skills in advanced laparoscopic colorectal surgery is reliable and has face, content, concurrent, and construct validities. The tool has the possibility of being used as a surgical training and appraisal tool.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Baker GR, Norton PG, Flintoft V et al (2004) The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 170:1678–1686

    PubMed  Google Scholar 

  2. Brennan TA, Leape LL, Laird NM et al (1991) Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med 324:370–376

    CAS  PubMed  Google Scholar 

  3. Vincent C, Neale G, Woloshynowych M (2001) Adverse events in British hospitals: preliminary retrospective record review. BMJ 322:517–519

    Article  CAS  PubMed  Google Scholar 

  4. The Southern Surgeons Club (1991) A prospective analysis of 1518 laparoscopic cholecystectomies. N Engl J Med 324:1073–1078

    Article  Google Scholar 

  5. Moorthy K, Munz Y, Sarker SK et al (2003) Objective assessment of technical skills in surgery. BMJ 327:1032–1037

    Article  PubMed  Google Scholar 

  6. Martin JA, Regehr G, Reznick R et al (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278

    Article  CAS  PubMed  Google Scholar 

  7. Sarker SK, Chang A, Vincent C et al (2006) Development of assessing generic and specific technical skills in laparoscopic surgery. Am J Surg 191:238–244

    Article  PubMed  Google Scholar 

  8. Friedman Z, Katznelson R, Devito I et al (2006) Objective assessment of manual skills and proficiency in performing epidural anesthesia—video-assisted validation. Reg Anesth Pain Med 31:304–310

    PubMed  Google Scholar 

  9. Moorthy K, Munz Y, Dosis A et al (2004) Bimodal assessment of laparoscopic suturing skills: construct and concurrent validity. Surg Endosc 18:1608–1612

    CAS  PubMed  Google Scholar 

  10. Swift SE, Carter JF (2006) Institution and validation of an observed structured assessment of technical skills (OSATS) for obstetrics and gynecology residents and faculty. Am J Obstet Gynecol 195:617–621

    Article  PubMed  Google Scholar 

  11. van der Heide PA, van Toledo-Eppinga L, van der HM et al (2006) Assessment of neonatal resuscitation skills: a reliable and valid scoring system. Resuscitation 71:212–221

    Article  PubMed  Google Scholar 

  12. Watterson JD, Beiko DT, Kuan JK et al (2002) Randomized prospective blinded study validating acquisition of ureteroscopy skills using computer based virtual reality endourological simulator. J Urol 168:1928–1932

    Article  PubMed  Google Scholar 

  13. Dath D, Regehr G, Birch D et al (2004) Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills. Surg Endosc 18:1800–1804

    Article  CAS  PubMed  Google Scholar 

  14. Joice P, Hanna GB, Cuschieri A (1998) Errors enacted during endoscopic surgery—a human reliability analysis. Appl Ergon 29:409–414

    Article  CAS  PubMed  Google Scholar 

  15. Sarker SK, Albrani T, Zaman A et al (2008) Procedural performance in gastrointestinal endoscopy: an assessment and self-appraisal tool. Am J Surg 196(3):450–455

    Article  PubMed  Google Scholar 

  16. Sarker SK, Chang A, Albrani T et al (2008) Constructing a hierarchical task analysis in surgery. Surg Endosc 22(1):107–111

    Article  PubMed  Google Scholar 

  17. Sarker SK, Chang A, Vincent C (2006) Assessing technical and technological skills in laparoscopic surgery. JSLS 10(3):284–292

    PubMed  Google Scholar 

  18. Sarker SK, Hutchinson R, Chang A et al (2006) Self-appraisal hierarchical task analysis of expert surgeons performing laparoscopic surgery. Surg Endosc 20(4):636–640

    Article  CAS  PubMed  Google Scholar 

  19. Aggarwal R, Grantcharov T, Moorthy K et al (2005) A reliability analysis of video-based rating scales for technical skills assessments in laparoscopic surgery. Surg Endosc 19:s286

    Google Scholar 

  20. Sarker SK, Chang A, Vincent C et al (2005) Assessment of technical skills in open and laparoscopic surgery. Br J Surg 92:s22–s23

    Google Scholar 

  21. Albrani T, Zaman A, Patel B et al (2007) Self appraisal and assessment of technical skills in endoscopic procedures. Gut 56:A86

    Google Scholar 

  22. Sarker SK, Chang A, Vincent C et al (2004) Self-appraisal of senior surgeons using objective structured assessment of technical skill in laparoscopic cholecystecomies. Surg Endosc 18:s233

    Google Scholar 

  23. Burt CG, Wilkins DC (2005) The accuracy of self-assessment by surgical trainees. Br J Surg 92:s140

    Article  Google Scholar 

  24. Beard JD, Thomas WE, Rochester J et al (2005) Developing assessments of surgical skills for GMC performance procedures. Br J Surg 92:s147

    Article  Google Scholar 

  25. Reznick RK (1993) Teaching and testing technical skills. Am J Surg 165:358–361

    Article  CAS  PubMed  Google Scholar 

  26. Brewster LP, Risucci DA, Joehl RJ et al (2008) Comparison of resident self-assessments with trained faculty and standardized patient assessments of clinical and technical skills in a structured educational module. Am J Surg 195(1):1–4

    Article  PubMed  Google Scholar 

  27. Eubanks TR, Clements RH, Pohl D et al (1999) An objective scoring system for laparoscopic cholecystectomy. J Am Coll Surg 189:566–574

    Article  CAS  PubMed  Google Scholar 

  28. Aggarwal R, Boza C, Hance J et al (2007) Training in laparoscopic Roux-en-Y gastric bypass—an evidence-based approach. Obes Surg 17:19–27

    Article  PubMed  Google Scholar 

  29. Beard JD, Choksy S, Khan S (2007) Assessment of operative competence during carotid endarterectomy. Br J Surg 94:726–730

    Article  CAS  PubMed  Google Scholar 

  30. Vassiliou MC, Feldman LS, Andrew CG et al (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113

    Article  PubMed  Google Scholar 

  31. Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using global operative assessment of laparoscopic skills. J Am Coll Surg 204:308–313

    Article  PubMed  Google Scholar 

  32. Larson JL, Williams RG, Ketchum J et al (2005) Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents. Surgery 138:640–647

    Article  PubMed  Google Scholar 

  33. Zirkle M, Taplin MA, Anthony R (2007) Objective assessment of temporal bone drilling skills. Ann Otol Rhinol Laryngol 116(11):793–798

    PubMed  Google Scholar 

  34. Black SA, Harrison RH, Horrocks EJ et al (2007) Competence assessment of senior vascular trainees using a carotid endarterectomy bench model. Br J Surg 94(10):1226–1231

    Article  CAS  PubMed  Google Scholar 

  35. Sarker SK (2006) Assessment of technical skills in surgery. PhD Thesis, Imperial College London, University of London

  36. Sarker SK (2004) Operative surgical safety—it’s good to talk. Bull R Coll Physicians Surg Glasg 33(3):2

    Google Scholar 

  37. Haynes AB, Weiser TG, Berry WR et al (2009) Safe Surgery Saves Lives Study Group: a surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med 360(5):491–499

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

We thank the surgical and nursing staff at the hospitals in West and North London and University of Cleveland Hospitals for their help.

Author information

Authors and Affiliations

  1. Colorectal Surgical Unit, Whittington Hospital, London, N19 5NF, UK

    Sudip K. Sarker

  2. Academic Surgery, University College London, London, WC1E 6BT, UK

    Isis Kumar

  3. Department of Colorectal Surgery, University Hospitals Case Medical Centre, Cleveland, OH, 44106, USA

    Conor Delaney

  4. 89 Cornwall Gardens, London, SW7 4AX, UK

    Sudip K. Sarker

Authors
  1. Sudip K. Sarker
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Isis Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Conor Delaney
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sudip K. Sarker.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sarker, S.K., Kumar, I. & Delaney, C. Assessing Operative Performance in Advanced Laparoscopic Colorectal Surgery. World J Surg 34, 1594–1603 (2010). https://doi.org/10.1007/s00268-010-0486-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00268-010-0486-4

Keywords

Search

Navigation