Skip to main content
Log in

Objective assessment of minimally invasive total mesorectal excision performance: a systematic review

  • Review
  • Published:
Techniques in Coloproctology Aims and scope Submit manuscript

Abstract

Introduction

Laparoscopy is widely used in colorectal practice, but recent trial results have questioned its use in rectal cancer resections. Patient outcomes are directly linked to the quality of total mesorectal excision (TME) specimen. Objective assessment of intraoperative performance could help ensure competence and delivery of optimal outcomes. Objective tools may also contribute to TME intervention trials, but their nature, structure and utilisation is unknown.

Aim

To systemically review the available literature to report on the available tools for the objective assessment of minimally invasive TME operative performance and their use within multicentre laparoscopic TME randomised controlled trials.

Methods

A systematic search of the PubMed and Cochrane databases was performed to identify tools used in the objective intraoperative assessment of minimally invasive TME performance in accordance with the PRISMA guidelines, independently by two authors. The identified tools were then evaluated within reported TME RCTs.

Results

A total of 8642 abstracts were screened of which 12 papers met the inclusion criteria; ten prospective observational studies, one randomised trial and one educational consensus. Eight assessment methods were described, which include formative and summative tools. The tools were mostly adaptations of colonic surgery tools based on either operative video review or post-operative trainer rating. All studies reported objective assessment of intraoperative performance was feasible, but only 126 (7%) of the 1762 included laparoscopic cases were TME. No multicentre laparoscopic TME trial reported using any objective surgical performance assessment tool.

Conclusion

Objective intraoperative laparoscopic TME performance assessment is feasible, but most of the current tools are adaptation of colonic surgery. There is a need to develop dedicated assessment tools for minimal access rectal surgery. No multicentre minimally invasive TME RCT reported using any objective assessment tool.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Schwenk W, Haase O, Neudecker J, Muller JM (2005) Short term benefits for laparoscopic colorectal resection. Cochrane Database Syst Rev 3:CD003145

    Google Scholar 

  2. Fleshman J, Branda M, Sargent DJ, Boller AM, George V, Abbas M et al (2015) Effect of laparoscopic-assisted resection vs open resection of stage II or III rectal cancer On pathologic outcomes: the ACOSOG Z6051 randomized clinical trial. JAMA 314(13):1346–1355

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Stevenson AR, Solomon MJ, Lumley JW, Hewett P, Clouston AD, Gebski VJ et al (2015) Effect of laparoscopic-assisted resection vs open resection on pathological outcomes in rectal cancer: the ALaCaRT randomized clinical trial. JAMA 314(13):1356–1363

    Article  CAS  PubMed  Google Scholar 

  4. Quirke P, Steele R, Monson J, Grieve R, Khanna S, Couture J et al (2009) Effect of the plane of surgery achieved on local recurrence in patients with operable rectal cancer: a prospective study using data from the MRC CR07 and NCIC-CTG CO16 randomised clinical trial. Lancet 373(9666):821–828

    Article  PubMed  PubMed Central  Google Scholar 

  5. Leonard D, Penninckx F, Laenen A, Kartheuser A (2015) Scoring the quality of total mesorectal excision for the prediction of cancer-specific outcome. Colorectal Dis 17(5):O115–O122

    Article  CAS  PubMed  Google Scholar 

  6. Nagtegaal ID, van de Velde CJ, van der Worp E, Kapiteijn E, Quirke P, van Krieken JH (2002) Macroscopic evaluation of rectal cancer resection specimen: clinical significance of the pathologist in quality control. J Clin Oncol 20(7):1729–1734

    Article  PubMed  Google Scholar 

  7. Van Sickle KR, Gallagher AG, Smith CD (2007) The effect of escalating feedback on the acquisition of psychomotor skills for laparoscopy. Surg Endosc 21(2):220–224

    Article  PubMed  Google Scholar 

  8. Moorthy K, Munz Y, Sarker SK, Darzi A (2003) Objective assessment of technical skills in surgery. BMJ 327(7422):1032–1037

    Article  PubMed  PubMed Central  Google Scholar 

  9. Birkmeyer JD, Stukel TA, Siewers AE, Goodney PP, Wennberg DE, Lucas FL (2003) Surgeon volume and operative mortality in the United States. N Engl J Med 349(22):2117–2127

    Article  CAS  PubMed  Google Scholar 

  10. Larson DW, Marcello PW, Larach SW, Wexner SD, Park A, Marks J et al (2008) Surgeon volume does not predict outcomes in the setting of technical credentialing: results from a randomized trial in colon cancer. Ann Surg 248(5):746–750

    Article  PubMed  Google Scholar 

  11. Foster JD, Mackenzie H, Nelson H, Hanna GB, Francis NK (2014) Methods of quality assurance in multicenter trials in laparoscopic colorectal surgery: a systematic review. Ann Surg 260(2):220–229

    Article  PubMed  Google Scholar 

  12. Simillis C, Hompes R, Penna M, Rasheed S, Tekkis PP (2016) A systematic review of transanal total mesorectal excision: Is this the future of rectal cancer surgery? Colorectal Dis 18(1):19–36

    Article  CAS  PubMed  Google Scholar 

  13. Penna M, Hompes R, Arnold S, Wynn G, Austin R, Warusavitarne J et al (2016) Transanal total mesorectal excision: international registry results of the first 720 cases. Ann Surg [Epub ahead of print]

  14. Markar SR, Wiggins T, Ni M, Steyerberg EW, Van Lanschot JJ, Sasako M et al (2015) Assessment of the quality of surgery within randomised controlled trials for the treatment of gastro-oesophageal cancer: a systematic review. Lancet Oncol 16(1):e23–e31

    Article  PubMed  Google Scholar 

  15. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339:b2535

    Article  PubMed  PubMed Central  Google Scholar 

  16. Vennix S, Pelzers L, Bouvy N, Beets GL, Pierie JP, Wiggers T et al (2014) Laparoscopic versus open total mesorectal excision for rectal cancer. Cochrane Database Syst Rev 4:CD005200

    Google Scholar 

  17. Downs SH, Black N (1998) The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 52(6):377–384

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Sarker SK, Kumar I, Delaney C (2010) Assessing operative performance in advanced laparoscopic colorectal surgery. World J Surg 34(7):1594–1603

    Article  PubMed  Google Scholar 

  19. Sarker SK, Delaney C (2011) Feasibility of self-appraisal in assessing operative performance in advanced laparoscopic colorectal surgery. Colorectal Dis 13(7):805–810

    Article  PubMed  Google Scholar 

  20. Miskovic D, Ni M, Wyles SM, Kennedy RH, Francis NK, Parvaiz A et al (2013) Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg 257(3):476–482

    Article  PubMed  Google Scholar 

  21. Miskovic D, Ni M, Wyles SM, Parvaiz A, Hanna GB (2012) Observational clinical human reliability analysis (OCHRA) for competency assessment in laparoscopic colorectal surgery at the specialist level. Surg Endosc 26(3):796–803

    Article  PubMed  Google Scholar 

  22. Miskovic D, Wyles SM, Carter F, Coleman MG, Hanna GB (2011) Development, validation and implementation of a monitoring tool for training in laparoscopic colorectal surgery in the English National Training Program. Surg Endosc 25(4):1136–1142

    Article  PubMed  Google Scholar 

  23. Jenkins JT, Currie A, Sala S, Kennedy RH (2016) A multi-modal approach to training in laparoscopic colorectal surgery accelerates proficiency gain. Surg Endosc 30(7):3007–3013

    Article  PubMed  Google Scholar 

  24. Costanzi A, Rigamonti L, Mari GM, Miranda A, Crippa J, Berardi V et al (2015) A prospective video-controlled study of genito-urinary disorders in 35 consecutive laparoscopic TMEs for rectal cancer. Surg Endosc 29(7):1721–1728

    Article  PubMed  Google Scholar 

  25. Foster JD, Ewings P, Falk S, Cooper EJ, Roach H, West NP et al (2016) Surgical timing after chemoradiotherapy for rectal cancer, analysis of technique (STARRCAT): results of a feasibility multi-centre randomized controlled trial. Tech Coloproctol 20(10):683–693

    Article  CAS  PubMed  Google Scholar 

  26. Marriott J, Purdie H, Crossley J, Beard JD (2011) Evaluation of procedure-based assessment for assessing trainees’ skills in the operating theatre. Br J Surg 98(3):450–457

    Article  CAS  PubMed  Google Scholar 

  27. Penna M, Hompes R, Mackenzie H, Carter F, Francis NK (2016) First international training and assessment consensus workshop on transanal total mesorectal excision (taTME). Tech Coloproctol 20(6):343–352

    Article  CAS  PubMed  Google Scholar 

  28. Mackenzie H, Ni M, Miskovic D, Motson RW, Gudgeon M, Khan Z et al (2015) Clinical validity of consultant technical skills assessment in the English National Training Programme for laparoscopic colorectal surgery. Br J Surg 102(8):991–997

    Article  CAS  PubMed  Google Scholar 

  29. Foster JD, Miskovic D, Allison AS, Conti JA, Ockrim J, Cooper EJ et al (2016) Application of objective clinical human reliability analysis (OCHRA) in assessment of technical performance in laparoscopic rectal cancer surgery. Tech Coloproctol 20(6):361–367

    Article  CAS  PubMed  Google Scholar 

  30. Coleman MG, Hanna GB, Kennedy R (2011) The national training programme for laparoscopic colorectal surgery in England: a new training paradigm. Colorectal Dis 13(6):614–616

    Article  CAS  PubMed  Google Scholar 

  31. LapCo. GAS forms http://lapco.nhs.uk/GAS-forms.php. 2016. 20-5-2016. Ref Type: Online Source

  32. ISCP. Procedure Based Assessment https://www.iscp.ac.uk/surgical/assessment_pba.aspx. 2016. 20-5-2016. Ref Type: Online Source

  33. Joice P, Hanna GB, Cuschieri A (1998) Errors enacted during endoscopic surgery—a human reliability analysis. Appl Ergon 29(6):409–414

    Article  CAS  PubMed  Google Scholar 

  34. Tang B, Hanna GB, Joice P, Cuschieri A (2004) Identification and categorization of technical errors by Observational Clinical Human Reliability Assessment (OCHRA) during laparoscopic cholecystectomy. Arch Surg 139(11):1215–1220

    Article  CAS  PubMed  Google Scholar 

  35. Kang SB, Park JW, Jeong SY, Nam BH, Choi HS, Kim DW et al (2010) Open versus laparoscopic surgery for mid or low rectal cancer after neoadjuvant chemoradiotherapy (COREAN trial): short-term outcomes of an open-label randomised controlled trial. Lancet Oncol 11(7):637–645

    Article  PubMed  Google Scholar 

  36. Kennedy RH, Francis EA, Wharton R, Blazeby JM, Quirke P, West NP et al (2014) Multicenter randomized controlled trial of conventional versus laparoscopic surgery for colorectal cancer within an enhanced recovery programme: EnROL. J Clin Oncol 32(17):1804–1811

    Article  PubMed  Google Scholar 

  37. Bonjer HJ, Deijen CL, Abis GA, Cuesta MA, van der Pas MH, de Lange-de Klerk ES et al (2015) A randomized trial of laparoscopic versus open surgery for rectal cancer. N Engl J Med 372(14):1324–1332

    Article  CAS  PubMed  Google Scholar 

  38. Jayne DG, Guillou PJ, Thorpe H, Quirke P, Copeland J, Smith AM et al (2007) Randomized trial of laparoscopic-assisted resection of colorectal carcinoma: 3-year results of the UK MRC CLASICC Trial Group. J Clin Oncol 25(21):3061–3068

    Article  PubMed  Google Scholar 

  39. Guillou PJ, Quirke P, Thorpe H, Walker J, Jayne DG, Smith AM et al (2005) Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer (MRC CLASICC trial): multicentre, randomised controlled trial. Lancet 365(9472):1718–1726

    Article  PubMed  Google Scholar 

  40. Jeong SY, Park JW, Nam BH, Kim S, Kang SB, Lim SB et al (2014) Open versus laparoscopic surgery for mid-rectal or low-rectal cancer after neoadjuvant chemoradiotherapy (COREAN trial): survival outcomes of an open-label, non-inferiority, randomised controlled trial. Lancet Oncol 15(7):767–774

    Article  PubMed  Google Scholar 

  41. Rickles AS, Dietz DW, Chang GJ, Wexner SD, Berho ME, Remzi FH et al (2015) High rate of positive circumferential resection margins following rectal cancer surgery: a call to action. Ann Surg 262(6):891–898

    Article  PubMed  PubMed Central  Google Scholar 

  42. Gravante G, Hemingway D, Stephenson JA, Sharpe D, Osman A, Haines M et al (2016) Rectal cancers with microscopic circumferential resection margin involvement (R1 resections): survivals, patterns of recurrence, and prognostic factors. J Surg Oncol 114(5):642–648

    Article  CAS  PubMed  Google Scholar 

  43. Heald RJ, Husband EM, Ryall RD (1982) The mesorectum in rectal cancer surgery—the clue to pelvic recurrence? Br J Surg 69(10):613–616

    Article  CAS  PubMed  Google Scholar 

  44. Heald RJ, Ryall RD (1986) Recurrence and survival after total mesorectal excision for rectal cancer. Lancet 1(8496):1479–1482

    Article  CAS  PubMed  Google Scholar 

  45. Miskovic D, Foster J, Agha A, Delaney CP, Francis N, Hasegawa H et al (2015) Standardization of laparoscopic total mesorectal excision for rectal cancer: a structured international expert consensus. Ann Surg 261(4):716–722

    Article  PubMed  Google Scholar 

  46. Deijen CL, Velthuis S, Tsai A, Mavroveli S, de Lange-de Klerk ES, Sietses C et al (2016) COLOR III: a multicentre randomised clinical trial comparing transanal TME versus laparoscopic TME for mid and low rectal cancer. Surg Endosc 30(8):3210–3215

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to N. K. Francis.

Ethics declarations

Conflicts of interest

Mr Curtis, Dr Davids, Mr Foster and Prof. Francis confirm they hold no conflicts of interest or financial disclosures.

Ethical approval

A formal ethical approval was not required for this evidence synthesis study. However, this research project was approved by the local governance of good clinical practice (GCP) according to the National Institute for Heath Research (NIHR)- UK.

Informed consent

No informed consent was required for this evidence synthesis study confined to a systematic review of published papers.

Appendix: Search string

Appendix: Search string

Minimally invasive

laparoscopic.tw OR laparoscope.tw OR laparoscopy.tw OR keyhole.tw OR minimally invasive.tw OR minimally-invasive.tw OR robotic.tw OR robot.tw OR robot assisted.tw OR stereoscopic.tw OR SILS.tw OR single incision.tw OR single-incision.tw OR stereoscope.tw OR 3D.tw OR three dimensional.tw OR three-dimensional.tw OR NOTES.tw

Total mesorectal excision

TME.tw OR total mesorectal excision.tw. OR mesorectal.tw OR rectal cancer.tw OR anterior resection.tw OR anterior-resection.tw OR TaTME.tw OR Trans-anal TME.tw OR colorectal.tw OR colo-rectal.tw. OR colo-rectal cancer.tw OR colorectal cancer.tw OR CRC.tw OR bowel resect$.tw OR rect$.tw OR proctectomy.tw

Assessment of performance

performance.tw OR assessment.tw OR objective.tw OR technical.tw OR procedural.tw OR competenc$.tw OR credent$.tw OR skill.mp OR proficiency.tw OR judgement.tw OR ability.tw OR training.tw OR education.tw OR analysis.tw OR developement.tw OR task.tw OR tool.tw OR error.tw OR proforma.tw OR score.tw OR checklist.tw OR global.tw OR evaluation.tw OR validity.tw OR observational.tw

  1. (((“laparoscopy”[MeSH Terms] OR “laparoscopy”[All Fields] OR “laparoscopic”[All Fields]) OR (“laparoscopes”[MeSH Terms] OR “laparoscopes”[All Fields] OR “laparoscope”[All Fields]) OR (“laparoscopy”[MeSH Terms] OR “laparoscopy”[All Fields]) OR keyhole[All Fields] OR (minimally[All Fields] AND invasive[All Fields]) OR minimally-invasive[All Fields] OR (“robotics”[MeSH Terms] OR “robotics”[All Fields] OR “robotic”[All Fields]) OR robot[All Fields] OR (robot[All Fields] AND assisted[All Fields]) OR stereoscopic[All Fields] OR (“squamous intraepithelial lesions of the cervix”[MeSH Terms] OR (“squamous”[All Fields] AND “intraepithelial”[All Fields] AND “lesions”[All Fields] AND “cervix”[All Fields]) OR “squamous intraepithelial lesions of the cervix”[All Fields] OR “sils”[All Fields]) OR ((“single person”[MeSH Terms] OR (“single”[All Fields] AND “person”[All Fields]) OR “single person”[All Fields] OR “single”[All Fields]) AND incision[All Fields]) OR single-incision[All Fields] OR stereoscope[All Fields] OR 3D[All Fields] OR (three[All Fields] AND dimensional[All Fields]) OR three-dimensional[All Fields] OR (“Notes Czechoslov Med Assoc G B”[Journal] OR “notes”[All Fields])) AND (TME[All Fields] OR (total[All Fields] AND mesorectal[All Fields] AND excision[All Fields]) OR mesorectal[All Fields] OR (“rectal neoplasms”[MeSH Terms] OR (“rectal”[All Fields] AND “neoplasms”[All Fields]) OR “rectal neoplasms”[All Fields] OR (“rectal”[All Fields] AND “cancer”[All Fields]) OR “rectal cancer”[All Fields]) OR (anterior[All Fields] AND resection[All Fields]) OR anterior-resection[All Fields] OR tatem[All Fields] OR (trans-anal[All Fields] AND tme[All Fields]) OR colorectal[All Fields] OR colo-rectal[All Fields] OR (“colorectal neoplasms”[MeSH Terms] OR (“colorectal”[All Fields] AND “neoplasms”[All Fields]) OR “colorectal neoplasms”[All Fields] OR (“colo”[All Fields] AND “rectal”[All Fields] AND “cancer”[All Fields]) OR “colo rectal cancer”[All Fields]) OR (“colorectal neoplasms”[MeSH Terms] OR (“colorectal”[All Fields] AND “neoplasms”[All Fields]) OR “colorectal neoplasms”[All Fields] OR (“colorectal”[All Fields] AND “cancer”[All Fields]) OR “colorectal cancer”[All Fields]) OR CRC[All Fields] OR (“administration, rectal”[MeSH Terms] OR (“administration”[All Fields] AND “rectal”[All Fields]) OR “rectal administration”[All Fields] OR “rectal”[All Fields]) OR (“rectum”[MeSH Terms] OR “rectum”[All Fields]) OR proctectomy[All Fields])) AND (performance[All Fields] OR (“Assessment”[Journal] OR “assessment”[All Fields]) OR (“goals”[MeSH Terms] OR “goals”[All Fields] OR “objective”[All Fields]) OR technical[All Fields] OR procedural[All Fields] OR (“mental competency”[MeSH Terms] OR (“mental”[All Fields] AND “competency”[All Fields]) OR “mental competency”[All Fields] OR “competence”[All Fields]) OR (“mental competency”[MeSH Terms] OR (“mental”[All Fields] AND “competency”[All Fields]) OR “mental competency”[All Fields] OR “competency”[All Fields]) OR (“credentialing”[MeSH Terms] OR “credentialing”[All Fields] OR “credential”[All Fields]) OR (“credentialing”[MeSH Terms] OR “credentialing”[All Fields]) OR skill[All Fields] OR proficiency[All Fields] OR (“judgment”[MeSH Terms] OR “judgment”[All Fields] OR “judgement”[All Fields]) OR (“aptitude”[MeSH Terms] OR “aptitude”[All Fields] OR “ability”[All Fields]) OR (“education”[Subheading] OR “education”[All Fields] OR “training”[All Fields] OR “education”[MeSH Terms] OR “training”[All Fields]) OR (“education”[Subheading] OR “education”[All Fields] OR “educational status”[MeSH Terms] OR (“educational”[All Fields] AND “status”[All Fields]) OR “educational status”[All Fields] OR “education”[All Fields] OR “education”[MeSH Terms]) OR (“analysis”[Subheading] OR “analysis”[All Fields]) OR (“growth and development”[Subheading] OR (“growth”[All Fields] AND “development”[All Fields]) OR “growth and development”[All Fields] OR “development”[All Fields]) OR task[All Fields] OR tool[All Fields] OR error[All Fields] OR proforma[All Fields] OR score[All Fields] OR (“checklist”[MeSH Terms] OR “checklist”[All Fields]) OR (“Glob Impacts”[Journal] OR “global”[All Fields]) OR (“evaluation studies”[Publication Type] OR “evaluation studies as topic”[MeSH Terms] OR “evaluation”[All Fields]) OR validity[All Fields] OR observational[All Fields]) AND ((“1982/01/01”[PDAT]: “2015/12/14”[PDAT]) AND English[lang])

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Curtis, N.J., Davids, J., Foster, J.D. et al. Objective assessment of minimally invasive total mesorectal excision performance: a systematic review. Tech Coloproctol 21, 259–268 (2017). https://doi.org/10.1007/s10151-017-1614-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10151-017-1614-z

Keywords

Navigation