Skip to main content
SpringerLink
Log in

Development of a novel tool to assess skills in laparoscopic gastrectomy using the Delphi method: the Japanese operative rating scale for laparoscopic distal gastrectomy (JORS-LDG)

  • Published:
Surgical Endoscopy Aims and scope Submit manuscript

Abstract

Background

Assessment of the performance of laparoscopic gastrectomy is yet unreported, likely because of the complexity of the procedure. We aimed to develop a tool to assess the skills required for laparoscopic distal gastrectomy (LDG) through cognitive task analysis (CTA) and expert consensus using the Delphi method.

Methods

CTA involved the listing of the knowledge and criteria required for completing each step of LDG as subtasks based on interviews by experts and novices and text book, instructional video, and procedural review. The Delphi evaluation method involved anonymous online surveys, conducted to merge the opinions of experts in laparoscopic gastrectomy. The experts were asked to rate (from 1 to 5) the importance of subtasks for skill evaluation and training for LDG using a Likert scale. Consensus among expert viewpoints was determined by the internal consistency of each item using Cronbach’s approach.

Results

Essential subtasks drafted for the assessment of LDG performance were determined based on the CTA. Thirty-one LDG experts participated in the online-survey with a response rate over 90%. A consensus was achieved after 2 rounds of surveys with a Cronbach alpha of 0.86, and 34 subtasks of LDG were selected. We finally created the Japanese Operative Rating Scale for Laparoscopic Distal Gastrectomy (JORS-LDG) based on the 34 subtasks.

Conclusions

We developed the JORS-LDG using CTA and the Delphi method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Derevianko AY, Schwaitzberg SD, Tsuda S, Barrios L, Brooks DC, Callery MP, Fobert D, Irias N, Rattner DW, Jones DB (2010) Malpractice carrier underwrites fundamentals of laparoscopic surgery training and testing: a benchmark for patient safety. Surg Endosc 24:616–623

    Article  Google Scholar 

  2. Hafford ML, Van Sickle KR, Willis RE, Wilson TD, Gugliuzza K, Brown KM, Scott DJ (2013) Ensuring competency: are fundamentals of laparoscopic surgery training and certification necessary for practicing surgeons and operating room personnel? Surg Endosc 27:118–126

    Article  Google Scholar 

  3. Kurashima Y, Feldman LS, Al-Sabah S, Kaneva PA, Fried GM, Vassiliou MC (2011) A tool for training and evaluation of laparoscopic inguinal hernia repair: the global operative assessment of laparoscopic skills-groin hernia (GOALS-GH). Am J Surg 201:54–61

    Article  Google Scholar 

  4. Poudel S, Kurashima Y, Kawarada Y, Watanabe Y, Murakami Y, Matsumura Y, Kato H, Miyazaki K, Shichinohe T, Hirano S (2016) Development and validation of a checklist for assessing recorded performance of laparoscopic inguinal hernia repair. Am J Surg 212:468–474

    Article  Google Scholar 

  5. Palter VN, Grantcharov TP (2012) A prospective study demonstrating the reliability and validity of two procedure-specific evaluation tools to assess operative competence in laparoscopic colorectal surgery. Surg Endosc 26:2489–2503

    Article  Google Scholar 

  6. Zevin B, Bonrath EM, Aggarwal R, Dedy NJ, Ahmed N, Grantcharov TP (2013) Development, feasibility, validity, and reliability of a scale for objective assessment of operative performance in laparoscopic gastric bypass surgery. J Am Coll Surg 216:955–965

    Article  Google Scholar 

  7. Torre LA, Bray F, Siegel RL, Ferlay J, Lortet-Tieulent J, Jemal A (2012) Global cancer statistics. CA Cancer J Clin 65:87–108

    Article  Google Scholar 

  8. Fock KM, Ang TL (2010) Epidemiology of Helicobacter pylori infection and gastric cancer in Asia. J Gastro Hepatol 25:479–486

    Article  CAS  Google Scholar 

  9. Japanese Gastric Cancer Association (2017) Japanese gastric cancer treatment guidelines 2014 (ver.). Gastric Cancer 20:1–19

    Article  Google Scholar 

  10. Mori T, Kimura T, Kitajima M (2010) Skill accreditation system for laparoscopic gastroenterologic surgeons in Japan. Minim Invasive Ther Allied Technol 19:18–23

    Article  Google Scholar 

  11. Singh P, Aggarwal R, Zevin B, Grantcharov T, Darzi A (2014) A global Delphi consensus study on defining and measuring quality in surgical training. J Am Coll Surg 219:346–353.e7

    Article  Google Scholar 

  12. Fink A, Kosecoff J, Chassin M, Brook RH (1984) Consensus methods: characteristics and guidelines for use. Am J Public Health 74:979–983

    Article  CAS  Google Scholar 

  13. Black N, Murphy M, Lamping D, McKee M, Sanderson C, Askham J, Marteau T (1999) Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy 4:236–248

    Article  CAS  Google Scholar 

  14. Stefanidis D, Montero P, Urbach DR, Qureshi A, Perry K, Bachman SL, Madan A, Petersen R, Pryor AD (2014) SAGES research agenda in gastrointestinal and endoscopic surgery: updated results of a Delphi study. Surg Endosc 28:2763–2771

    Article  Google Scholar 

  15. Francis N, Kazaryan AM, Pietrabissa A, Goitein D, Yiannakopoulou E, Agresta F, Khatkov I, Schulze S, Arulampalam T, Tomulescu V, Kim YW, Targarona EM, Zaninotto G (2017) A research agenda for the European Association for Endoscopic Surgeons (EAES). Surg Endosc 31:2042–2049

    Article  Google Scholar 

  16. Pucher PH, Brunt LM, Fanelli RD, Asbun HJ, Aggarwal R (2015) SAGES expert Delphi consensus: critical factors for safe surgical practice in laparoscopic cholecystectomy. Surg Endosc 29:3074–3085

    Article  Google Scholar 

  17. Palter VN, MacRae HM, Grantcharov TP (2011) Development of an objective evaluation tool to assess technical skill in laparoscopic colorectal surgery: a Delphi methodology. Am J Surg 201:251–259

    Article  Google Scholar 

  18. Dijkstra FA, Bosker RJ, Veeger NJ, van Det MJ, Pierie JP (2015) Procedural key steps in laparoscopic colorectal surgery, consensus through Delphi methodology. Surg Endosc 29:2620–2627

    Article  Google Scholar 

  19. Birkmeyer JD, Finks JF, O’Reilly A, Oerline M, Carlin AM, Nunn AR, Dimick J, Banerjee M, Birkmeyer NJO (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:1434–1442

    Article  CAS  Google Scholar 

  20. Mackenzie H, Ni M, Miskovic D, Motson RW, Gudgeon M, Khan Z, Longman R, Coleman MG, Hanna GB (2015) Clinical validity of consultant technical skills assessment in the English National Training Programme for laparoscopic colorectal surgery. Br J Surg 102:991–997

    Article  CAS  Google Scholar 

  21. Scally CP, Varban OA, Carlin AM, Birkmeyer JD, Dimick JB (2016) Video ratings of surgical skill and late outcomes of bariatric surgery. JAMA Surg 151:e160428

    Article  Google Scholar 

Download references

Acknowledgements

The author would like to thank the 31 laparoscopic surgeons who participated in this study. We could not complete this study without their kind support.

Author information

Authors and Affiliations

  1. Department of Gastroenterological Surgery II, Hokkaido University Graduate School of Medicine, Kita-15, Nishi-7, Kita-ku, Sapporo, 060-8638, Japan

    Yo Kurashima, Yusuke Watanabe, Saseem Poudel, Yuma Ebihara, Soichi Murakami, Toshiaki Shichinohe & Satoshi Hirano

  2. Clinical Simulation Center, Hokkaido University Graduate School of Medicine, Sapporo, Japan

    Yo Kurashima

  3. Department of Gastroenterological Surgery, The Cancer Institute Hospital of Japanese Foundation for Cancer Research, Tokyo, Japan

    Naoki Hiki

  4. Department of Gastroenterological Surgery, Keiyukai Sapporo Hospital, Sapporo, Japan

    Hidehiko Kitagami

Authors
  1. Yo Kurashima
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yusuke Watanabe
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Naoki Hiki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Saseem Poudel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hidehiko Kitagami
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yuma Ebihara
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Soichi Murakami
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Toshiaki Shichinohe
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Satoshi Hirano
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yo Kurashima.

Ethics declarations

Disclosures

Dr. Yo Kurashima is a consultant at Ethicon. Drs. Yusuke Watanabe, Naoki Hiki, Saseem Poudel, Hidehiko Kitagami, Yuma Ebihara, Soichi Murakami, Toshiaki Shichinohe, and Satoshi Hirano have no conflicts of interest or financial ties to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kurashima, Y., Watanabe, Y., Hiki, N. et al. Development of a novel tool to assess skills in laparoscopic gastrectomy using the Delphi method: the Japanese operative rating scale for laparoscopic distal gastrectomy (JORS-LDG). Surg Endosc 33, 3945–3952 (2019). https://doi.org/10.1007/s00464-019-06681-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00464-019-06681-6

Keywords

Search

Navigation