Skip to main content

Advertisement

SpringerLink
Log in

LapOntoSPM: an ontology for laparoscopic surgeries and its application to surgical phase recognition

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

An Erratum to this article was published on 24 December 2015

Abstract

Purpose

The rise of intraoperative information threatens to outpace our abilities to process it. Context-aware systems, filtering information to automatically adapt to the current needs of the surgeon, are necessary to fully profit from computerized surgery. To attain context awareness, representation of medical knowledge is crucial. However, most existing systems do not represent knowledge in a reusable way, hindering also reuse of data. Our purpose is therefore to make our computational models of medical knowledge sharable, extensible and interoperational with established knowledge representations in the form of the LapOntoSPM ontology. To show its usefulness, we apply it to situation interpretation, i.e., the recognition of surgical phases based on surgical activities.

Methods

Considering best practices in ontology engineering and building on our ontology for laparoscopy, we formalized the workflow of laparoscopic adrenalectomies, cholecystectomies and pancreatic resections in the framework of OntoSPM, a new standard for surgical process models. Furthermore, we provide a rule-based situation interpretation algorithm based on SQWRL to recognize surgical phases using the ontology.

Results

The system was evaluated on ground-truth data from 19 manually annotated surgeries. The aim was to show that the phase recognition capabilities are equal to a specialized solution. The recognition rates of the new system were equal to the specialized one. However, the time needed to interpret a situation rose from 0.5 to 1.8 s on average which is still viable for practical application.

Conclusion

We successfully integrated medical knowledge for laparoscopic surgeries into OntoSPM, facilitating knowledge and data sharing. This is especially important for reproducibility of results and unbiased comparison of recognition algorithms. The associated recognition algorithm was adapted to the new representation without any loss of classification power. The work is an important step to standardized knowledge and data representation in the field on context awareness and thus toward unified benchmark data sets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36

    Article  Google Scholar 

  2. Joyce JP, Lapinski GW (1983) A history and overview of the safety parameter display system concept. IEEE Nucl Sci 30:744–749

    Article  Google Scholar 

  3. Kranzfelder M, Staub C, Fiolka A, Schneider A, Gillen S, Wilhelm D, Friess H, Knoll A, Feussner H (2013) Toward increased autonomy in the surgical OR: needs, requests, and expectations. Surg Endosc 27(5):1681–1688

    Article  PubMed  Google Scholar 

  4. Lemke HU, Ratib OM, Horii SC (2005) Workflow in the operating room: a summary review of the arrowhead 2004 seminar on imaging and informatics. Int Congr Ser 1281:862–867

    Article  Google Scholar 

  5. Cleary K, Chung H, Mun S (2005) Or 2020: the operating room of the future. In: CARS 2005: computer assisted radiology and surgery, Proceedings of the 19th international congress and exhibition, International congress series, vol 1281, pp 832–838

  6. Lalys F, Jannin P (2013) Surgical process modelling: a review. Int J Comput Assist Radiol Surg 9(3):495–511. doi:10.1007/s11548-013-0940-5

  7. Blum T, Padoy N, Feussner H, Navab N (2008) Workflow mining for visualization and analysis of surgeries. Int J Comput Assist Radiol Surg 3(5):379–386

    Article  Google Scholar 

  8. Bouarfa L, Jonker PP, Dankelman J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform 44(3):455–462

    Article  PubMed  Google Scholar 

  9. Ahmadi A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2007) Recovery of surgical workflow without explicit models. Med Image Comput Comput Assist Interv 9(Pt 1):420–428

  10. Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) In: Random forests for phase detection in surgical workflow analysis the 5th international conference on information processing in computer-assisted interventions (IPCAI)

  11. Reiley C, Lin H, Varadarajan B, Vagolgyi B, Khudanpur S, Yuh D, Hager G (2008) Automatic recognition of surgical motions using statistical modeling for capturing variability. Stud Health Technol Inform 132:396–401

  12. Lalys F, Riffaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM. Med Comput Vis Recognit Tech Appl Med Imaging

  13. Padoy N, Blum T, Ahmadi SA, Feussner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632–641

    Article  PubMed  Google Scholar 

  14. Blum T, Feussner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. Med Image Comput Comput Assist Interv

  15. Suzuki T, Sakurai Y, Yoshimitsu K, Nambu K, Muragaki Y, Iseki H (2010) Intraoperative multichannel audio-visual information recording and automatic surgical phase and incident detection. In: 32nd annual international conference of the IEEE EMBS, 1190–1193

  16. Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2011) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71

    Article  PubMed  PubMed Central  Google Scholar 

  17. Burgert O, Neumuth T, Lempp F, Mudunuri R, Meixensberger J, Strauss G, Dietz A, Jannin P, Lemke HU (2006) Linking top-level ontologies and surgical workflows. Int J Comput Assist Radiol Surg 1(1):437–438

    Google Scholar 

  18. Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37(3):783–791

    Article  PubMed  CAS  Google Scholar 

  19. Neumuth T, Kaschek B, Neumuth D, Ceschia M, Meixensberger J, Strauss G, Burgert O (2010) An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions. Behav Res Methods 42(4):1049–1058

  20. Neumuth D, Loebe F, Herre H, Neumuth T (2011) Modeling surgical processes: a four-level translational approach. Artif Intell Med 51(3):147–161

    Article  PubMed  Google Scholar 

  21. Lalys F, Bouget B, Riffaud R, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg CARS 8:39–49

    Article  Google Scholar 

  22. Oropesa I, Snchez-Gonzlez P, Lamata P, Chmarra MK, Pagador JB, Snchez-Margallo JA, Snchez-Margallo FM, Gmez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171(1):81–95

    Article  Google Scholar 

  23. Blake C, Keogh E, Merz CJ (1998) UCI repository of machine learning databases, http://www.ics.uci.edu/mlearn/MLRepository.html

  24. Katic Katic, Wekerle AL, Grtner F, Kenngott HG, Müller-Stich BP, Dillmann R, Speidel S (2014) Knowledge-driven formalization of laparoscopic surgeries for rule-based intraoperative context-aware assistance. Information processing in computer-assisted interventions, Lecture Notes in Computer Science, vol 8498, pp 158–167

  25. Gibaud B, Penet C, Pierre J (2014) OntoSPM: a core ontology of surgical procedure models, SURGETICA

  26. Grenon P, Smith B (2004) SNAP and SPAN: towards dynamic spatial ontology. Spat Cognit Compuat 1(4):69–103

    Google Scholar 

  27. Rosse C, Mejino JLV (2007) The foundational model of anatomy ontology. Anat Ontol Bioinf Princ Pract 6:59–117

    Google Scholar 

  28. Information Artifact Ontology. https://code.google.com/p/information-artifact-ontology

  29. Unit Ontology. https://code.google.com/p/unit-ontology/

  30. Speidel S, Benzko J, Sudra G, Azad P, Müller-Stich BP, Gutt C, Dillmann R (2009) Automatic classification of minimally invasive instruments based on endoscopic image sequences. SPIE Med Imaging 7261

  31. Neumuth T, Strauss G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006

  32. Xiang Z, Courtot M, Brinkman RR, Ruttenberg A, He Y (2010) OntoFox: web-based support for ontology reuse. BMC Res Notes 3:175

    Article  PubMed  PubMed Central  Google Scholar 

  33. O’Connor MJ, Das A (2009) SQWRL: a query language for OWL OWL: experiences and directions (OWLED). In: 6th International Workshop

  34. Shearer R, Motik B, Horrocks I (2008) HermiT: a highly-efficient OWL reasoner. In: 5th International workshop on OWL: experiences and directions

  35. O’Connor MJ, Knublauch H, Tu SW, Grossof B, Dean M, Grosso WE, Musen MA (2005) Supporting Rule System Interoperability on the Semantic Web with SWRL. In: 4th International semantic web conference (ISWC) LNCS 3729:974–986

  36. Horridge M, Bechhofer S (2011) The OWL API: a Java API for OWL ontologies. Semanti Web J Spec Issue Semant Web Tools Syst 2(1):11–21

    Google Scholar 

  37. http://protege.stanford.edu/

  38. Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inform Assoc 16(1):72–80. doi:10.1197/jamia.M2748 PMCID: PMC2605601

  39. Cornet R, de Keizer N (2008) Forty years of SNOMED: a literature review. BMC Med Inform Decis Mak 8(Suppl 1):S2

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

The present research was supported by the “SFB TRR 125” funded by the DFG, the ESF of Baden-Wuerttemberg and the Karlsruhe House of Young Scientists (KHYS)” and for the French partners by a French government support granted to the CominLabs excellence laboratory and managed by the National Research Agency in the “Investing for the Future” program under reference ANR–10–LABX–07–01.

Conflict of interest

Darko Katić, Chantal Julliard, Anna-Laura Wekerle, Hannes Kenngott, Beat Peter Müller-Stich, Rüdiger Dillmann, Stefanie Speidel, Pierre Jannin and Bernard Gibaud declare that they have no conflict of interest.

Author information

Authors and Affiliations

  1. Karlsruhe Institute of Technology (KIT), Adenauerring 2, 76131, Karlsruhe, Germany

    Darko Katić, Chantal Julliard, Anna-Laura Wekerle, Hannes Kenngott, Beat Peter Müller-Stich, Rüdiger Dillmann, Stefanie Speidel, Pierre Jannin & Bernard Gibaud

Authors
  1. Darko Katić
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chantal Julliard
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anna-Laura Wekerle
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hannes Kenngott
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Beat Peter Müller-Stich
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rüdiger Dillmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Stefanie Speidel
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Pierre Jannin
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Bernard Gibaud
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Darko Katić.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Katić, D., Julliard, C., Wekerle, AL. et al. LapOntoSPM: an ontology for laparoscopic surgeries and its application to surgical phase recognition. Int J CARS 10, 1427–1434 (2015). https://doi.org/10.1007/s11548-015-1222-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-015-1222-1

Keywords

Search

Navigation