Skip to main content
SpringerLink
Log in

Depth-Awareness in a System for Mixed-Reality Aided Surgical Procedures

  • Conference paper
  • First Online:
Intelligent Computing Methodologies (ICIC 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11645))

Included in the following conference series:

Abstract

Computer-assisted surgery is a trending topic in research, with many different approaches which aim at supporting surgeons in the operating room. Existing surgical planning and navigation solutions are often considered to be distracting, unintuitive or hard to interpret. In this work, we address this issue with an approach based on mixed reality devices like Microsoft HoloLens. We assess the depth sensing capabilities of Microsoft HoloLens, and the potential benefit they could bring to computer-assisted surgery applications.

Supported by FWF KLI 678-B31 (enFaced), COMET K-Project 871132 (CAMed) and the TU Graz Lead Project (Mechanics, Modeling and Simulation of Aortic Dissection).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. National Institutes of Health: Technologies Enhance Tumor Surgery: Helping Surgeons Spot and Remove Cancer. News in Health (2016)

    Google Scholar 

  2. Chen, X., et al.: Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J. Biomed. Inform. 55, 124–131 (2015)

    Article  Google Scholar 

  3. Perkins, S.L., Lin, M.A., Srinivasan, S., Wheeler, A.J., Hargreaves, B.A., Daniel, B.L.: A mixed reality system for breast surgical planning. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Nantes, pp. 269–274 (2017)

    Google Scholar 

  4. Pratt, P., et al.: Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels. Eur. Radiol. Exp. 2(1), 2 (2018)

    Article  Google Scholar 

  5. Wang, J., Suenaga, H., Yang, L., Kobayashi, E., Sakuma, I.: Video see-through augmented reality for oral and maxillofacial surgery. Int. J. Med. Rob. Comput. Assist. Surg. 13, e1754 (2017)

    Article  Google Scholar 

  6. Pepe, A., et al.: Pattern recognition and mixed reality for computer-aided maxillofacial surgery and oncological assessment. In: 2018 11th IEEE Biomedical Engineering International Conference (BMEiCON), pp. 1–5 (2018). https://doi.org/10.1109/BMEiCON.2018.8609921

  7. Dlib C++ library. http://www.dlib.net

  8. Bevilacqua, V., D’Ambruoso, D., Mandolino, G., Suma, M.: A new tool to support diagnosis of neurological disorders by means of facial expressions. In: IEEE International Symposium on Medical Measurements and Applications, Medical Measurements and Applications Proceedings (MeMeA2011), pp. 544–549 (2011). https://ieeexplore.ieee.org/document/5966766/

  9. Bevilacqua, V., Biasi, L., Pepe, A., Mastronardi, G., Caporusso, N.: A computer vision method for the italian finger spelling recognition. In: International Conference on Intelligent Computing (ICIC2015), vol. 9227, pp. 264–274 (2015). https://doi.org/10.1007/978-3-319-22053-6_28

    Google Scholar 

  10. Bevilacqua, V., et al.: A comprehensive method for assessing the blepharospasm cases severity. In: Santosh, K.C., Hangarge, M., Bevilacqua, V., Negi, A. (eds.) RTIP2R 2016. CCIS, vol. 709, pp. 369–381. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-4859-3_33

    Chapter  Google Scholar 

  11. Microsoft: HoloLens Research Mode Tutorial at CVPR (2018). https://docs.microsoft.com/it-it/windows/mixed-reality/cvpr-2018

  12. Microsoft: HoloLensForCV C#/C++ library. https://github.com/Microsoft/HoloLensForCV

  13. MathWorks: pcfitplane - fit plane to 3D point cloud. https://www.mathworks.com/help/vision/ref/pcfitplane.html

  14. Microsoft: Process Media frames with MediaFrameReader. https://docs.microsoft.com/en-us/windows/uwp/audio-video-camera/processmedia-frames-with-mediaframereader#setting-up-your-project

  15. Guyman, W., Zeller, M., Cowley, E., Bray, B.: Locatable camera, Microsoft - Windows Dev Center, 21 March 2018. https://docs.microsoft.com/en-us/windows/mixedreality/locatable-camera

  16. Microsoft: CameraIntrinsics Class. https://docs.microsoft.com/en-us/uwp/api/windows.media.devices.core.cameraintrinsics

Download references

Author information

Authors and Affiliations

  1. Institute for Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Graz, Austria

    Mauro Sylos Labini, Christina Gsaxner, Antonio Pepe & Jan Egger

  2. Computer Algorithms for Medicine Laboratory, Graz, Austria

    Mauro Sylos Labini, Christina Gsaxner, Antonio Pepe, Juergen Wallner & Jan Egger

  3. Department of Electrical and Information Engineering, Polytechnic University of Bari, Bari, Italy

    Mauro Sylos Labini & Vitoantonio Bevilacqua

  4. Department of Oral and Maxillofacial Surgery, Medical University of Graz, Graz, Austria

    Christina Gsaxner, Juergen Wallner & Jan Egger

Authors
  1. Mauro Sylos Labini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christina Gsaxner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Antonio Pepe
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Juergen Wallner
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jan Egger
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Vitoantonio Bevilacqua
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jan Egger .

Editor information

Editors and Affiliations

  1. Tongji University, Shanghai, China

    De-Shuang Huang

  2. Nanchang Institute of Technology, Nanchang, China

    Zhi-Kai Huang

  3. Liverpool John Moores University, Liverpool, UK

    Abir Hussain

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sylos Labini, M., Gsaxner, C., Pepe, A., Wallner, J., Egger, J., Bevilacqua, V. (2019). Depth-Awareness in a System for Mixed-Reality Aided Surgical Procedures. In: Huang, DS., Huang, ZK., Hussain, A. (eds) Intelligent Computing Methodologies. ICIC 2019. Lecture Notes in Computer Science(), vol 11645. Springer, Cham. https://doi.org/10.1007/978-3-030-26766-7_65

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-26766-7_65

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-26765-0

  • Online ISBN: 978-3-030-26766-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation