An Augmented Reality Platform for Preoperative Surgical Planning

  • S. Teodoro Vite
  • C. F. Domínguez Velasco
  • S. Muscatello
  • M. Á. Padilla Castañeda
  • L. T. De PaolisEmail author
Conference paper
Part of the IFMBE Proceedings book series (IFMBE, volume 71)


Researching in new technologies for diagnosis, planning and medical treatment have allowed the development of computer tools that provide new ways of representing data obtained from patient’s medical images such as computed tomography (CT) and magnetic resonance imaging (MRI). In this sense, augmented reality (AR) technologies provide a new form of data representation by combining the common analysis using images and the ability to superimpose virtual 3D representations of the organs of the human body in the real environment. In this paper we describe the development of a generic computer platform based on augmented reality technology for surgical preoperative planning. In particular, the surgeon can navigate in the 3D models of the patient’s organs in order to have the possibility to perfectly understand the anatomy and plan in the best way the surgical procedure. In addition, a touchless interaction with the virtual organs is available thanks to the use of an armband provided of electromyographic muscle sensors. To validate the system, we focused in two cases of study: navigation through aorta artery for mitral valve repair surgery and navigation through vascular structures in the brain for the treatment of cerebral aneurysms.


Augmented reality Surgical planning Touchless interaction 



The platform described in this paper is part of the project No. UNAM-DGAPA_PAPIME-PE109018.

Conflict of Interest

The authors declare that they have no conflict of interest.


  1. 1.
    Lamata, P., Ali, W., Cano, A., Cornella, J., Declerck, J., Elle, O.J., Freudenthal, A., Furtado, H., Kalkofen, D., Naerum, E.: Augmented reality for minimally invasive surgery: overview and some recent advances. In: Augmented Reality. InTech, Croatia (2010)Google Scholar
  2. 2.
    De Paolis, L.T., Ricciardi, F.: Augmented visualisation in the treatment of the liver tumours with radiofrequency ablation. Comput. Methods Biomech. Biomed. Eng. Imaging Vis. 6(4), 396–404 (2018)CrossRefGoogle Scholar
  3. 3.
    De Paolis, L.T., Aloisio, G.: Augmented reality in minimally invasive surgery. In: Advances in Biomedical Sensing, Measurements, Instrumentation and Systems, pp. 305–320. Springer, Berlin (2010)Google Scholar
  4. 4.
    Wagner, A., Ploder, O., Enislidis, G., Truppe, M., Ewers, R.: Virtual image guided navigation in tumor surgery technical innovation. J. Craniomaxillofac. Surg. 23(5), 271–273 (1995)CrossRefGoogle Scholar
  5. 5.
    Collins, T., Pizarro, D., Bartoli, A., Canis, M., Bourdel, N.: Computer-assisted laparoscopic myomectomy by augmenting the uterus with pre-operative MRI data. In: IEEE International Symposium on Mixed and Augmented Reality, pp. 243–248 (2014)Google Scholar
  6. 6.
    Collins, T., Chauvet, P., Debize, C., Pizarro, D., Bartoli, A., Canis, M., Bourdel, N.: A system for augmented reality guided laparoscopic tumour resection with quantitative ex-vivo user evaluation. In: International Workshop on Computer-Assisted and Robotic Endoscopy, pp. 114–126. Springer, Berlin (2016)Google Scholar
  7. 7.
    Wang, J., Suenaga, H., Hoshi, K., Yang, L., Kobayashi, E., Sakuma, I., Liao, H.: Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans. Biomed. Eng. 61(4), 1295–1304 (2014)CrossRefGoogle Scholar
  8. 8.
    Ricciardi, F., Copelli, C., De Paolis, L.T.: An augmented reality system for maxillo-facial surgery. In: Fourth International Conference Augmented and Virtual Reality and Computer Graphics (AVR 2017), pp. 53–62. Springer, Berlin (2017)Google Scholar
  9. 9.
    Ricciardi, F., Copelli, C., De Paolis, L.T.: A pre-operative planning module for an augmented reality application in maxillo-facial surgery. In: International Conference on Augmented and Virtual Reality, pp. 244–254. Springer, Berlin (2015)Google Scholar
  10. 10.
    De Paolis, L.T.: Augmented visualization as surgical support in the treatment of tumors. In: International Conference on Bioinformatics and Biomedical Engineering, pp. 432–443. Springer, Berlin (2017)Google Scholar
  11. 11.
    Kersten-Oertel, M., Chen, S.J., Drouin, S., Sinclair, D.S., Collins, D.L.: Augmented reality visualization for guidance in neurovascular surgery. Stud. Health Technol. Inform. 173, 225–229 (2012)Google Scholar
  12. 12.
    Kersten-Oertel, M., Gerard, I., Drouin, S., Mok, K., Sirhan, D., Sinclair, D.S., Collins, D.L.: Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int. J. Comput. Assist. Radiol. Surg. 10(11), 1823–1836 (2015)CrossRefGoogle Scholar
  13. 13.
    Indraccolo, C., De Paolis, L.T.: Augmented reality and myo for a touchless interaction with virtual organs. In: International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 63–73. Springer, Berlin (2017)Google Scholar
  14. 14.
  15. 15.
    Cignoni, P., Callieri, M., Corsini, M., Dellepiane, M., Ganovelli, F., Ranzuglia, G.: MeshLab: an open-source mesh processing tool. In: Scarano, V., Chiara, R.D., Erra, U. (eds.) Eurographics Italian Chapter Conference (2008)Google Scholar
  16. 16.
    Hess, R.: Chapter 1—an introduction to 3D: recreating the world inside your computer, or not. In: Hess, R. (ed.) Blender Foundations, pp. 1–11. Focal Press, Boston (2010)Google Scholar
  17. 17.
  18. 18.

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • S. Teodoro Vite
    • 1
  • C. F. Domínguez Velasco
    • 1
  • S. Muscatello
    • 2
  • M. Á. Padilla Castañeda
    • 1
  • L. T. De Paolis
    • 2
    Email author
  1. 1.Applied Sciences and Technology InstituteNational Autonomous University of MexicoMexico CityMexico
  2. 2.Department of Engineering for InnovationUniversity of SalentoLecceItaly

Personalised recommendations