Applications of Virtual and Augmented Reality in Biomedical Imaging
Virtual and Augmented Reality has experienced a steady growth in medicine in recent years. At the same time, the radiological images play a central role in the diagnosis and planification of surgical approaches. The aim of this study is to present the first attempt to enhanced radiological image visualization using virtual and augmented reality for better planification and monitorization of surgeries. This application allows to move beyond traditional two-dimensional images towards three-dimensional models that can be visualized and manipulated with both Augmented Reality and Virtual Reality. We propose possible approaches to automate the segmentation of radiological images, using computer vision techniques and Artificial Intelligence.
KeywordsVirtual reality Augmented reality DICOM 3D visualization Radiological images Image segmentation
The authors would like to thank ARSOFT company for their technical work and the Education in Knowledge Society PhD Programme of the University of Salamanca for their support.
This project has been funded by the Spanish Ministry of Science, Innovation and Universities, as part of the Spanish National Program of Research, Development and Innovation for Challenges of Society, as part of the National Plan for Scientific and Technical Research and Innovation, with expedient number RTC-2017-6682-1.
Compliance with Ethical Standards
Conflict of Interest
The authors declare that they have no conflict of interest.
- 2.Brammer, M., The role of neuroimaging in diagnosis and personalized medicine--current position and likely future directions. Dialogues Clin. Neurosc. 11:389–396, 2009.Google Scholar
- 3.Inoue, D., Kabata, T., Maeda, T., Kajino, Y., Fujita, K., Hasegawa, K. , Yamamoto, T., and Tsuchiya, H., Value of computed tomography-based three-dimensional surgical preoperative planning software in total hip arthroplasty with developmental dysplasia of the hip. J. Orthopaed. Sci., 2015.Google Scholar
- 4.Seeram, E., Computed tomography: Physical principles, clinical applications, and quality control, fourth edition [chapter 11]. ISBN: 978–0–323-31288-2, 2016.Google Scholar
- 5.Prionas, N. D., Ray, S., and Boone, J. M., Volume assessment accuracy in computed tomography: A phantom study. Journal of applied clinical medical physics, volume 11, number 2, Spring 2010.Google Scholar
- 6.Zaiton, N. M., and Musbah, J., Aquel. survey on image segmentation techniques. Int. Conf. Commun. Manag. Inform. Technol. (ICCMIT 2015), 2015. https://doi.org/10.1016/j.procs.2015.09.02.
- 7.Zaitoun, N. M., and Aqel, M. J., Survey on image segmentation techniques. Int. Conf. Commun. Manag. Inform. Technol. (ICCMIT), 2015. https://doi.org/10.1016/j.procs.2015.09.027.
- 8.Sharma, N., and Aggarwal, L. M., Automated medical image segmentation techniques. J. Med. Phys., 2010. https://doi.org/10.4103/0971-6203.58777.
- 10.S. González Izard , J.A. Juanes Méndez , J. M. Gonzalvez Estella , M.J. Sánchez Ledesma , F. J. García-Peñalvo , P. R. Palomera, Virtual simulation for scoliosis surgery, proceedings of the 5th international conference on technological ecosystems for enhancing Multiculturality, 1–8, 2017. Cádiz, Spain. doi: https://doi.org/10.1145/3144826.3145404.
- 11.Belda, J., Leap Motion (II): principio de funcionamiento. Showleap Technologies, 2015. From http://blog.showleap.com/2015/05/leap-motion-ii-principio-de-funcionamiento/
- 12.Marin, G., Dominio, F., and Zanuttigh, P., Hand gesture recognition with leap motion and kinect devices. Image Process. (ICIP), 2014 IEEE Int. Conf., 2014. https://doi.org/10.1109/ICIP.2014.7025313.
- 13.Manolova, A., System for touchless interaction with medical images in surgery using leap motion. Radiocommunications and Videotechnologies Department Faculty of Telecommunications, Technical University of Sofia. Communications, Electromagnetics and Medical Applications (CEMA'14).Google Scholar
- 15.A. Silvetti, C. Delrieux, S. Castro (2001). Una implementación eficiente del algoritmo Marching Cubes. http://hdl.handle.net/10915/23546
- 16.Al-Shayea, Q. K., Artificial neural networks in medical diagnosis. IJCSI Int. J. Comput. Sci. 8(2):2011, 2011.Google Scholar