Abstract
In this study, we proposed to combine autostereoscopic 3D display and interactive display to enhance medical education and training, which could be an alternative to the traditional medical education. We developed an enhanced 3D rendering algorithm for medical education and training based on the traditional lens based rendering algorithm (LBR). We used the system to perform a user study of medical visualization and education with a heart phantom, and a human-computer interaction device to capture hand motions, rotations, and gestures. Structure of the heart was labeled and validated by physician ahead. Furthermore, we devided 40 users (20 women and 20 men) into two groups: control group and experimental group, to operate a user study on anatomical structure of the heart phantom. Experimental results showed that our algorithm can achieve higher rendering performance than the traditional LBR. User test showed that 3D education system equipped by the enhanced LBR can achieve interactive display, and can thus promote education experience and reduce education time consuming. Further work includes more user studies on medical education and increasing frame rate of rendering for more versatile hardware configurations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Basdogan, C., Ho, H., Srinivasan, M.: Virtual environments for medical training: graphical and haptic simulation of laparoscopic common bile duct exploration, IEEE/ASME Trans. Mechatronics 6, 269–285 (2001).
Okuda, Y., Bond, W., Bonfante, G., et al.: National growth in simulation training within emergency medicine residency programs, 2003–2008 [J]. Academic emergency medicine, 15(11), 1113–1116 (2008).
Loomis, M., Klatzky, L., and Giudice, N.: Sensory substitution of vision: importance of perceptual and cognitive processing. Assistive technology for blindness and low vision: 162–191(2012).
Van, K., and Broyles, J.: Visuospatial task performance as a function of two-and three-dimensional display presentation techniques. Displays, 21(1), 17–24 (2000).
Dodgson, N.: Autostereoscopic 3D Displays. Computer 38(8), 31–36 (2005).
Leap motion, Inc., Leap motion, https://www.leapmotion.com, last accessed 2018/01/27.
Chen, G. et. al.: Real-time Lens based Rendering Algorithm for Super-multiview Integral Photography without Image Resampling, IEEE transactions on visualization and computer graphics (2017).
Acknowledgements
The authors acknowledge supports from National Key Research and Development Program of China (2017YFC0108000), National Natural Science Foundation of China (81427803, 81771940), National Key Technology R&D Program of China (2015BAI01B03), Soochow-Tsinghua Innovation Project (2016SZ0206), and Beijing Municipal Science & Technology Commission (Z151100003915079).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Chen, G., Ma, C., Zhang, X., Liao, H. (2019). Enhance Medical Education and Training Using Interactive Autostereoscopic 3D Display by In Situ 3D Interaction. In: Lhotska, L., Sukupova, L., Lacković, I., Ibbott, G.S. (eds) World Congress on Medical Physics and Biomedical Engineering 2018. IFMBE Proceedings, vol 68/1. Springer, Singapore. https://doi.org/10.1007/978-981-10-9035-6_160
Download citation
DOI: https://doi.org/10.1007/978-981-10-9035-6_160
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-9034-9
Online ISBN: 978-981-10-9035-6
eBook Packages: EngineeringEngineering (R0)