A Touchless Visualization System for Medical Volumes Based on Kinect Gesture Recognition
The purpose of this study is to construct a system for surgical assistance by touchless interactions. In the clinical site, surgeons usually need to use some contacting devices to display or visualize medical images and check the anatomic information of the patient. However, after operating the visualization device, re-sterilization is necessary in order to maintain hygiene. Though some touchless surgery support systems using Kinect have been developed, their functions are not enough for surgical support. In this paper, we develop a new system, which can visualize 3D medical image by simple touchless single-handed interactions.
KeywordsComputer aided surgery (CAS) Medical image visualization Hand form recognition Touchless interaction Kinect
This work is supported in part by the Grant-in Aid for Scientific Research from the Japanese Ministry for Education, Science, Culture and Sports (MEXT) under the Grant no. 15K16031, no. 15H01130, no. 25280044 and no. 26289069 in part by the MEXT Support Program for the Strategic Research Foundation at Private Universities (2013–2017), and in part by the R-GIRO Research Fund from Ritsumeikan University.
- 1.Gallo, L. et al.: Controller-free exploration of medical image data: experiencing the Kinect. National Research Council of Italy Institute for High Performance Computing and Networking (2011)Google Scholar
- 2.Yoshimitsu, K., et al.: Development and initial clinical testing of “OPECT”: an innovative device for fully intangible control of the intraoperative image-displaying monitor by the surgeon. Neurosurgery 1, 46–50 (2014)Google Scholar
- 5.Foruzan A.H., et al.: Segmentation of liver in low contrast images using K-means clustering and geodesic active contour algorithm. IEICE Trans. Inf. Syst. E96-D, 798–807 (2013)Google Scholar
- 6.Tomoko, T., et al.: Patient-specific 3D visualization of the liver and vascular structures and interactive surgical planning system. Med. Imaging Technol. 31, 176–187 (2013). in JapaneseGoogle Scholar
- 7.Chen Y.W. et al.: Computer-aided liver surgical planning system using CT volumes. In: Proceedings of IEEE EMBC2013, Osaka, Japan, pp. 2360–2363 (2013)Google Scholar