A Touchless Visualization System for Medical Volumes Based on Kinect Gesture Recognition

  • Ryoma FujiiEmail author
  • Tomoko Tateyama
  • Titinunt Kitrungrotsakul
  • Satoshi Tanaka
  • Yen-Wei Chen
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 60)


The purpose of this study is to construct a system for surgical assistance by touchless interactions. In the clinical site, surgeons usually need to use some contacting devices to display or visualize medical images and check the anatomic information of the patient. However, after operating the visualization device, re-sterilization is necessary in order to maintain hygiene. Though some touchless surgery support systems using Kinect have been developed, their functions are not enough for surgical support. In this paper, we develop a new system, which can visualize 3D medical image by simple touchless single-handed interactions.


Computer aided surgery (CAS) Medical image visualization Hand form recognition Touchless interaction Kinect 



This work is supported in part by the Grant-in Aid for Scientific Research from the Japanese Ministry for Education, Science, Culture and Sports (MEXT) under the Grant no. 15K16031, no. 15H01130, no. 25280044 and no. 26289069 in part by the MEXT Support Program for the Strategic Research Foundation at Private Universities (2013–2017), and in part by the R-GIRO Research Fund from Ritsumeikan University.


  1. 1.
    Gallo, L. et al.: Controller-free exploration of medical image data: experiencing the Kinect. National Research Council of Italy Institute for High Performance Computing and Networking (2011)Google Scholar
  2. 2.
    Yoshimitsu, K., et al.: Development and initial clinical testing of “OPECT”: an innovative device for fully intangible control of the intraoperative image-displaying monitor by the surgeon. Neurosurgery 1, 46–50 (2014)Google Scholar
  3. 3.
    Ruppert, G.C., et al.: Touchless gesture user interface for interactive image visualization in urological surgery. World J. Urol. 30, 687–691 (2012)CrossRefGoogle Scholar
  4. 4.
    Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. Comput. Graph. 21, 163–169 (1987)CrossRefGoogle Scholar
  5. 5.
    Foruzan A.H., et al.: Segmentation of liver in low contrast images using K-means clustering and geodesic active contour algorithm. IEICE Trans. Inf. Syst. E96-D, 798–807 (2013)Google Scholar
  6. 6.
    Tomoko, T., et al.: Patient-specific 3D visualization of the liver and vascular structures and interactive surgical planning system. Med. Imaging Technol. 31, 176–187 (2013). in JapaneseGoogle Scholar
  7. 7.
    Chen Y.W. et al.: Computer-aided liver surgical planning system using CT volumes. In: Proceedings of IEEE EMBC2013, Osaka, Japan, pp. 2360–2363 (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Ryoma Fujii
    • 1
    Email author
  • Tomoko Tateyama
    • 1
  • Titinunt Kitrungrotsakul
    • 1
  • Satoshi Tanaka
    • 1
  • Yen-Wei Chen
    • 1
    • 2
  1. 1.Graduate School of Information Science and EngineeringRitsumeikan UniversityShigaJapan
  2. 2.College of Computer Science and TechnologyZhejiang UniversityHangzhouChina

Personalised recommendations