Validation of Knot-Tying Motion by Temporal-Spatial Matching with RGB-D Sensor for Surgical Training

  • Yoko Ogawa
  • Nobutaka Shimada
  • Yoshiaki Shirai
  • Yoshimasa Kurumi
  • Masaru Komori
Conference paper

DOI: 10.1007/978-3-319-23024-5_53

Volume 45 of the book series Smart Innovation, Systems and Technologies (SIST)
Cite this paper as:
Ogawa Y., Shimada N., Shirai Y., Kurumi Y., Komori M. (2016) Validation of Knot-Tying Motion by Temporal-Spatial Matching with RGB-D Sensor for Surgical Training. In: Chen YW., Torro C., Tanaka S., Howlett R., C. Jain L. (eds) Innovation in Medicine and Healthcare 2015. Smart Innovation, Systems and Technologies, vol 45. Springer, Cham

Abstract

We propose a method for validating surgical knot-tying motions for self-training of surgical trainee. Our method observes their hands by a RGB-D sensor and describes the point cloud as a SHOT feature. We use the features for matching an input point cloud sequence to that of an expert by dynamic programming. On the basis of the matched frames, the method validates relative positions of both hands and each hand shape in each input frame. Then the system detects and shows inappropriate parts in each frame. This paper shows the results of our method on a knot-tying motion dataset of a novice and an expert surgeon.

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Yoko Ogawa
    • 1
  • Nobutaka Shimada
    • 1
  • Yoshiaki Shirai
    • 1
  • Yoshimasa Kurumi
    • 2
  • Masaru Komori
    • 2
  1. 1.Ritsumeikan UniversityKusatsuJapan
  2. 2.Shiga University of Medical ScienceOtsuJapan