Handwritten Character Recognition in the Air by Using Leap Motion Controller

  • Kazuki Tsuchida
  • Hidetoshi MiyaoEmail author
  • Minoru Maruyama
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 528)


In order to develop a system which can precisely and quickly recognize handwritten characters in the air by using a Leap Motion Controller, we propose the following method: (1) A user has to register handwritten characters as template patterns before use. Each pattern is represented by a sequence of motion vectors calculated by using adjacent sampling data. (2) In the recognition phase, an input pattern is represented in the same method as above. The input pattern is compared with each of the registered template patterns by using DP matching and we can obtain a distance (degree of similarity) between them. Our system outputs the character class corresponding to the pattern with a minimum distance as a recognition result. In our experiments for recognition of 46 Japanese hiragana characters and 26 alphabets, a high average recognition rate of 86.7 % and a short average processing time of 196 ms were obtained.


Character recognition Leap motion DP matching 


  1. 1.
    Kratz, S., Aumi, T.: AirAuth: evaluating in-air hand gestures for authentication. In: MobileHCI 2014 (2014)Google Scholar
  2. 2.
    Bashir, M., Scharfenberg, G., Kempf, J.: Person authentication by handwriting in air using a biometric smart pen device. In: BIOSIG 2011, pp. 219–226 (2011)Google Scholar
  3. 3.
    Vikram, S., Li, L., Russell, S.: Handwriting and gestures in the air, recognizing on the fly. In: CHI 2013 Extended Abstracts (2013)Google Scholar
  4. 4.
    Leap Motion. Accessed 25 March 2015

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Kazuki Tsuchida
    • 1
  • Hidetoshi Miyao
    • 1
    Email author
  • Minoru Maruyama
    • 1
  1. 1.Computer Science and EngineeringShinshu UniversityNaganoJapan

Personalised recommendations