Enhance Robotics ability in Hand Gesture Recognition by Using Leap Motion Controller

  • Alaa Ahmed AlmarzuqiEmail author
  • Seyed Mohamed Buhari
Conference paper
Part of the Lecture Notes on Data Engineering and Communications Technologies book series (LNDECT, volume 2)


Usage of intelligence in the interactions between human and robot is one of the significant topics in research. As an added assistance to human, robots are used to facilitate and assist human in many ways. Robots could be made to understand and recognize human gestures. Therefore, robots should be programmed to deal with certain gestures, that, the robots can identify and act accordingly. Our research aims to enhance the robot gesture recognition ability by using supported hand gesture detection device known as Leap Motion Controller (LMC). This research aims to expose the accuracy of hand gesture recognition using Leap Motion depth sensor to enhance intelligent system where human hand gestures are used to interact with robot in learning or gaming system.


Sign Language Humanoid Robot Gesture Recognition Hand Gesture Kinect Sensor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gonzalez-Sanchez, T. and D. Puig, Real-time body gesture recognition using depth camera. Electronics Letters, 2011. 47(12): p. 697.Google Scholar
  2. 2.
    Zhou, R., et al., Robust Part-Based Hand Gesture Recognition Using Kinect Sensor. Multimedia, IEEE Transactions on, 2013. 15(5): p. 1110-1120.Google Scholar
  3. 3.
    .Rouanet, P., et al., The Impact of Human–Robot Interfaces on the Learning of Visual Objects. Robotics, IEEE Transactions on, 2013. 29(2): p. 525-541.Google Scholar
  4. 4.
    Mitra, S. and T. Acharya, Gesture recognition: A survey. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 2007. 37(3): p. 311-324.Google Scholar
  5. 5.
    Ibraheem, N.A. and R. Khan, Survey on various gesture recognition technologies and techniques. International Journal, 2011. 50.Google Scholar
  6. 6.
    Church, R.B., S. Ayman-Nolley, and S. Mahootian, The role of gesture in bilingual education: Does gesture enhance learning? International Journal of Bilingual Education and Bilingualism, 2004. 7(4): p. 303-319.Google Scholar
  7. 7.
    Yorita, A., et al., Remote education based on robot edutainment, in Progress in Robotics. 2009, Springer. p. 204-213.Google Scholar
  8. 8.
    Kose, H. and R. Yorganci. Tale of a robot: humanoid robot assisted sign language tutoring. in Humanoid Robots (Humanoids), 2011 11th IEEE-RAS International Conference on. 2011. IEEE.Google Scholar
  9. 9.
    Lund, H.H., P. Marti, and V. Palma. Educational robotics: manipulative technologies for cognitive rehabilitation. in Ninth international symposium On Artificial life and robotics (AROB 9th’04), Oita, JAPAN. 2004.Google Scholar
  10. 10.
    F. Weichert, D. Bachmann, B. Rudak, and D. Fisseler, “Analysis of the Accuracy and Robustness of the Leap Motion Controller,” Sensors, vol. 13, no. 5, pp. 6380–6393, May 2013.Google Scholar
  11. 11.
    J. Guna, G. Jakus, M. Pogačnik, S. Tomažič, and J. Sodnik, “An Analysis of the Precision and Reliability of the Leap Motion Sensor and Its Suitability for Static and Dynamic Tracking,” Sensors, vol. 14, no. 2, pp. 3702–3720, Feb. 2014.Google Scholar
  12. 12.
    I.-A. Zaiţi, Ş.-G. Pentiuc, and R.-D. Vatavu, “On free-hand TV control: experimental results on user-elicited gestures with Leap Motion,” Pers. Ubiquitous Comput., vol. 19, no. 5–6, pp. 821–838, Jun. 2015.Google Scholar
  13. 13.
    J. J. Kim, D. A. Gonzalez, A. Mintz, E. A. Roy, and J. Y. Tung, “Motor Control Assessment using Leap Motion: Filtering Methods and Performance in Indoor and Outdoor Environments,” in World Congress on Medical Physics and Biomedical Engineering, June 7-12, 2015, Toronto, Canada, D. A. Jaffray, Ed. Springer International Publishing, 2015, pp. 1150–1154.Google Scholar
  14. 14.
    S. Chen, H. Ma, C. Yang, and M. Fu, “Hand Gesture Based Robot Control System Using Leap Motion,” in Intelligent Robotics and Applications, H. Liu, N. Kubota, X. Zhu, R. Dillmann, and D. Zhou, Eds. Springer International Publishing, 2015, pp. 581–591.Google Scholar
  15. 15.
    T. V. S. N. Venna and S. Patel, “Real-Time Robot Control Using Leap Motion A Concept of Human-Robot Interaction,” Apr. 2015.Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.King Abdulaziz UniversityJeddahSaudi Arabia

Personalised recommendations