Skip to main content

Hand Gesture Recognition with Leap Motion

  • Conference paper
  • First Online:
Proceedings of the Future Technologies Conference (FTC) 2018 (FTC 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 880))

Included in the following conference series:

Abstract

Hand gesture is a natural way for people to communicate, it plays an important role in Human-Computer Interaction (HCI). Nowadays, many developers build HCI applications on the top of hand gesture recognition, but how to get more accurate when recognizing hand gestures still have a long way to go. The recent introduction of depth cameras like Leap Motion Controller (LMC) allows researchers to exploit the depth information to recognize hand gesture more robustly. This paper proposes a novel hand gesture recognition system with LMC for hand gesture recognition. Histogram of Oriented Gradient (HOG) feature is extracted from Leap Motion binarized and undistorted sensor images. We feed these features into a multi-class Support Vector Machine (SVM) classifier to recognize performed gesture. The results show that our model is much more accurate than previous work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rautaray, S.S., Agrawal, A.: Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intell. Rev. 43(1), 1–54 (2015)

    Article  Google Scholar 

  2. Ohn-Bar, E., Trivedi, M.M.: Hand gesture recognition in real time for automotive interfaces: a multimodal vision-based approach and evaluations. IEEE Trans. Intell. Transp. Syst. 15(6), 2368–2377 (2014)

    Article  Google Scholar 

  3. Wan, C., Yao, A., Van Gool, L.: Hand pose estimation from local surface normals. In: European Conference on Computer Vision, pp. 554–569. Springer (2016)

    Google Scholar 

  4. Chaudhary, A., Raheja, J.L., Das, K., Raheja, S.: Intelligent approaches to interact with machines using hand gesture recognition in natural way: a survey. arXiv preprint arXiv:1303.2292 (2013)

  5. Freeman, W.T., Tanaka, K.-i., Ohta, J., Kyuma, K.: Computer vision for computer games. In: Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, pp. 100–105. IEEE (1996)

    Google Scholar 

  6. Ren, Z., Yuan, J., Meng, J., Zhang, Z.: Robust part-based hand gesture recognition using kinect sensor. IEEE Trans. Multimed. 15(5), 1110–1120 (2013)

    Article  Google Scholar 

  7. Suarez, J., Murphy, R.R.: Hand gesture recognition with depth images: a review. In: RO-MAN, 2012 IEEE, pp. 411–417. IEEE (2012)

    Google Scholar 

  8. Suryanarayan, P., Subramanian, A., Mandalapu, D.: Dynamic hand pose recognition using depth data. In: 2010 20th International Conference on Pattern Recognition (ICPR), pp. 3105–3108. IEEE (2010)

    Google Scholar 

  9. Dominio, F., Donadeo, M., Zanuttigh, P.: Combining multiple depth-based descriptors for hand gesture recognition. Pattern Recognit. Lett. 50, 101–111 (2014)

    Article  Google Scholar 

  10. Yao, Y., Yun, F.: Contour model-based hand-gesture recognition using the kinect sensor. IEEE Trans. Circuits Syst. Video Technol. 24(11), 1935–1944 (2014)

    Article  Google Scholar 

  11. Chen, Z.-h., Kim, J.-T., Liang, J., Zhang, J., Yuan, Y.-B.: Real-time hand gesture recognition using finger segmentation. Sci. World J. 2014 (2014)

    Google Scholar 

  12. Feng, K.-p., Yuan, F.: Static hand gesture recognition based on hog characters and support vector machines. In: 2013 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation (IMSNA), pp. 936–938. IEEE (2013)

    Google Scholar 

  13. Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13(5), 6380–6393 (2013)

    Article  Google Scholar 

  14. Ameur, S., Khalifa, A.B., Bouhlel, M.S.: A comprehensive leap motion database for hand gesture recognition. In: 2017 International Conference on Information and Digital Technologies (IDT), pp. 514–519. IEEE (2017)

    Google Scholar 

  15. Wei, L., Tong, Z., Chu, J.: Dynamic hand gesture recognition with leap motion controller. IEEE Signal Process. Lett. 23(9), 1188–1192 (2016)

    Article  Google Scholar 

  16. Marin, G., Dominio, F., Zanuttigh, P.: Hand gesture recognition with leap motion and kinect devices. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 1565–1569. IEEE (2014)

    Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61627808, 91648205, 61602082, and 61672130. This work was also supported in part by the development of science and technology of guangdong province special fund project Grants 2016B090910001 and Open Program of State Key Laboratory of Software Architecture (Item number SKLSAOP1701).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shenglan Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Feng, L., Du, Y., Liu, S., Xu, L., Wu, J., Qiao, H. (2019). Hand Gesture Recognition with Leap Motion. In: Arai, K., Bhatia, R., Kapoor, S. (eds) Proceedings of the Future Technologies Conference (FTC) 2018. FTC 2018. Advances in Intelligent Systems and Computing, vol 880. Springer, Cham. https://doi.org/10.1007/978-3-030-02686-8_4

Download citation

Publish with us

Policies and ethics