Skip to main content

Hand Gesture Recognition System Based on LBP and SVM for Mobile Devices

  • Conference paper
  • First Online:
Computational Collective Intelligence (ICCCI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11683))

Included in the following conference series:

Abstract

With the advent of smart devices and the massive use of smartphones, hand gesture recognition by mobile devices is being a major difficulty due to their technical specificities. To find a balance between speed and accuracy, we propose a new approach to recognize hand gestures by a smart device. This topic has some current interest and future applicability. In this paper, we present a new gesture detection framework for mobile devices based on LBP and SVM. LBP provides good texture representation properties. First, the proposed LBP on each non-overlapping blocks of a hand pose image is computed and a histogram of these LBPs is obtained. Those histograms are used as feature vectors for gesture classification as they demonstrate their robustness against compression and uniform intensity variations. The classification has been done by using Support Vector Machine (SVM). Since SVM is commonly used for pattern recognition, it is good for the explicit classification of form-dependent data, such as hand gestures. A recognition rate of approximately 93% is obtained based the enhanced NUS database I. In addition, the impact of using such a hand pose estimation task in an embedded device is studied. We conduct experiments on the speed of detection on different mobile devices. The impact of using SVM as a classifier for a gesture recognition task in an embedded device like smartphone is studied.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Manjoo, F: A Murky Road Ahead for Android, Despite Market Dominance. The New York Times. ISSN 0362-4331. Retrieved May 27 2015

    Google Scholar 

  2. Statcounter company web site. http://gs.statcounter.com/press/android-overtakes-windows-for-first-time. 3 April 2017

  3. OpenCV. http://opencv.org/platforms/android.html

  4. Cobârzan, C., Hudelist, M.A., Schoeffmann, K., Primus, M.J.: Mobile image analysis: Android vs. iOS. In: 21st International Conference on MultiMedia Modelling (MMM), pp. 99–110 (2015)

    Chapter  Google Scholar 

  5. Seymour, M., Tšoeu, M.: A Mobile Application for South African Sign Language (SASL) recognition. In: IEEE Africon, pp 281–285 (2015)

    Google Scholar 

  6. Xie, C., Luan, S., Wang, H., Zhang, B.: Gesture recognition benchmark based on mobile phone. In: You, Z., Zhou, J., Wang, Y., Sun, Z., Shan, S., Zheng, W., Feng, J., Zhao, Q. (eds.) CCBR 2016. LNCS, vol. 9967, pp. 432–440. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46654-5_48

    Chapter  Google Scholar 

  7. Lahiani, H., Elleuch, M., Kherallah, M.: Real time hand gesture recognition system for android devices. In: 15th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 592–597 (2015)

    Google Scholar 

  8. Lahiani, H., Elleuch, M., Kherallah, M.: Real time static hand gesture recognition system for mobile devices. J. Inf. Ass. Secur. 11, 067–076 (2016). ISSN: 1554-1010

    Google Scholar 

  9. Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on Viola-Jones algorithm for android devices. In: 13th ACS/IEEE International Conference on Computer Systems and Applications, (AICCSA) (2016)

    Google Scholar 

  10. Lahiani, H., Kherallah, M., Neji, M.: Vision based hand gesture recognition for mobile devices: a review. In: Abraham, A., Haqiq, A., Alimi, Adel M., Mezzour, G., Rokbani, N., Muda, A.K. (eds.) HIS 2016. AISC, vol. 552, pp. 308–318. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-52941-7_31

    Chapter  Google Scholar 

  11. Lahiani, H., Neji, M.: Hand gesture recognition method based on HOG-LBP features for mobile devices. In: 22nd International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES), pp. 254–263 (2018)

    Google Scholar 

  12. Lahiani, H., Kherallah, M., Neji, M.: Hand gesture recognition system based on local binary pattern approach for mobile devices. In: 17th International Conference on Intelligent Systems Design and Applications (ISDA) 2017

    Google Scholar 

  13. Jin, C., Omar, Z., Jaward, M.H.: A mobile application of american sign language translation via image processing algorithms. In: 2016 IEEE Region 10 Symposium (TENSYMP), pp. 104–109 (2016)

    Google Scholar 

  14. Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on a cascade approach for mobile devices. In: Abraham, A., Muhuri, Pranab Kr., Muda, A.K., Gandhi, N. (eds.) ISDA 2017. AISC, vol. 736, pp. 619–629. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-76348-4_60

    Chapter  Google Scholar 

  15. Setiawardhana, R.Y. Hakkun, Baharuddin, A.: Sign language learning based on android for deaf and speech impaired people. In: 2015 International Electronics Symposium (IES) 2015, pp. 114–117 (2015)

    Google Scholar 

  16. Prasuhn, L., Oyamada, Y., Mochizuki, Y., Ishikawa, H.: A HOG-Based hand gesture recognition system on a mobile device. In: IEEE International Conference on Image Processing (ICIP), pp. 3973–3977 (2014)

    Google Scholar 

  17. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)

    MATH  Google Scholar 

  18. Burges, J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Disc. 2, 121–167 (1998)

    Article  Google Scholar 

  19. The NUS hand posture datasets I. https://www.ece.nus.edu.sg/stfpage/elepv/NUS-HandSet

  20. Jamdaade, K., Khairmode, A., Kamble, S.: A comparative study between Android & iOS. Int. J. Curr. Trends Eng. Res. (IJCTER) 2(6), 495–501 (2016). e-ISSN 2455–1392

    Google Scholar 

  21. TimingLogger| Android Developers. https://developer.android.com/reference/android/util/TimingLogger.html

  22. Logcat Command-line Tool. https://developer.android.com/studio/command-line/logcat.html

  23. Lahiani, H., Neji, M.: Comparative study between hand pose estimation systems for mobile devices. J. Inf. Ass. Secur. 12, 218–226 (2017). ISSN: 1554-1010

    Google Scholar 

  24. Howse, J., Puttemans, S., Hua, Q., Sinha, U.: Object detection performance testing in “OpenCV 3 Blueprints”

    Google Scholar 

  25. Chandrashekar N.S., Nataraj, K.R.: NMS and Thresholding Architecture used for FPGA based Canny Edge Detector for Area Optimization. In: Proceedings of International Conference on Control, Communication and Power Engineering, pp 80-84 (2013)

    Google Scholar 

  26. Qifan, Y., Hao, T., Xuebing, Z, Yin, L., Sanfeng, Z.: Dolphin: ultrasonic-based gesture recognition on smartphone platform. In: IEEE 17th International Conference on Computational Science and Engineering, pp. 1461–1468 (2014)

    Google Scholar 

  27. Libsvm ported to Android jni environment. https://github.com/cnbuff410/Libsvm-androidjni

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Houssem Lahiani .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lahiani, H., Neji, M. (2019). Hand Gesture Recognition System Based on LBP and SVM for Mobile Devices. In: Nguyen, N., Chbeir, R., Exposito, E., Aniorté, P., Trawiński, B. (eds) Computational Collective Intelligence. ICCCI 2019. Lecture Notes in Computer Science(), vol 11683. Springer, Cham. https://doi.org/10.1007/978-3-030-28377-3_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-28377-3_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-28376-6

  • Online ISBN: 978-3-030-28377-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics