Skip to main content

Hand Gesture Recognition System Based on Local Binary Pattern Approach for Mobile Devices

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 736))

Abstract

Since the appearance of mobile devices, gesture recognition is being a challenging task in the field of computer vision. In this paper, a simple and fast algorithm for static hand gesture recognition for mobile device is described. The hand pose is recognized by using gentle AdaBoost learning algorithm and Local Binary Pattern features. The system is developed on an Android OS platform. The method used consists of two steps: a real-time gesture captured by a smartphone’s camera and the recognition of the hand gestures. It presents a system based on a real-time hand posture recognition algorithm for mobile devices. The aim of this work is to allow the mobile device interpreting the sign made by the user without the need to touch the screen. In this system, the device is able to perform all necessary steps to recognize hand posture without the need to connect to any distant device.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Manjoo, F.: A Murky road ahead for android, despite market dominance. The New York Times (2015). ISSN 0362-4331. Accessed 27 May 2015

    Google Scholar 

  2. Statcounter company web site. http://gs.statcounter.com/press/android-overtakes-windows-for-first-time. Accessed 3 Apr 2017

  3. OpenCV. http://opencv.org/platforms/android.html

  4. Cobârzan, C., Hudelist, M.A., Schoeffmann, K., Primus, M.J.: Mobile image analysis: android vs. iOS. In: 21st International Conference on MultiMedia Modelling (MMM), pp. 99–110 (2015)

    Google Scholar 

  5. Seymour, M., Tšoeu, M.: A mobile application for South African sign language (SASL) recognition. In: IEEE AFRICON 2015, pp. 281–285 (2015)

    Google Scholar 

  6. Xie, C., Luan, S., Wang, H., Zhang, B.: Gesture recognition benchmark based on mobile phone. In: Chinese Conference on Biometric Recognition (CCBR). Lecture Notes in Computer Science, vol. 9967, pp. 432–440 (2016)

    Google Scholar 

  7. Lahiani, H., Elleuch, M., Kherallah, M.: Real time hand gesture recognition system for android devices. In: 15th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 592–597 (2015)

    Google Scholar 

  8. Lahiani, H., Elleuch, M., Kherallah, M.: Real time static hand gesture recognition system for mobile devices. J. Inf. Assur. Secur. 11, 67–76 (2016). ISSN 1554-1010

    Google Scholar 

  9. Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on Viola-Jones algorithm for android devices. In: 13th ACS/IEEE International Conference on Computer Systems and Applications (AICCSA) (2016)

    Google Scholar 

  10. Lahiani, H., Kherallah, M., Neji, M.: Vision based hand gesture recognition for mobile devices: a review. In: 16th International Conference on Hybrid Intelligent Systems (HIS 2016). Advances in Intelligent Systems and Computing, pp. 308–318 (2016)

    Google Scholar 

  11. Viola, P., Jones, M.: Rapid objet detection using a boosted cascade of simple features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 511–518 (2001)

    Google Scholar 

  12. Hays, P., Ptucha, R., Melton, R.: Mobile device to cloud co-processing of ASL finger spelling to text conversion. In: 2013 IEEE Western New York Image Processing Workshop (WNYIPW), pp. 39–43 (2013)

    Google Scholar 

  13. Jin, C., Omar, Z., Jaward, M.H.: A mobile application of American sign language translation via image processing algorithms. In: 2016 IEEE Region 10 Symposium (TENSYMP), pp. 104–109 (2016)

    Google Scholar 

  14. Kamat, R., Danoji, A., Dhage, A., Puranik, P., Sengupta, S.: Monvoix-an android application for hearing impaired people. J. Commun. Technol. Electron. Comput. Sci. 8, 24–28 (2016)

    Article  Google Scholar 

  15. Setiawardhana, Hakkun, R.Y., Baharuddin, A.: Sign language learning based on android for deaf and speech impaired people. In: 2015 International Electronics Symposium (IES), pp. 114–117 (2015)

    Google Scholar 

  16. Prasuhn, L., Oyamada, Y., Mochizuki, Y., Ishikawa, H.: A HOG-based hand gesture recognition system on a mobile device. In: IEEE International Conference on Image Processing (ICIP), pp. 3973–3977 (2014)

    Google Scholar 

  17. Harwood, D., Ojala, T., Pietikäinen, M., Kelman, S., Davis, S.: Texture classification by center-symmetric auto-correlation, using Kullback discrimination of distributions. Technical report, Computer Vision Laboratory, Center for Automation Research, University of Maryland, College Park, Maryland, CAR-TR-678 (1993)

    Google Scholar 

  18. Ojala, T., Pietikïnen, M., Harwood, D.: A comparative study of texture measures a with classification based on feature distributions. Pattern Recogn. 29, 51–59 (1996)

    Article  Google Scholar 

  19. Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: Proceedings of the 13th International Conference in Machine Learning, pp. 148–156 (1996)

    Google Scholar 

  20. Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: Proceedings of the IEEE Conference on Image Processing (ICIP 2002), New York, USA, pp. 155–162, September 2002

    Google Scholar 

  21. Ferreira, A., Figueiredo, M.: Boosting algorithms: a review of methods, theory, and applications. In: Ensemble Machine Learning: Methods and Applications. Springer, New York, pp. 35–85 (2012)

    Google Scholar 

  22. Frejlichowski, D., Gosciewska, K., Forczmanski, P., Nowosielski, A., Hofman, R.: Applying image features and AdaBoost classification for vehicle detection in the ‘SM4Public’ system. In: Image Processing and Communications Challenges 7. Advances in Intelligent Systems and Computing, vol. 389, pp. 81–88 (2015)

    Google Scholar 

  23. The NUS hand posture datasets I. https://www.ece.nus.edu.sg/stfpage/elepv/NUS-HandSet/

  24. Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on a cascade approach for mobile devices. In: 17th International Conference on Intelligent Systems Design and Applications (ISDA) (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Houssem Lahiani .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lahiani, H., Kherallah, M., Neji, M. (2018). Hand Gesture Recognition System Based on Local Binary Pattern Approach for Mobile Devices. In: Abraham, A., Muhuri, P., Muda, A., Gandhi, N. (eds) Intelligent Systems Design and Applications. ISDA 2017. Advances in Intelligent Systems and Computing, vol 736. Springer, Cham. https://doi.org/10.1007/978-3-319-76348-4_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-76348-4_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-76347-7

  • Online ISBN: 978-3-319-76348-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics