Hand Gesture Recognition System Based on Local Binary Pattern Approach for Mobile Devices

  • Houssem Lahiani
  • Monji Kherallah
  • Mahmoud Neji
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 736)


Since the appearance of mobile devices, gesture recognition is being a challenging task in the field of computer vision. In this paper, a simple and fast algorithm for static hand gesture recognition for mobile device is described. The hand pose is recognized by using gentle AdaBoost learning algorithm and Local Binary Pattern features. The system is developed on an Android OS platform. The method used consists of two steps: a real-time gesture captured by a smartphone’s camera and the recognition of the hand gestures. It presents a system based on a real-time hand posture recognition algorithm for mobile devices. The aim of this work is to allow the mobile device interpreting the sign made by the user without the need to touch the screen. In this system, the device is able to perform all necessary steps to recognize hand posture without the need to connect to any distant device.


Hand posture recognition Android LBP AdaBoost Human-machine interaction 


  1. 1.
    Manjoo, F.: A Murky road ahead for android, despite market dominance. The New York Times (2015). ISSN 0362-4331. Accessed 27 May 2015Google Scholar
  2. 2.
    Statcounter company web site. Accessed 3 Apr 2017
  3. 3.
  4. 4.
    Cobârzan, C., Hudelist, M.A., Schoeffmann, K., Primus, M.J.: Mobile image analysis: android vs. iOS. In: 21st International Conference on MultiMedia Modelling (MMM), pp. 99–110 (2015)Google Scholar
  5. 5.
    Seymour, M., Tšoeu, M.: A mobile application for South African sign language (SASL) recognition. In: IEEE AFRICON 2015, pp. 281–285 (2015)Google Scholar
  6. 6.
    Xie, C., Luan, S., Wang, H., Zhang, B.: Gesture recognition benchmark based on mobile phone. In: Chinese Conference on Biometric Recognition (CCBR). Lecture Notes in Computer Science, vol. 9967, pp. 432–440 (2016)Google Scholar
  7. 7.
    Lahiani, H., Elleuch, M., Kherallah, M.: Real time hand gesture recognition system for android devices. In: 15th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 592–597 (2015)Google Scholar
  8. 8.
    Lahiani, H., Elleuch, M., Kherallah, M.: Real time static hand gesture recognition system for mobile devices. J. Inf. Assur. Secur. 11, 67–76 (2016). ISSN 1554-1010Google Scholar
  9. 9.
    Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on Viola-Jones algorithm for android devices. In: 13th ACS/IEEE International Conference on Computer Systems and Applications (AICCSA) (2016)Google Scholar
  10. 10.
    Lahiani, H., Kherallah, M., Neji, M.: Vision based hand gesture recognition for mobile devices: a review. In: 16th International Conference on Hybrid Intelligent Systems (HIS 2016). Advances in Intelligent Systems and Computing, pp. 308–318 (2016)Google Scholar
  11. 11.
    Viola, P., Jones, M.: Rapid objet detection using a boosted cascade of simple features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 511–518 (2001)Google Scholar
  12. 12.
    Hays, P., Ptucha, R., Melton, R.: Mobile device to cloud co-processing of ASL finger spelling to text conversion. In: 2013 IEEE Western New York Image Processing Workshop (WNYIPW), pp. 39–43 (2013)Google Scholar
  13. 13.
    Jin, C., Omar, Z., Jaward, M.H.: A mobile application of American sign language translation via image processing algorithms. In: 2016 IEEE Region 10 Symposium (TENSYMP), pp. 104–109 (2016)Google Scholar
  14. 14.
    Kamat, R., Danoji, A., Dhage, A., Puranik, P., Sengupta, S.: Monvoix-an android application for hearing impaired people. J. Commun. Technol. Electron. Comput. Sci. 8, 24–28 (2016)CrossRefGoogle Scholar
  15. 15.
    Setiawardhana, Hakkun, R.Y., Baharuddin, A.: Sign language learning based on android for deaf and speech impaired people. In: 2015 International Electronics Symposium (IES), pp. 114–117 (2015)Google Scholar
  16. 16.
    Prasuhn, L., Oyamada, Y., Mochizuki, Y., Ishikawa, H.: A HOG-based hand gesture recognition system on a mobile device. In: IEEE International Conference on Image Processing (ICIP), pp. 3973–3977 (2014)Google Scholar
  17. 17.
    Harwood, D., Ojala, T., Pietikäinen, M., Kelman, S., Davis, S.: Texture classification by center-symmetric auto-correlation, using Kullback discrimination of distributions. Technical report, Computer Vision Laboratory, Center for Automation Research, University of Maryland, College Park, Maryland, CAR-TR-678 (1993)Google Scholar
  18. 18.
    Ojala, T., Pietikïnen, M., Harwood, D.: A comparative study of texture measures a with classification based on feature distributions. Pattern Recogn. 29, 51–59 (1996)CrossRefGoogle Scholar
  19. 19.
    Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: Proceedings of the 13th International Conference in Machine Learning, pp. 148–156 (1996)Google Scholar
  20. 20.
    Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: Proceedings of the IEEE Conference on Image Processing (ICIP 2002), New York, USA, pp. 155–162, September 2002Google Scholar
  21. 21.
    Ferreira, A., Figueiredo, M.: Boosting algorithms: a review of methods, theory, and applications. In: Ensemble Machine Learning: Methods and Applications. Springer, New York, pp. 35–85 (2012)Google Scholar
  22. 22.
    Frejlichowski, D., Gosciewska, K., Forczmanski, P., Nowosielski, A., Hofman, R.: Applying image features and AdaBoost classification for vehicle detection in the ‘SM4Public’ system. In: Image Processing and Communications Challenges 7. Advances in Intelligent Systems and Computing, vol. 389, pp. 81–88 (2015)Google Scholar
  23. 23.
  24. 24.
    Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on a cascade approach for mobile devices. In: 17th International Conference on Intelligent Systems Design and Applications (ISDA) (2017)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Houssem Lahiani
    • 1
    • 3
    • 4
  • Monji Kherallah
    • 2
  • Mahmoud Neji
    • 3
    • 4
  1. 1.National School of Electronics and TelecommunicationsUniversity of SfaxSfaxTunisia
  2. 2.Faculty of SciencesUniversity of SfaxSfaxTunisia
  3. 3.Faculty of Economics and ManagementUniversity of SfaxSfaxTunisia
  4. 4.Multimedia Information Systems and Advanced Computing LaboratorySfaxTunisia

Personalised recommendations