Advertisement

Multimedia Tools and Applications

, Volume 77, Issue 5, pp 5995–6016 | Cite as

Rapid and efficient hand gestures recognizer based on classes discriminator wavelet networks

  • Tahani BouchrikaEmail author
  • Olfa Jemai
  • Mourad Zaied
  • Chokri Ben Amar
Article
  • 142 Downloads

Abstract

The vision based on hand gesture recognition is one of the key challenges in behavior understanding and computer vision. It offers to machines the possibility of identifying, recognizing and interpreting hand gestures in the aim of controlling certain devices, to monitor certain human activities or interacting with certain human machine interfaces (HMI). This paper aims at proposing a rapid and efficient hand gestures recognizer based on classes discriminator wavelet networks. In this work two main contributions were proposed: firstly, by enhancing previous works using wavelet networks (WN) in the classification field, specifically at the learning process of the latest version of WN classifier (WNC) by creating separator WNs discriminating classes (n − 1 WNs to classify n classes) as alternative of constructing a WN corresponding to each training image. This contribution, by minimizing the comparison number between test images WNs and training ones, makes quicker the test phase. Secondly, a new WN architecture based on the cascade notion was proposed, in which the WN is decomposed of a set of stages. The novel architecture aims not only at making recognitions robust and quick but also at rejecting from early stages, as fast as possible, gestures that must not be taken into consideration by the system (spontaneous gestures). To test this work, both proprietary and public hand posture datasets were used. Comparisons with other works are detailed and discussed. Given results showed that the novel hand gesture recognizer performances are comparable to already established ones.

Keywords

Hand gesture recognition Separator wavelet networks Cascaded wavelet networks 

Notes

Acknowledgments

The authors would like to acknowledge the financial support of this work by grants from General Direction of Scientific Research (DGRST), Tunisia, under the ARUB program.

References

  1. 1.
    Ben Amar C, Zaied M, Alimi MA (2005) Beta wavelets. Synthesis and application to lossy image compression. J Adv Eng Soft Elsevier Edition 36, N7:459–474CrossRefzbMATHGoogle Scholar
  2. 2.
    Bouchrika T, Zaied M, Jemai O, Ben Amar C (2012) Ordering computers by hand gesture recognition based on wavelet networks, Int. Conf. on Communications, Computing and Control Applications proceedings, Marseilles, France. doi: 10.1109/CCCA.2012.6417911, pp. 1–6
  3. 3.
    Bouchrika T, Zaied M, Jemai O, Ben Amar C (2013) Neural solutions to interact with computers by hand gesture recognition. MTAP: Multimedia Tools and Applications  10.1007/s11042-013-1557-y
  4. 4.
    Bouchrika T, Jemai O, Zaied M, Ben Amar C (2014) Cascaded hybrid wavelet network for hand gesture recognition. In: IEEE international conference on systems, man, and cybernetics (SMC 2014) proceedings, San Diego, pp 1360–1365,  10.1109/SMC.2014.6974104
  5. 5.
    Bouchrika T, Jemai O, Zaied M, Ben Amar C (2014) A new hand posture recognizer based on hybrid wavelet network including a fuzzy decision support system. In: The 15th international conference on intelligent data engineering and automated learning (IDEAL 2014) proceedings, Lecture Notes in Computer Science, vol. 8669. Salamanca, pp. 183–190Google Scholar
  6. 6.
    Bouchrika T, Jemai O, Zaied M, Ben Amar C (2015) CSWN: a cascaded architecture of separator wavelet networks for image classification. In: Proceedings of the 27th international conference on tools with artificial intelligence (ICTAI 2015). Vietri sul Mare, Italy,  10.1109/ICTAI.2015.48, pp 258–264
  7. 7.
    Bouchrika T, Jemai O, Zaied M, Ben Amar C (2015) Hand posture recognizer based on separator wavelet networks. In: Proceedings of SPIE9875, Eighth International Conference on Machine Vision (ICMV 2015) Barcelone, Spain, November 19-21, 2015, 98750F (December 8, 2015);  10.1117/12.2228425
  8. 8.
    Cemil O, Leu Ming C (2011) American Sign Language word recognition with a sensory glove using artificial neural networks. Eng Appl Artif Intell 24:12041213Google Scholar
  9. 9.
    Chang-Yi K, Chin-Shyurng F (2011) A human-machine interaction technique: Hand gesture recognition based on hidden markov models with trajectory of hand motion. Control Eng Inf Sci 15 :3739–3743Google Scholar
  10. 10.
    Delp D, Scott D (1989) Understanding human movement with computer graphics. SOMA Engineering for the Human Body 3(3):17–25Google Scholar
  11. 11.
    Fels S, Glove T (1994) Mapping hand gestures to speech using neural networks an approach to building adaptive interfaces. Ph.D. dissertation, University of TorontoGoogle Scholar
  12. 12.
    Freeman T, Craig D (1994) Television control by hand gestures, technical report, mitsubishi electronic research laboratories TR-94-24Google Scholar
  13. 13.
    Han J, Awad G, Sutherland A (2009) Modelling and segmenting subunits for sign language recognition based on hand motion analysis. Pattern Recogn Lett 30:623–633CrossRefGoogle Scholar
  14. 14.
    Jemai O, Zaied M, Ben Amar C, Adel Alimi M (2010) FBWN: An architecture of Fast Beta Wavelet Networks for Image Classification, 2010 IEEE World Congress on Computational Intelligence (IEEE WCCI 2010), the 2010 International Joint Conference on Neural Networks (IJCNN 2010), CCIB, Barcelona, pp 1953–1960Google Scholar
  15. 15.
    Jemai O, Zaied M, Ben Amar C, Alimi A (2011) Fast learning algorithm of wavelet network based on Fast Wavelet Transform. Int J Pattern Recognit Artif Intell 25(8):1297–1319MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Kumar P, Vadakkepat P, Poh L (2010) Hand posture and face recognition using a fuzzy-rough approach. Int J Humanoid Robot 7(3):331–356CrossRefGoogle Scholar
  17. 17.
    Lee C, Yangsheng X (1996) Online interactive learning of gestures for Human/Robot interfaces. In: 1996 IEEE international conference on robotics and automation, vol. 4, pp. 2982–2987Google Scholar
  18. 18.
    Lv Z, Halawani A, Feng S, Li H, Rhman SU (2014) Multimodal hand and foot gesture interaction for handheld devices. ACM Trans Multimed Comput Commun Appl (TOMM) 11 (1s):10Google Scholar
  19. 19.
    Lv Z, Halawani A, Feng S, Rhman SU, Li H (2015) Touch-less interactive augmented reality game on vision-based wearable device. Pers Ubiquit Comput 19 (3–4):551–567CrossRefGoogle Scholar
  20. 20.
    Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324CrossRefGoogle Scholar
  21. 21.
    Sheng C, Chih-Ming F, Chung-Lin H (2003) Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis Comput 21:745–758CrossRefGoogle Scholar
  22. 22.
    Stephan J, Khudayer S (2010) Gesture recognition for Human-Computer interaction (HCI). International Journal of Advancements in Computing Technology 02 (4):30–35CrossRefGoogle Scholar
  23. 23.
    Stergiopoulou E, Papamarkos N (2009) Hand gesture recognition using a neural network shape fitting technique. Eng Appl Artif Intell 22:1141–1158CrossRefGoogle Scholar
  24. 24.
    Sushmita M, Tinku A (2007) Gesture recognition: a survey. EEE Trans Syst Man Cybern Part C Appl Rev 37(3)Google Scholar
  25. 25.
    Triesch J, Malsburg C, Marcel S Hand posture and gesture datasets: Jochen Triesch static hand posture database, Available at http://www.idiap.ch/resources/gestures/
  26. 26.
    Viola P, Jones J (2004) Michael robust real-time face detection. Int J Comput Vis 57(2):137–154CrossRefGoogle Scholar
  27. 27.
    Zaied M, Jemai O, Ben Amar C (2008) Training of the Beta wavelet networks by the frames theory: application to face recognition, the International Workshops on Image Processing Theory, Tools and Application. Tunisia, pp 165–170Google Scholar
  28. 28.
    Zhou M, Wei H, Maybank S (2006) Gabor wavelets and AdaBoost in feature selection for face verification, applications of computer vision 2006 workshop in conjuction with ECCV 2006, Graz, pp 101–109Google Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  • Tahani Bouchrika
    • 1
    Email author
  • Olfa Jemai
    • 2
  • Mourad Zaied
    • 2
  • Chokri Ben Amar
    • 3
  1. 1.Faculty of Science of GabesUniversity of GabesGabesTunisia
  2. 2.National Engineering School of Gabes (ENIG)University of GabesGabesTunisia
  3. 3.National Engineering School of Sfax (ENIS)University of SfaxGabesTunisia

Personalised recommendations