Advertisement

Multimedia Tools and Applications

, Volume 72, Issue 3, pp 2949–2975 | Cite as

Neural solutions to interact with computers by hand gesture recognition

  • Tahani BouchrikaEmail author
  • Mourad Zaied
  • Olfa Jemai
  • Chokri Ben Amar
Article

Abstract

This paper attempts to present a vision-based interface which interacts with computers by hand gesture recognition. This work aims at creating a natural and intuitive application employing both static and dynamic hand gestures. The proposed application can be summarized in three main steps: hands detection in a video, hands tracking and converting hand shapes or trajectories into computer commands. To accomplish this application, a classification phase is paramount whether at the part of hand detection, or at the phase of “commanding computers”. For this reason, we have proposed to use a wavelet network classifier (WNC) learnt by fast wavelet transform (FWT). To emphasize the robustness of this classifier, we have used a neural network classifier (NNC) version in order to compare the two classifiers’ performances aiming at proving the strength of our proposed one. Global rates given by experimental results show the effectiveness of our proposed approaches of hand detection, hand tracking and hand gesture recognition. The comparison of the two classifier’s result helps to choose the best classifier, which can improve the performances of our application.

Keywords

Computer vision Hand detection Hand tracking Hand gestures recognition Wavelet network classifier Neural network classifier 

Notes

Acknowledgements

The authors would like to acknowledge the financial support of this work by grants from General Direction of Scientific Research (DGRST), Tunisia, under the ARUB program.

References

  1. 1.
    Antonini M, Barlaud M (1992) Image coding using wavelet transform. IEEE Trans Image Process 1:205–220CrossRefGoogle Scholar
  2. 2.
    Bencheriet Ch, Boualleg A/H, Tebbikh H, Guerzize B, Belguidoum W (2007) Détection de Visages par Méthode Hybride Couleur de Peau et Template Matching. In: SETIT 2007 4th International Conference: Sciences of Electronic, Technologies of Information and Telecommunications, TUNISIAGoogle Scholar
  3. 3.
    Ben Gharat I, Bouchrika T, Zaied M, Ben Amar C (2013) Hands Gestures recognition for virtual objects commanding in augmented reality applications. In: The 5th international conference on web and information technologie (ICWIT’13), Hammamet-Tunisia, 9–12 May 2013Google Scholar
  4. 4.
    Bouchrika T, Zaied M, Jemai O, Ben Amar C (2012) Ordering computers by hand gestures recognition based on wavelet networks. In: 2012 international conference on communications, computing and control applications. (CCCA’2012) proceedings, session1: robotics, Marseilles, France, 06–08 Dec 2012, pp 36–41Google Scholar
  5. 5.
    Burrus CS, Gopinath RA, Guo H (1998) Introduction to wavelets and wavelet transforms. A primer. Prentice Hall, Upper Saddle River, NJ, USAGoogle Scholar
  6. 6.
    Chen F-S, Fu C-M, Huang C-L (2003) Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis Comput 21:745–758CrossRefGoogle Scholar
  7. 7.
    Cover TM (1968) Estimation by the nearest neighbor rule. IEEE Trans Inf Theory 14(1):50–55CrossRefzbMATHGoogle Scholar
  8. 8.
    Daubechies I (1992) Ten lectures on wavelets. In: CBMS-NSF Regional Conf. Series in Appl. Math. 61. Society for Industrial and Mathematics. Philadelphia, PA, ISBN: 0-89871- 274-2Google Scholar
  9. 9.
    Ejbali R, Zaied M, Ben Amar C (2010) Wavelet network for recognition system of Arabic word. Int J Speech Technol 13(3):163–174CrossRefGoogle Scholar
  10. 10.
    El Adel A, Zaied M, Ben Amar C (2011) Learning wavelet networks based on multiresolution analysis: application to images copy detection. In: 2011 International Conference on Communications, Computing and Control Applications (CCCA’2011). Hammamet-TunisiaGoogle Scholar
  11. 11.
    Erol A, Bebis G, Nicolescu M, Boyle RD, Twombly X (2007) Vision-based hand pose estimation: a review. Comput Vis Image Underst 108:52–73CrossRefGoogle Scholar
  12. 12.
    Feng Z, Yang B, Chen Y, Zheng Y, Xu T, Li Y, Xu T, Zhu D (2011) Features extraction from hand images based on new detection operators. Pattern Recogn 44:1089–1105CrossRefzbMATHGoogle Scholar
  13. 13.
    Guedri B, Zaied M, Ben Amar C (2011) Indexing and images retrieval by content. In: IEEE 2011 International Conference on High Performance Computing & Simulation (HPCS’2011). Istanbul Turkey, pp 369–375Google Scholar
  14. 14.
    Han J, Awad G, Sutherland A (2009) Modelling and segmenting subunits for sign language recognition based on hand motion analysis. Pattern Recogn Lett 30:623–633CrossRefGoogle Scholar
  15. 15.
    Holzinger A, Softic S, Stickel C, Ebner M, Debevc, M, Hu B (2010) Nintendo Wii remote controller in higher education: development and evaluation of a demonstrator kit for e-teaching. Computing and Informatics 29:601–615Google Scholar
  16. 16.
    Jemai O (2010) Apprentissage automatique des réseaux d’ondelettes: Application à la classification d’images. In: Dept. of computer sciences and MultiMedia, National Engineering School of SfaxGoogle Scholar
  17. 17.
    Jemai O, Zaied M, Ben Amar C, Alimi AM (2010) FBWN: an architecture of fast beta wavelet networks for image classification. In: 2010 IEEE World Congress on Computational Intelligence (IEEE WCCI 2010), The 2010 International Joint Conference on Neural Networks (IJCNN 2010). CCIB, Barcelona, Spain, pp 1953–1960Google Scholar
  18. 18.
    Jemai O, Zaied M, Ben Amar C, Alimi AM (2011) Fast learning algorithm of wavelet network based on fast wavelet transform. Int J Pattern Recogn Artif Intell 25(8):1297–1319CrossRefMathSciNetGoogle Scholar
  19. 19.
    Jemai O, Zaied M, Ben Amar C, El Alimi MA (2011) Pyramidal hybrid approach: wavelet network with OLS algorithm-based image classification. Int J Wavelets Multiresolut Inf Process 9(1):1–20CrossRefMathSciNetGoogle Scholar
  20. 20.
    Kao C-Y, Fahn C-S (2011) A human-machine interaction technique: hand gesture recognition based on hidden Markov models with trajectory of hand motion. Procedia Engineering 15:3739–3743CrossRefGoogle Scholar
  21. 21.
    Kelly D, McDonald J, Markham C (2010) A person independent system for recognition of hand postures used in sign language. Pattern Recogn Lett 31:1359–1368CrossRefGoogle Scholar
  22. 22.
    Li H, Greenspan M (2011) Model-based segmentation and recognition of dynamic gestures in continuous video streams. Pattern Recogn 44:1614–1628CrossRefGoogle Scholar
  23. 23.
    Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):277–290CrossRefGoogle Scholar
  24. 24.
    Oz C, Leu MC (2011) American Sign Language word recognition with a sensory glove using artificial neural networks. Eng Appl Artif Intell 24:1204–1213CrossRefGoogle Scholar
  25. 25.
    Stephan JJ, Khudayer S (2010) Gesture recognition for Human-Computer Interaction (HCI). Int J Adv Comp Techn 2(4):30–35Google Scholar
  26. 26.
    Stergiopoulou E, Papamarkos N (2009) Hand gesture recognition using a neural network shape fitting technique. Eng Appl Artif Intell 22:1141–1158CrossRefGoogle Scholar
  27. 27.
    Teyeb I, Jemai O, Bouchrika T, Ben Amar C (2013) Detecting driver drowsiness using eyes recognition system based on wavelet network. In: Proc. of the 5th international conference on web and information technologies (ICWIT 2013), Hammamet, Tunisia, 9–12 May 2013, pp. 245–254Google Scholar
  28. 28.
    Venkatesh YV (2003) On the classification of multispectral satellite images using the multilayer perceptron. Pattern Recogn 36(9):2161–2175CrossRefzbMATHGoogle Scholar
  29. 29.
    Wah Ng C, Ranganath S (2002) Real-time gesture recognition system and application. Image Vis Comput 20:993–1007CrossRefGoogle Scholar
  30. 30.
    Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surv 38(4):45, Article 13CrossRefGoogle Scholar
  31. 31.
    Zaied M, Jemai O, Ben Amar C (2008a) Image processing theory. In: Tools and Applications, IPTA 2008, pp 1–6Google Scholar
  32. 32.
    Zaied M, Jemai O, Ben Amar C (2008b) Training of the Beta wavelet networks by the frames theory: application to face recognition. In: IPTA’08, The International Workshops on Image Processing Theory, Tools and Applications. Tunisia, pp 165–170Google Scholar
  33. 33.
    Zaied M, Said S, Jemai O, Ben Amar C (2011) A novel approach for face recognition based on fast learning algorithm and wavelet network theory. Int J Wavelets Multiresolut Inf Process 9(6):923–945CrossRefzbMATHMathSciNetGoogle Scholar
  34. 34.
    Zhang Q, Benveniste A (1992) Wavelet networks. IEEE Trans Neural Netw 3:889–898Google Scholar
  35. 35.
    Zhao Z-Y, Gao W-L, Zhu M-M, Yu L (2012) A vision based method to distinguish and recognize static and dynamic gesture. Procedia Engineering 29:3065–3069CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Tahani Bouchrika
    • 1
    Email author
  • Mourad Zaied
    • 1
  • Olfa Jemai
    • 1
  • Chokri Ben Amar
    • 1
  1. 1.REGIM: Research Groups on Intelligent MachinesUniversity of Sfax, National Engineering School of Sfax (ENIS)SfaxTunisia

Personalised recommendations