Advertisement

Neural Computing and Applications

, Volume 25, Issue 2, pp 251–261 | Cite as

RETRACTED ARTICLE: Human–computer interaction using vision-based hand gesture recognition systems: a survey

  • Haitham Hasan
  • Sameem Abdul-Kareem
Review

Abstract

Considerable effort has been put toward the development of intelligent and natural interfaces between users and computer systems. In line with this endeavor, several modes of information (e.g., visual, audio, and pen) that are used either individually or in combination have been proposed. The use of gestures to convey information is an important part of human communication. Hand gesture recognition is widely used in many applications, such as in computer games, machinery control (e.g., crane), and thorough mouse replacement. Computer recognition of hand gestures may provide a natural computer interface that allows people to point at or to rotate a computer-aided design model by rotating their hands. Hand gestures can be classified into two categories: static and dynamic. The use of hand gestures as a natural interface serves as a motivating force for research on gesture taxonomy, its representations, and recognition techniques. This paper summarizes the surveys carried out in human--computer interaction (HCI) studies and focuses on different application domains that use hand gestures for efficient interaction. This exploratory survey aims to provide a progress report on static and dynamic hand gesture recognition (i.e., gesture taxonomies, representations, and recognition techniques) in HCI and to identify future directions on this topic.

Keywords

Human–computer interaction Gesture recognition Representations Recognition Natural interfaces 

References

  1. 1.
    Just A (2006) Two-handed gestures for human–computer interaction. Research report IDIAP 06-73, EPFLGoogle Scholar
  2. 2.
    Hasan H, Abdul Kareem S (2012) Fingerprint image enhancement and recognition algorithms: a survey. Neural Comput Appl. doi: 10.1007/s00521-012-1113-0
  3. 3.
    Hasan H, Abdul Kareem S (2012) Static hand gesture recognition using neural networks. Artif Intell Rev. doi: 10.1007/s10462-011-9303-1
  4. 4.
    Karam M (2006) A framework for research and design of gesture-based human–computer interactions. PhD Thesis, University of SouthamptonGoogle Scholar
  5. 5.
    Ionescu B, Coquin D, Lambert P, Buzuloiu V (2005) Dynamic hand gesture recognition using the skeleton of the hand. EURASIP J Appl Signal Process 2101–2109Google Scholar
  6. 6.
    Moeslund T, Granum E (2001) A survey of computer vision based human motion capture. Comput Vis Image Underst 81:231–268CrossRefzbMATHGoogle Scholar
  7. 7.
    Derpanis KG (2004) A review of vision- based hand gestures. http://cvr.yorku.ca/members/gradstudents/kosta/publications/fileGesturereview.pdf
  8. 8.
    Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern, Part C Appl Rev 37(3):311–324CrossRefGoogle Scholar
  9. 9.
    Chaudhary A, Raheja JL, Das K, Raheja S (2011) Intelligent approaches to interact with machines using hand gesture recognition in natural way: a survey. Int J Comput Sci Eng Survey (IJCSES) 2(1):122–133CrossRefGoogle Scholar
  10. 10.
    Wachs JP, Kolsch M, Stern H, Edan Y (2011) Vision-based hand-gesture applications. Commun ACM 54:60–71CrossRefGoogle Scholar
  11. 11.
    Corera S, Krishnarajah N (2011) Capturing hand gesture movement: a survey on tools, techniques and logical considerations. In: Proceedings of chi sparks 2011 HCI research, innovation and implementation, Arnhem, Netherlands. http://proceedings.chi-sparks.nl/documents/Education-Gestures/FP-35-AC-EG.pdf
  12. 12.
    Kevin NYY, Ranganath S, Ghosh D (2004) Trajectory modeling in gesture recognition using CyberGloves, TENCON 2004, IEEE region 10 conferenceGoogle Scholar
  13. 13.
    Symeonidis K (1996) Hand gesture recognition using neural networks. Neural Netw 13:1–5Google Scholar
  14. 14.
    Kanniche MB (2009) Gesture recognition from video sequences. PhD Thesis, University of Nice 2009Google Scholar
  15. 15.
    Webel S, Keil J, Zoellner M (2008) Multi-touch gestural interaction in X3D using hidden markov models. In: VRST 08 Proceedings of the 2008 ACM symposium on virtual reality software and technology. ACM, New York, NY, USA, pp 263–264Google Scholar
  16. 16.
    Schlomer T, Poppinga B, Henze N, Boll S (2008) Gesture recognition with a wii controller. In: TEI 08 Proceedings of the 2nd international conference on tangible and embedded interaction. ACM, New York, NY, USA, pp 11–14Google Scholar
  17. 17.
    Bourke A, Brien JO, Lyons G (2007) Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. Gait Posture 26(2):194–199. http://www.sciencedirect.com/science/article/B6T6Y-4MBCJHV-1/2/f87e4f1c82f3f93a3a5692357e3fe00c CrossRefGoogle Scholar
  18. 18.
    Noury N, Barralon P, Virone G, Boissy P, Hamel M, Rumeau P (2003) A smart sensor based on rules and its evaluation in daily routines. In: Engineering in medicine and biology society, 2003. Proceedings of the 25th annual international conference of the IEEE, vol. 4, pp 3286–3289Google Scholar
  19. 19.
    Hall ET (1973) The silent language, Anchor Books. ISBN-13 978-0385055499Google Scholar
  20. 20.
    McNeill D (1992) Hand and mind: what gestures reveal about thought. University of Chicago Press. ISBN 9780226561325Google Scholar
  21. 21.
    Boulay B (2007) Human posture recognition for behavior understanding. PhD thesis, Universite de Nice-Sophia AntipolisGoogle Scholar
  22. 22.
    Bretzner L, Laptev I, Lindeberg T (2002) Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering. In: Fifth IEEE international conference on automatic face and gesture recognition, pp 405–410. doi: 10.1109/AFGR.2002.1004190
  23. 23.
    Birdal A, Hassanpour R (2008) Region based hand gesture recognition. In: 16th international conference in central Europe on computer graphics, visualization and computer vision, pp 17Google Scholar
  24. 24.
    Ju SX, Black MJ, Minneman S, Kimber D (1997) Analysis of gesture and action in technical talks for video indexing. Technical report. American Association for Artificial Intelligence. AAAI Technical Report SS-97-03Google Scholar
  25. 25.
    Luo Q, Kong X, Zeng G, Fan J (2008) Human action detection via boosted local motion histograms. Mach Vis Appl. doi: 10.1007/s00138-008-0168-5
  26. 26.
    Lindsay J (2009) K-means classifier tutorial. http://www.uoguelph.ca/~hydrogeo/Whitebox/Help/kMeansClass.html
  27. 27.
    Thirumuruganathan S (2010) A detailed introduction to K-nearest neighbor (KNN) algorithm. http://saravananthirumuruganathan.wordpress.com/2010/05/17/a-detailed-introduction-to-k-nearest-neighbor-knnalgorithm/
  28. 28.
    Derpanis KG (2005) Mean shift clustering, lecture notes. http://www.cse.yorku.ca/kosta/CompVisNotes/meanshift.pdf
  29. 29.
    Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Kluwer Academic, Boston, pp 1–43Google Scholar
  30. 30.
    Ramage D (2007) Hidden Markov models fundamentals. Lecture notes. http://cs229.stanford.edu/section/cs229-hmm.pdf
  31. 31.
    Senin P (2008) Dynamic time warping algorithm review. Technical report. http://csdl.ics.hawaii.edu/techreports/08-04/08-04.pdf
  32. 32.
    Wohler C, Anlauf JK (1999) An adaptable time-delay neural-network algorithm for image sequence analysis. IEEE Trans Neural Netw 10(6):1531–1536CrossRefGoogle Scholar
  33. 33.
    Holzmann GJ (1991) Design and validation of computer protocols. Prentice Hall, New JerseyGoogle Scholar
  34. 34.
    Haykin SS (2009) Neural networks and learning machines. Prentice Hall, New YorkGoogle Scholar
  35. 35.
    Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. Pattern Anal Mach Intell, IEEE Trans 22(1):4–37CrossRefGoogle Scholar
  36. 36.
    Cheng J, Xie X, Bian W, Tao D (2012) Feature fusion for 3D hand gesture recognition by learning a shared hidden space. Pattern Recogn Lett 33:476–484CrossRefGoogle Scholar
  37. 37.
    Sangineto EE, Cupelli M (2012) Real-time viewpoint-invariant hand localization with cluttered backgrounds. Image Vis Comput 30:26–37CrossRefGoogle Scholar
  38. 38.
    Wang GW, Zhang C, Zhuang J (2012) An application of classifier combination methods in hand gesture recognition, mathematical problems in engineering, vol 2012. Hindawi Publishing Corporation, pp 1–17. doi: 10.1155/2012/346951
  39. 39.
    Radkowski R, Stritzke C (2012) Interactive hand gesture-based assembly for augmented reality applications. In: ACHI: The fifth international conference on advances in computer–human interactions, IARIA, pp 303–308Google Scholar
  40. 40.
    Tran C, Trivedi MM (2012) 3-D posture and gesture recognition for interactivity in smart spaces. IEEE Trans Ind Inf 8(1):178–187CrossRefGoogle Scholar
  41. 41.
    Rautaray SS, Agrawal A (2012) Real time hand gesture recognition system for dynamic applications. Int J UbiComp 3(1):21–31CrossRefGoogle Scholar
  42. 42.
    Reale MJ, Canavan S, Yin L, Hu K, Hung T (2011) A multi-gesture interaction system using a 3-D Iris disk model for gaze estimation and an active appearance model for 3-D hand pointing. IEEE Trans Multimed 13(3):474–486CrossRefGoogle Scholar
  43. 43.
    Vsrkonyi-Kczy AR, Tusor B (2011) Human–computer interaction for smart environment applications using fuzzy hand posture and gesture models. IEEE Trans Instrum Meas 60(5):1505–1514CrossRefGoogle Scholar
  44. 44.
    Gorce MDL, Fleet DJ, Paragios N (2011) Model-based 3D hand pose estimation from monocular video. IEEE Trans Pattern Anal Mach Intell 33(9):1793–1805CrossRefGoogle Scholar
  45. 45.
    Sajjawiso T, Kanongchaiyos P (2011) 3D hand pose modeling from uncalibrate monocular images. In: Eighth international joint conference on computer science and software engineering (JCSSE), pp 177–181Google Scholar
  46. 46.
    Henia OB, Bouakaz S (2011) 3D Hand model animation with a new data-driven method. In: Workshop on digital media and digital content management, IEEE, pp 72–76Google Scholar
  47. 47.
    Ionescu D, Ionescu B, Gadea C, Islam S (2011) A multimodal interaction method that combines gestures and physical game controllers. In: Proceedings of 20th international conference on computer communications and networks (ICCCN), IEEE, pp 1–6Google Scholar
  48. 48.
    Yang J, Xu J, Li M, Zhang D, Wang C (2011) A real-time command system based on hand gesture recognition. In: Seventh international conference on natural computation, pp 1588–1592Google Scholar
  49. 49.
    Huang D, Tang W, Ding Y, Wan T, Wu X, Chen Y (2011) Motion capture of hand movements using stereo vision for minimally invasive vascular interventions. In: Sixth international conference on image and graphics, pp 737–742Google Scholar
  50. 50.
    Ionescu D, Ionescu B, Gadea C, Islam S (2011) An intelligent gesture interface for controlling TV sets and set-top boxes. In: 6th IEEE international symposium on applied computational intelligence and informatics, pp 159–164Google Scholar
  51. 51.
    Bergh M, Gool L (2011) Combining RGB and ToF cameras for real-time 3D hand gesture interaction. In: Workshop on applications of computer vision (WACV), IEEE, pp 66–72Google Scholar
  52. 52.
    Bao J, Song A, Guo Y, Tang H (2011) Dynamic hand gesture recognition based on SURF tracking in international conference on electric information and control engineering (ICEICE), pp 338–341Google Scholar
  53. 53.
    Bellarbi A, Benbelkacem S, Zenati-Henda N, Belhocine M (2011) Hand gesture interaction using color-based method for tabletop interfaces. In: IEEE 7th international symposium on intelligent signal processing (WISP), pp 16Google Scholar
  54. 54.
    Hackenberg G, McCall R, Broll W (2011) Lightweight palm and finger tracking for real-time 3D gesture control. In: IEEE virtual reality conference (VR), pp 19–26Google Scholar
  55. 55.
    Du H, Xiong W, Wang Z (2011) Modeling and interaction of virtual hand based on virtools. In: International conference on multimedia technology (ICMT), pp 416–419Google Scholar
  56. 56.
    Rautaray SS, Agrawal A (2011) A novel human–computer interface based on hand gesture recognition using computer vision techniques. In: International conference on intelligent interactive technologies and multimedia (IITM-2011), pp 292–296Google Scholar
  57. 57.
    Visser M, Hopf V (2011) Near and far distance gesture tracking for 3D applications In: 3DTV conference: the true vision-capture, transmission and display of 3D Vedio (3DTV-CON), pp 1–4Google Scholar
  58. 58.
    He GF, Kang SK, Song WC, Jung ST (2011) Real-time gesture recognition using 3D depth camera. In: 2nd international conference on software engineering and service science (ICSESS), pp 187–190Google Scholar
  59. 59.
    Tan T, De Geo ZM (2011) Research of hand positioning and gesture recognition based on binocular vision. In: EEE international symposium on virtual reality innovation 2011, pp 311–315Google Scholar
  60. 60.
    Ho MF, Tseng CY, Lien CC, Huang CL (2011) A multi-view vision- based hand motion capturing system. Pattern Recogn 44:443–453CrossRefzbMATHGoogle Scholar
  61. 61.
    Huang DY, Hu WC, Chang SH (2011) Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination. Expert Syst Appl 38(5):6031–6042CrossRefGoogle Scholar
  62. 62.
    Hsieh CC, Liou DH , Lee D (2010) A real time hand gesture recognition system using motion history image. In: 2nd international conference on signal processing systems (ICSPS), pp 394–398Google Scholar
  63. 63.
  64. 64.
  65. 65.
    Mgestyk (2009) http://www.mgestyk.com/
  66. 66.
    Wii Nintendo (2006) http://www.nintendo.com/wii
  67. 67.

Copyright information

© Springer-Verlag London 2013

Authors and Affiliations

  1. 1.Department of Artificial Intelligence, Faculty of Computer Science and Information TechnologyUniversity of MalayaKuala LumpurMalaysia

Personalised recommendations