Skip to main content
SpringerLink
Log in

Vision-Based Dynamic Hand Gesture Recognition Techniques and Applications: A Review

  • Conference paper
  • First Online:
Proceedings of the 8th International Conference on Computational Science and Technology

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 835))

Abstract

Hand gesture recognition is an area in computer science that focuses on utilizing mathematical algorithms to analyze human gestures. The aim of this study is to perform a review evaluating related input devices, techniques, limitations and problems of dynamic hand gesture recognition using vision-based methods. More precisely, the hand gesture recognition process is divided into four stages: (a) input image, (b) segmentation, (c) feature extraction and (d) classification/recognition. Gesture control is the ability to acknowledge and interpret human body movements using a variety of gestures or motions made in the air by interacting and controlling devices without having the need to physically touch them. The Single Camera, Leap Motion Controller (LMC) and Microsoft Kinect are the three vision-based hand gestures devices that are compared in this review paper. We found out that the Single Camera is able to perform and achieve an accuracy rate of more than 95%. Besides, this paper not only is able to differentiate and compare the accuracy rate between the input devices, but also between the techniques applied which consists of (a) Hidden Markov Model, (b) Dynamic Time warping and (c) Neural Network including their advantages as well as the disadvantages. The applications that are used in vision-based dynamic hand gesture recognition are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 299.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cheok MJ, Omar Z, Jaward MH (2019) A review of hand gesture and sign language recognition techniques. Int J Mach Learn Cybern 10:131–153

    Google Scholar 

  2. Pisharady PK, Saerbeck M (2015) Recent methods and databases in vision-based hand gesture recognition: a review. Comput Vis Image Underst 141:152–165

    Google Scholar 

  3. Dan RB, Mohod PS (2014) Survey on hand gesture recognition approaches. Int J Comput Sci Inf Technol 5(2):2050–2052

    Google Scholar 

  4. Sinha K, Kumari R, Priya A, Paul P (2019) A computer vision-based gesture recognition using hidden Markov model. In: Proceedings of ICEMIT 2017, pp 55–67

    Google Scholar 

  5. Rani HK, Rani J (2016) A review: study of various techniques of hand gesture recognition. In: 16 IEEE 1st international conference on power electronics, intelligent control and energy systems (ICPEICES), pp 1–5

    Google Scholar 

  6. Patel N, He S (2018) A survey on hand gesture recognition techniques, methods and tools. Int J Res Advent Technol 6(6)

    Google Scholar 

  7. Nikam AS, Ambekar AG (2017) Bilingual sign recognition using image based hand gesture technique for hearing and speech impaired people. In: Proceedings of the 2nd International conference on computing, communication, control and automation 2016, pp 1–6

    Google Scholar 

  8. Munasinghe MINP (2018) Dynamic hand gesture recognition using computer vision and neural networks. In: 3rd International conference for convergence in technology I2CT 2018, pp 1–5

    Google Scholar 

  9. Lai HY, Lai HJ (2014) Real-time dynamic hand gesture recognition. In: Proceedings of the 2014 International symposium on computer, consumer and control, IS3C 2014, pp 658–661

    Google Scholar 

  10. Lu W, Tong Z, Chu J (2016) Dynamic hand gesture recognition with leap motion controller. IEEE Sign Process Lett 23(9):1188–1192

    Google Scholar 

  11. Liu L, Huai Y (2019) Dynamic hand gesture recognition using LMC for flower and plant interaction. Int J Pattern Recogn Artif Intell 33

    Google Scholar 

  12. Linqin C, Shuangjie C, Min X, Jimin Y, Jianrong Z (2017) Dynamic hand gesture recognition using RGB-D data for natural human-computer interaction. J Intell Fuzzy Syst 32(5):3495–3507

    Google Scholar 

  13. Wei-Lun C, Chih-Hung W, Hong Lin C (2015) Depth-based hand gesture recognition using hand movements and defects. In: 2015 International symposium on next-generation electronics, ISNE, pp 1–4

    Google Scholar 

  14. Tran TH, Tran HN, Doan HG (2019) Dynamic hand gesture recognition from multi-modal streams using deep neural network. In: Multi-disciplinary trends in artificial intelligence. MIWAI 2019. Lecture notes in computer science, pp 156–167

    Google Scholar 

  15. Haria A, Subramanian A, Asokkumar N, Poddar S, Nayak JS (2017) Hand gesture recognition for human computer interaction. Proc Comput Sci 115:367–374

    Article  Google Scholar 

  16. Syahputra MF, Fatimah S, Rahmat RF (2018) Interaction on augmented reality with finger detection and hand movement recognition. Springer International Publishing, pp 702–712

    Google Scholar 

  17. Jia J, Tu G, Deng X, Zhao C, Yi W (2018) Real-time hand gestures system based on leap motion. Concurrency Comput: Pract Exp 31:1–11

    Google Scholar 

  18. Naglot D, Kulkarni M (2016) Real time sign language recognition using the leap motion controller. In: 2016 International conference on inventive computation technologies (ICICT), vol 3, pp 1–5

    Google Scholar 

  19. Mantecón T, Del-Blanco CR, Jaureguizar F, García N (2016) Hand gesture recognition using infrared imagery provided by leap motion controller, vol 10016, pp 47–57

    Google Scholar 

  20. Ghotkar A, Kharate GK (2015) Dynamic hand gesture recognition and novel sentence interpretation algorithm for Indian sign language using microsoft Kinect sensor. J Pattern Recogn Res 1:24–38

    Google Scholar 

  21. Yohannes E, Shih TK, Utaminingrum F (2020) Virtual reality in puppet game using depth sensor of gesture recognition and tracking. J Comput 31(5):89–98

    Google Scholar 

  22. García-Bautista G, Trujillo-Romero F, Caballero-Morales SO (2017) Mexican sign language recognition using Kinect and data time warping algorithm. In: 2017 International conference on electronics, communications and computers (CONIELECOMP), pp 1–5

    Google Scholar 

  23. Bencherif MA, Algabri M, Mekhtiche MA, Faisal M, Alsulaiman M, Mathkour H, Al-Hammadi M, Ghaleb H (2021) Arabic sign language recognition system using 2D hands and body skeleton data. IEEE Access 9:59612–59627

    Article  Google Scholar 

  24. Azar SG, Seyedarabi H (2020) Trajectory-based recognition of dynamic Persian sign language using hidden Markov model. Comput Speech Lang 61

    Google Scholar 

  25. Wang X, Xia M, Cai H, Gao Y, Cattani C (2012) Hidden-Markov-models-based dynamic hand gesture recognition. Math Probl Eng

    Google Scholar 

  26. Chen G, Ge K (2020) A fusion recognition method based on multi-feature Hidden Markov model for dynamic hand gesture. Comput Intell Neurosci

    Google Scholar 

  27. Ahmed W, Chanda K, Mitra S (2016) Vision based hand gesture recognition using dynamic time warping for Indian sign language. In: Proceedings of the 2016 International conference on information science, ICIS, pp 120–125

    Google Scholar 

  28. Plouffe G, Cretu AM (2016) Static and dynamic hand gesture recognition in depth data using dynamic time warping. IEEE Trans Instrum Meas 65(2):305–316

    Google Scholar 

  29. Zhi D, De Oliveira TEA, Da Fonseca VP, Petriu EM (2018) Teaching a robot sign language using vision-based hand gesture recognition. In: 2018 IEEE international conference on computational intelligence and virtual environments for measurement systems and applications, CIVEMSA, pp 1–6 (2018).

    Google Scholar 

  30. Chin-Shyurng F, Lee SE, Wu ML (2019) Real-time musical conducting gesture recognition based on a dynamic time warping classifier using a single-depth camera. Appl Sci 9

    Google Scholar 

  31. Ameur S, Ben Khalifa A, Bouhlel MS (2020) A novel hybrid bidirectional unidirectional LSTM network for dynamic hand gesture recognition with leap motion. Entertain Comput 35:100373

    Google Scholar 

  32. Yang L, Chen J, Zhu W (2020) Dynamic hand gesture recognition based on a leap motion controller and two-layer bidirectional recurrent neural network. Sensors (Switzerland) 20

    Google Scholar 

  33. Zhang W, Wang J (2019) Dynamic hand gesture recognition based on 3D convolutional neural network models. In: 2019 IEEE 16th International conference on networking, sensing and control, ICNSC, pp 224–229

    Google Scholar 

  34. Li Y, Feng X, Xu Y, Dong X, Xu Z, Huang J, Lu L (2019) A dynamic hand gesture recognition model based on the improved dynamic time warping algorithm. In: Proceedings of the 25th International conference on automation & computing, Lancaster University, Lancaster, UK, September, pp 5–7

    Google Scholar 

  35. Zhang X, Wang J, Wang X (2016) Improvement of dynamic hand gesture recognition based on HMM algorithm. In: 2016 International conference on information system and artificial intelligence (ISAI), pp 401–406

    Google Scholar 

  36. Kajan S, Goga J, Zsiros O (2020) Comparison of algorithms for dynamic hand gesture recognition. In: Proceedings of the 30th International conference on cybernetics and informatics, K and I 2020, pp 1–5

    Google Scholar 

  37. Mahmood MR, Mohsin Abdulazeez A, Orman Z (2018) Dynamic hand gesture recognition system for Kurdish sign language using two lines of features. In: International conference on advanced science and engineering (ICOASE), Duhok, pp 42–47 (2018).

    Google Scholar 

  38. Ghotkar A, Vidap P, Deo K (2016) Dynamic hand gesture recognition using hidden Markov model by microsoft kinect sensor. Int J Comput Appl 150:5–9

    Google Scholar 

  39. Rahim MA, Shin J, Islam MR (2019) Dynamic hand gesture based sign word recognition using convolutional neural network with feature fusion. In: Proceedings of the 2nd IEEE international conference on knowledge innovation and invention 2019, ICKII, pp 221–224

    Google Scholar 

  40. Pramunanto E, Sumpeno S, Legowo RS (2017) Classification of hand gesture in Indonesian sign language system using Naive Bayes. In: 2017 International seminar on sensors, instrumentation, measurement and metrology (ISSIMM), Surabaya, pp 187–191

    Google Scholar 

  41. Simão M, Neto P, Gibaru O (2016) Natural control of an industrial robot using hand gesture recognition with neural networks. In: IECON 2016—42nd Annual conference of the IEEE Industrial Electronics Society, pp 5322–5327

    Google Scholar 

  42. Luan K, Matsumaru T (2019) Dynamic hand gesture recognition for robot ARM teaching based on improved LRCN model. In: IEEE international conference on robotics and biomimetics, ROBIO, pp 1269–1274

    Google Scholar 

  43. Gao Q, Chen Y, Ju Z, Liang Y (2021) Dynamic hand gesture recognition based on 3D hand pose estimation for human-robot interaction. IEEE Sens J, pp 1–10

    Google Scholar 

  44. Rahman A, Al Mahmud J, Hasanuzzaman M (2018) Pointing and commanding gesture recognition in 3D for human-robot interaction. In: 2018 International conference on innovation in engineering and technology, ICIET, pp 1–10

    Google Scholar 

  45. Tsai CC, Kuo CC, Chen YL (2020) 3D hand gesture recognition for drone control in unity. In: 2020 IEEE 16th international conference on automation science and engineering, pp 985–988

    Google Scholar 

  46. Hu B, Wang J (2018) Deep learning based hand gesture recognition and UAV flight controls. In: 2018 24th International conference on automation and computing (ICAC), pp 1–6

    Google Scholar 

  47. Rani SS, Dhrisya KJ, Ahalyadas M (2017) Hand gesture control of virtual object in augmented reality. In: 2017 International conference on advances in computing, communications and informatics (ICACCI), pp 1500–1505

    Google Scholar 

  48. Areyur V, Chao S, Cao L, Meacham S, Blakely V, Hansberger J (2020) Design and evaluation of a hand gesture recognition approach for real-time interactions. Multimedia Tools Appl 79

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computing and Informatics, Universiti Malaysia Sabah, 88400, Kota Kinabalu, Sabah, Malaysia

    Nurfazlin Muhamad Feizal Franslin & Giap Weng Ng

Authors
  1. Nurfazlin Muhamad Feizal Franslin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Giap Weng Ng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Giap Weng Ng .

Editor information

Editors and Affiliations

  1. Faculty of Computing and Informatics, Universiti Malaysia Sabah, Kota Kinabalu, Malaysia

    Rayner Alfred

  2. School of Information, Science, Security, Network, Japan Advanced Institute of Science and Technology, Ishikawa, Japan

    Yuto Lim

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Franslin, N.M.F., Ng, G.W. (2022). Vision-Based Dynamic Hand Gesture Recognition Techniques and Applications: A Review. In: Alfred, R., Lim, Y. (eds) Proceedings of the 8th International Conference on Computational Science and Technology. Lecture Notes in Electrical Engineering, vol 835. Springer, Singapore. https://doi.org/10.1007/978-981-16-8515-6_11

Download citation

Publish with us

Policies and ethics

Search

Navigation