Nonlinear Dynamical System Analysis for Continuous Gesture Recognition

  • Wenjun Hou
  • Guangyu FengEmail author
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 516)


Extracting applicable features from continuous gesture is uneasy since it shows up as a nonlinear dynamic system with a spatial–temporal pattern. This paper introduces a continuous gesture recognition framework that analyzes, models, and classifies the nonlinear dynamics of gestures based on chaotic theory. In this system, the trajectories of finger joints are captured as the discrete observations of nonlinear dynamic system, which defines the feature matrix of gestures by reconstructing a phase space through employing a delay-embedding scheme, the properties of the reconstructed phase space are captured in terms of dynamic and metric invariants that include Lyapunov exponent, correlation integral, and fractal dimension. Finally, we extract a feature matrix for training several classifiers with relatively few samples and get best accuracy of around 96.6% to prove our assumption that the nonlinear dynamics of continuous gesture can be approximated by a particular type of dynamical system for classification.


Continuous gesture recognition Human computer interaction Feature extraction Chaotic theory 


  1. 1.
    Yang Z, Narayanan SS. Modeling dynamics of expressive body gestures in dyadic interactions. IEEE Trans Affect Comput. 2017;8(3):369–81.CrossRefGoogle Scholar
  2. 2.
    Yang HD, Sclaroff S, Lee SW. Sign language spotting with a threshold model based on conditional random fields. IEEE Trans Pattern Anal Mach Intell. 2009;31(7):1264–77.CrossRefGoogle Scholar
  3. 3.
    Celebi S, Aydin AS, Temiz TT, Arici T. Gesture recognition using skeleton data with weighted dynamic time warping; 2013. p. 620–5.Google Scholar
  4. 4.
    Vo DH, Huynh, HH, Nguyen TN, Meunier J. Automatic hand gesture segmentation for recognition of Vietnamese sign language; 2016. p. 368–73.Google Scholar
  5. 5.
    Lu W, Tong Z, Chu J. Dynamic hand gesture recognition with leap motion controller. IEEE Sig Process Lett. 2016;23(9):1188–92.CrossRefGoogle Scholar
  6. 6.
    Singha J, Misra S, Laskar RH. Effect of variation in gesticulation pattern in dynamic hand gesture recognition system. Neurocomputing. 2016;208:269–80.CrossRefGoogle Scholar
  7. 7.
    Wang P, Li W, Liu S, Gao Z, Tang C, Ogunbona P. Large-scale isolated gesture recognition using convolutional neural networks. In: ArXiv e-prints; 2017.Google Scholar
  8. 8.
    Chai X, Liu Z, Yin F, Liu Z, Chen X. Two streams recurrent neural networks for large-scale continuous gesture recognition; 2016. p. 31–6.Google Scholar
  9. 9.
    Wan J, Escalera S, Escalante HJ, Baro X, Guyon I, Allik J, Lin C, et al. Results and analysis of ChaLearn LAP multi-modal isolated and continuous gesture recognition, and real versus fake expressed emotions challenges; 2017.Google Scholar
  10. 10.
    Takens F. Detecting strange attractors in turbulence. Berlin, Heidelberg: Springer; 1981. p. 366–81.zbMATHGoogle Scholar
  11. 11.
    Oselio B, Hero A. Dynamic reconstruction of influence graphs with adaptive directed information; 2017.Google Scholar
  12. 12.
    Fraser AM, Swinney HL. Independent coordinates for strange attractors from mutual information. Phys Rev A. 1986;33(2):1134–40.MathSciNetCrossRefGoogle Scholar
  13. 13.
    Brown L, Abarbanel J, Brown D, Kennel J, Kennel C. Determining embedding dimension for phase-space reconstruction using a geometrical construction. Phys Rev A. 1992;45(6):3402–4311.Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.School of Digital Media and Design ArtsBeijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations