Improving Gait Recognition with 3D Pose Estimation

  • Weizhi An
  • Rijun Liao
  • Shiqi YuEmail author
  • Yongzhen Huang
  • Pong C. Yuen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10996)


Gait is a kind of attractive biometric feature for human identification in recent decades. The view, clothing, carrying and other variations are always the challenges for gait recognition. One of the possible solutions is the model based methods. In this paper, 3D pose is estimated from 2D images are used as the feature for gait recognition. So gait can be described by the motion of human body joints. Besides, the 3D pose has better capacity for view variation than the 2D pose. Experimental results also prove that in the paper. To improve the recognition rates, LSTM and CNNs are employed to extract temporal and spatial features. Compared with other model-based methods, the proposed one has achieved much better performance and is comparable with appearance-based ones. The experimental results show the proposed 3D pose based method has unique advantages in large view variation. It will have great potential with the development of pose estimation in future.


Gait recognition 3D pose LSTM CNNs 



The work is supported by the strategic new and future industrial development fund of Shenzhen (Grant No. 20170504160426188).


  1. 1.
    K. Bashir, T. Xiang, and S. Gong. Cross view gait recognition using correlation strength. In BMVC, pages 1–11, 2010Google Scholar
  2. 2.
    C. H. Chen and D. Ramanan. 3D human pose estimation = 2D pose estimation + matching. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 7035–7043, 2017Google Scholar
  3. 3.
    Y. Feng, Y. Li, and J. Luo. Learning effective gait features using lstm. In International Conference on Pattern Recognition (ICPR), pages 325–330, 2017Google Scholar
  4. 4.
    K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778, 2016Google Scholar
  5. 5.
    W. Kusakunniran, Q. Wu, H. Li, and J. Zhang. Multiple views gait recognition using view transformation model based on optimized gait energy image. In IEEE International Conference on Computer Vision Workshops, pages 1058–1064, 2010Google Scholar
  6. 6.
    Kusakunniran, W., Wu, Q., Zhang, J., Li, H.: Gait recognition under various viewing angles based on correlated motion regression. IEEE Transactions on Circuits and Systems for Video Technology 22(6), 966–980 (2012)CrossRefGoogle Scholar
  7. 7.
    B. Kwolek, T. Krzeszowski, A. Michalczuk, and H. Josinski. 3D Gait Recognition Using Spatio-Temporal Motion Descriptors. Springer International Publishing, 2014Google Scholar
  8. 8.
    Liang, Y., Li, C.T., Guan, Y., Hu, Y.: Gait recognition based on the golden ratio. Eurasip Journal on Image and Video Processing 2016(1), 22 (2016)CrossRefGoogle Scholar
  9. 9.
    R. Liao, C. Cao, E. B. Garcia, S. Yu, and Y. Huang. Pose-based temporal-spatial network (ptsn) for gait recognition with carrying and clothing variations. In the 12th Chinese Conference on Biometric Recognition (CCBR), pages 474–483, 2017Google Scholar
  10. 10.
    Makihara, Yasushi, Sagawa, Ryusuke, Mukaigawa, Yasuhiro, Echigo, Tomio, Yagi, Yasushi: Gait Recognition Using a View Transformation Model in the Frequency Domain. In: Leonardis, Aleš, Bischof, Horst, Pinz, Axel (eds.) ECCV 2006. LNCS, vol. 3953, pp. 151–163. Springer, Heidelberg (2006). Scholar
  11. 11.
    Nash, J.M., Carter, J.N., Nixon, M.S.: Dynamic feature extraction via the velocity hough transform. Pattern Recognition Letters 18(10), 1035–1047 (1997)CrossRefGoogle Scholar
  12. 12.
    Y. Sun, X. Wang, and X. Tang. Deep learning face representation from predicting 10,000 classes. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1891–1898, 2014Google Scholar
  13. 13.
    R. Tanawongsuwan and A. Bobick. Gait recognition from time-normalized joint-angle trajectories in the walking plane. In IEEE Conference on Computer Vision and Pattern Recognition, page 726, 2001Google Scholar
  14. 14.
    Wang, L., Tan, T., Hu, W., Ning, H.: Automatic gait recognition based on statistical shape analysis. IEEE Transactions on Image Processing 12(9), 1120–1131 (2003)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Y. Wen, K. Zhang, Z. Li, and Y. Qiao. A discriminative feature learning approach for deep face recognition. In European Conference on Computer Vision, pages 499–515, 2016Google Scholar
  16. 16.
    Wu, Z., Huang, Y., Wang, L., Wang, X., Tan, T.: A comprehensive study on cross-view gait based human identification with deep cnns. IEEE Transactions on Pattern Analysis and Machine Intelligence 39(2), 209–226 (2016)CrossRefGoogle Scholar
  17. 17.
    X. Xing, K. Wang, T. Yan, and Z. Lv. Complete canonical correlation analysis with application to multi-view gait recognition. Pattern Recognition, 50(C):107–117, 2016Google Scholar
  18. 18.
    S. Yu, D. Tan, and T. Tan. A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. In International Conference on Pattern Recognition (ICPR), pages 441–444, 2006Google Scholar
  19. 19.
    S. Yu, L. Wang, W. Hu, and T. Tan. Gait analysis for human identification in frequency domain. In International Conference on Image and Graphics, pages 282–285, 2004Google Scholar
  20. 20.
    S. Yu, Q. Wang, L. Shen, and Y. Huang. View invariant gait recognition using only one uniform model. In 23rd International Conference on Pattern Recognition (ICPR2016), pages 889–894, 2016Google Scholar
  21. 21.
    Zhang, K., Huang, Y., Du, Y., et al.: Facial expression recognition based on deep evolutional spatial-temporal networks. IEEE Transactions on Image Processing 26(9), 4193–4203 (2017)MathSciNetCrossRefGoogle Scholar
  22. 22.
    G. Zhao, G. Liu, H. Li, and M. Pietikainen. 3d gait recognition using multiple cameras. In International Conference on Automatic Face and Gesture Recognition, pages 529–534, 2006Google Scholar
  23. 23.
    S. Zheng, J. Zhang, K. Huang, R. He, and T. Tan. Robust view transformation model for gait recognition. In Image Processing (ICIP), 2011 18th IEEE International Conference on, pages 2073–2076. IEEE, 2011Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Weizhi An
    • 1
  • Rijun Liao
    • 1
  • Shiqi Yu
    • 1
    Email author
  • Yongzhen Huang
    • 2
  • Pong C. Yuen
    • 3
  1. 1.College of Computer Science and Software EngineeringShenzhen UniversityShenzhenChina
  2. 2.National Laboratory of Pattern Recognition, Institute of AutomationChinese Academy of SciencesBeijingChina
  3. 3.Department of Computer ScienceHong Kong Baptist UniversityHong Kong SARChina

Personalised recommendations