Abstract
Gait is a kind of attractive biometric feature for human identification in recent decades. The view, clothing, carrying and other variations are always the challenges for gait recognition. One of the possible solutions is the model based methods. In this paper, 3D pose is estimated from 2D images are used as the feature for gait recognition. So gait can be described by the motion of human body joints. Besides, the 3D pose has better capacity for view variation than the 2D pose. Experimental results also prove that in the paper. To improve the recognition rates, LSTM and CNNs are employed to extract temporal and spatial features. Compared with other model-based methods, the proposed one has achieved much better performance and is comparable with appearance-based ones. The experimental results show the proposed 3D pose based method has unique advantages in large view variation. It will have great potential with the development of pose estimation in future.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
K. Bashir, T. Xiang, and S. Gong. Cross view gait recognition using correlation strength. In BMVC, pages 1–11, 2010
C. H. Chen and D. Ramanan. 3D human pose estimation = 2D pose estimation + matching. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 7035–7043, 2017
Y. Feng, Y. Li, and J. Luo. Learning effective gait features using lstm. In International Conference on Pattern Recognition (ICPR), pages 325–330, 2017
K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778, 2016
W. Kusakunniran, Q. Wu, H. Li, and J. Zhang. Multiple views gait recognition using view transformation model based on optimized gait energy image. In IEEE International Conference on Computer Vision Workshops, pages 1058–1064, 2010
Kusakunniran, W., Wu, Q., Zhang, J., Li, H.: Gait recognition under various viewing angles based on correlated motion regression. IEEE Transactions on Circuits and Systems for Video Technology 22(6), 966–980 (2012)
B. Kwolek, T. Krzeszowski, A. Michalczuk, and H. Josinski. 3D Gait Recognition Using Spatio-Temporal Motion Descriptors. Springer International Publishing, 2014
Liang, Y., Li, C.T., Guan, Y., Hu, Y.: Gait recognition based on the golden ratio. Eurasip Journal on Image and Video Processing 2016(1), 22 (2016)
R. Liao, C. Cao, E. B. Garcia, S. Yu, and Y. Huang. Pose-based temporal-spatial network (ptsn) for gait recognition with carrying and clothing variations. In the 12th Chinese Conference on Biometric Recognition (CCBR), pages 474–483, 2017
Makihara, Yasushi, Sagawa, Ryusuke, Mukaigawa, Yasuhiro, Echigo, Tomio, Yagi, Yasushi: Gait Recognition Using a View Transformation Model in the Frequency Domain. In: Leonardis, Aleš, Bischof, Horst, Pinz, Axel (eds.) ECCV 2006. LNCS, vol. 3953, pp. 151–163. Springer, Heidelberg (2006). https://doi.org/10.1007/11744078_12
Nash, J.M., Carter, J.N., Nixon, M.S.: Dynamic feature extraction via the velocity hough transform. Pattern Recognition Letters 18(10), 1035–1047 (1997)
Y. Sun, X. Wang, and X. Tang. Deep learning face representation from predicting 10,000 classes. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1891–1898, 2014
R. Tanawongsuwan and A. Bobick. Gait recognition from time-normalized joint-angle trajectories in the walking plane. In IEEE Conference on Computer Vision and Pattern Recognition, page 726, 2001
Wang, L., Tan, T., Hu, W., Ning, H.: Automatic gait recognition based on statistical shape analysis. IEEE Transactions on Image Processing 12(9), 1120–1131 (2003)
Y. Wen, K. Zhang, Z. Li, and Y. Qiao. A discriminative feature learning approach for deep face recognition. In European Conference on Computer Vision, pages 499–515, 2016
Wu, Z., Huang, Y., Wang, L., Wang, X., Tan, T.: A comprehensive study on cross-view gait based human identification with deep cnns. IEEE Transactions on Pattern Analysis and Machine Intelligence 39(2), 209–226 (2016)
X. Xing, K. Wang, T. Yan, and Z. Lv. Complete canonical correlation analysis with application to multi-view gait recognition. Pattern Recognition, 50(C):107–117, 2016
S. Yu, D. Tan, and T. Tan. A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. In International Conference on Pattern Recognition (ICPR), pages 441–444, 2006
S. Yu, L. Wang, W. Hu, and T. Tan. Gait analysis for human identification in frequency domain. In International Conference on Image and Graphics, pages 282–285, 2004
S. Yu, Q. Wang, L. Shen, and Y. Huang. View invariant gait recognition using only one uniform model. In 23rd International Conference on Pattern Recognition (ICPR2016), pages 889–894, 2016
Zhang, K., Huang, Y., Du, Y., et al.: Facial expression recognition based on deep evolutional spatial-temporal networks. IEEE Transactions on Image Processing 26(9), 4193–4203 (2017)
G. Zhao, G. Liu, H. Li, and M. Pietikainen. 3d gait recognition using multiple cameras. In International Conference on Automatic Face and Gesture Recognition, pages 529–534, 2006
S. Zheng, J. Zhang, K. Huang, R. He, and T. Tan. Robust view transformation model for gait recognition. In Image Processing (ICIP), 2011 18th IEEE International Conference on, pages 2073–2076. IEEE, 2011
Acknowledgment
The work is supported by the strategic new and future industrial development fund of Shenzhen (Grant No. 20170504160426188).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
An, W., Liao, R., Yu, S., Huang, Y., Yuen, P.C. (2018). Improving Gait Recognition with 3D Pose Estimation. In: Zhou, J., et al. Biometric Recognition. CCBR 2018. Lecture Notes in Computer Science(), vol 10996. Springer, Cham. https://doi.org/10.1007/978-3-319-97909-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-97909-0_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97908-3
Online ISBN: 978-3-319-97909-0
eBook Packages: Computer ScienceComputer Science (R0)