Abstract
When coping with person identification problem, previous approaches either directly take raw RGB as inputs or use more sophisticated devices to capture other information. However, most of the approaches are sensitive to the changes of environment and different clothing, little variation may lead to failure identification. Recent research shows that “gait” (i.e., a person’s manner of walking) is a unique trait of a human being. Motivated by this, we propose a novel method to identify people by their gaits. In order to figure out the characteristic of individual gait, we are interested in utilizing skeletal information, which is more robust to the diversification of environment and appearance. To effectively utilize skeletal data, we analyze the spatial relationship of joints and transform the 3D skeleton coordinates into relative distances and angles between joints, and then we use a bidirectional long short-term memory neural network to explore the temporal information of the skeleton sequences. Results show that our proposed method can outperform previous methods on BIWI and IAS-Lab datasets by gaining 10.33% accuracy improvement on average.
C.-C. Wei and L.-H. Tsai—The authors contribute equally to this paper.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
BIWI dataset kernel description. http://robotics.dei.unipd.it/reid/index.php/8-dataset/2-overview-biwi
Shotton, J., et al.: Real-time human pose recognition in parts from single depth images. In: CVPR 2011, pp. 1297–1304 (2011)
Lavi, B., Serj, M.F., Ullah, I.: Survey on deep learning techniques for person re-identification task. Pattern Recognit. (2018)
Baltieri, D., Vezzani, R., Cucchiara, R., Utasi, A., Benedek, C., Szirányi, T.: Multi-view people surveillance using 3D information. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1817–1824 (2011)
Elaoud, A., Barhoumi, W., Drira, H., Zagrouba, E.: Analysis of skeletal shape trajectories for person re-identification. In: Blanc-Talon, J., Penne, R., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2017. LNCS, vol. 10617, pp. 138–149. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70353-4_12. https://hal.archives-ouvertes.fr/hal-01703945
Haque, A., Alahi, A., Li, F.F.: Recurrent attention models for depth-based person identification, November 2016
Oliver, J., Albiol, A., Albiol, A.: 3D descriptor for people re-identification. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR 2012), pp. 1395–1398 (2012)
Karianakis, N., Liu, Z., Chen, Y., Soatto, S.: Reinforced temporal attention and split-rate transfer for depth-based person re-identification. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11209, pp. 737–756. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01228-1_44
Wang, L., Tan, T., Ning, H., Weiming, H.: Silhouette analysis-based gait recognition for human identification. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1505–1518 (2003). https://doi.org/10.1109/TPAMI.2003.1251144
Luong, T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal, pp. 1412–1421. Association for Computational Linguistics, September 2015. https://doi.org/10.18653/v1/D15-1166, https://www.aclweb.org/anthology/D15-1166
Munaro, M., Basso, A., Fossati, A., Gool, L.V., Menegatti, E.: 3D reconstruction of freely moving persons for re-identification with a depth sensor. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 4512–4519 (2014)
Munaro, M., Basso, A., Fossati, A., Van Gool, L., Menegatti, E.: 3D reconstruction of freely moving persons for re-identification with a depth sensor. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 4512–4519, May 2014. https://doi.org/10.1109/ICRA.2014.6907518
Prakash, C., Kumar, R., Mittal, N.: Recent developments in human gait research: parameters, approaches, applications, machine learning techniques, datasets and challenges. Artif. Intell. Rev. 49(1), 1–40 (2018). https://doi.org/10.1007/s10462-016-9514-6
Schuster, M., Paliwal, K.: Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 45(11), 2673–2681 (1997). https://doi.org/10.1109/78.650093
Önsen Toygar, E.A., Afaneh, A.: Person identification using multimodal biometrics under different challenges. Pattern Recognit. (2017)
Yan, S., Xiong, Y., Lin, D.: Spatial temporal graph convolutional networks for skeleton-based action recognition. In: AAAI 2018, pp. 1297–1304 (2018)
Du, Y., Wang, W., Wang, L.: Hierarchical recurrent neural network for skeleton based action recognition. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1110–1118 (2015)
Zeng, W., Wang, C., Yang, F.: Silhouette-based gait recognition via deterministic learning. Pattern Recognit. 47(11), 3568–3584 (2014)
Zhao, L., Li, X., Zhuang, Y., Wang, J.: Deeply-learned part-aligned representations for person re-identification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3219–3228 (2017)
Zheng, W., Li, L., Zhang, Z., Huang, Y., Wang, L.: Relational network for skeleton-based action recognition. In: International Conference on Multimedia and Expo (ICME) 2019 (2018)
Zheng, Z., Zheng, L., Yang, Y.: Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3754–3762 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Wei, CC., Tsai, LH., Chou, HP., Chang, SC. (2020). Person Identification by Walking Gesture Using Skeleton Sequences. In: Blanc-Talon, J., Delmas, P., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2020. Lecture Notes in Computer Science(), vol 12002. Springer, Cham. https://doi.org/10.1007/978-3-030-40605-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-40605-9_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-40604-2
Online ISBN: 978-3-030-40605-9
eBook Packages: Computer ScienceComputer Science (R0)