Skip to main content
SpringerLink
Log in

3D convolution neural network-based person identification using gait cycles

  • Original Paper
  • Published:
Evolving Systems Aims and scope Submit manuscript

Abstract

Human identification plays a prominent role in terms of security. In modern times security is becoming the key term for an individual or a country, especially for countries which are facing internal or external threats. Gait analysis is interpreted as the systematic study of the locomotive in humans. It can be used to extract the exact walking features of individuals. Walking features depends on biological as well as the physical feature of the object; hence, it is unique to every individual. In this work, gait features are used to identify an individual. The steps involve object detection, background subtraction, silhouettes extraction, skeletonization, and training 3D Convolution Neural Network (3D-CNN) on these gait features. The model is trained and evaluated on the dataset acquired by CASIA—B Gait, which consists of 15,000 videos of 124 subjects’ walking pattern captured from 11 different angles carrying objects such as bag and coat. The proposed method focuses more on the lower body part to extract features such as the angle between knee and thighs, hip angle, angle of contact, and many other features. The experimental results are compared with amongst accuracies of silhouettes as datasets for training and skeletonized image as training data. The results show that extracting the information from skeletonized data yields improved accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Akman O, Alatan AA, Çiloglu T (2008) Multi-camera visual surveillance for motion detection, occlusion handling, tracking and event recognition. In: workshop on multi-camera and multi-modal sensor fusion algorithms

  • Angra S, Ahuja S (2017) Machine learning and its application. IEEE. https://doi.org/10.1109/ICBDACI.2017.8070809

    Article  Google Scholar 

  • Ariyanto G, Nixon MS (2011) Model-based 3D gait biometrics. In: 2011 international joint conference on biometrics (IJCB)

  • Blanke DJ, Hageman PA (1989) Comparison of gait of young men and elderly men. Phys Ther 69(2):144–148

    Article  Google Scholar 

  • Bobick F, Johnson AY (2001) Gait recognition using static activity-specific parameters. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:423–430

    Google Scholar 

  • Boudaoud LB, Sider A, Tari A (2015) A new thinning algorithm for binary images. In: 2015 3rd international conference on control, engineering & information technology (CEIT), p 1–6. Doi: https://doi.org/10.1109/CEIT.2015.7233099.

  • Boulgouris NV, Chi ZX (2007) Gait recognition using radon transform and linear discriminant analysis. IEEE Trans Image Process 16(3):731–740

    Article  MathSciNet  Google Scholar 

  • Chuang J-H, Tsai C-H, Ko M-C (2000) Skeletonisation of three dimensional object using generalized potential field. IEEE Trans Patterns Anal Mach Learn. https://doi.org/10.1109/34.888709

    Article  Google Scholar 

  • Cutting JE, Kozlowski LT (1977) Recognizing friends by their walk: gait perception without familiarity cues. Bull Psychon Soc 9(5):353–6

    Article  Google Scholar 

  • El-Alfy H, Mitsugami I, Yagi Y (2014) A new gait-based identification method using local Gauss maps. In: Asian conference on computer vision. Springer, Cham, p 3–18

  • Fleuret F, Berclaz J, Lengagne R, Fua P (2008) Multicamera people tracking with a probabilistic occupancy map. IEEE Trans Pattern Anal Mach Intell 30(2):267–282

    Article  Google Scholar 

  • Geng X, Zhou ZH, Smith-Miles K (2008) Individual stable space: an approach to face recognition under uncontrolled conditions. IEEE Trans Neural Netw 19(8):1354–1368

    Article  Google Scholar 

  • Gu J, Ding X, Wang S, Wu Y (2010) Action and gait recognition from recovered 3-D human joints. IEEE Trans Syst Man Cybern B Cybern 40(4):1021–1033

    Article  Google Scholar 

  • Guha T, Ward R (2010) Differential radon transform for gait recognition. In: 2010 IEEE international conference on acoustics, speech and signal processing, p 834-837

  • Han J, Bhanu B (2006) Individual recognition using gait energy image. IEEE Trans PAMI 28(2):316–322

    Article  Google Scholar 

  • Jagna A (2014) An efficient image independent thinning algorithm. Int J Adv Res Comp Commun Eng 3(10):8309–8311

    Article  Google Scholar 

  • Ji S, Xu W, Yang M (2012) 3D convolutional neural networks for human action recognition. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/TPAMI.2012.59

    Article  Google Scholar 

  • Johansson G (1975) Visual motion perception. Sci Am 232:6

    Article  Google Scholar 

  • Kumar AN, Sureshkumar C (2013) Background subtraction based on threshold detection using modified k-means algorithm. In: 2013 international conference on pattern recognition, informatics and mobile engineering 2013. Doi: https://doi.org/10.1109/ICPRIME.2013.6496505

  • Kusakunniran W, Wu Q, Zhang J, Ma Y, Li H (2013) A new view-invariant feature for cross-view gait recognition. IEEE Trans Inf Forensics Secur 8(10):1642–1653

    Article  Google Scholar 

  • Lee J (2017) Analysis of precision and accuracy in a simple model of machine learning. J Korean Phys Soc 71(12):866–870

    Article  Google Scholar 

  • Lee H, Kim H, Kim JI (2016) Background subtraction using background sets with image-and color-space reduction. IEEE Trans Multimed 18(10):2093–2103. https://doi.org/10.1109/TMM.2016.2595262

    Article  MathSciNet  Google Scholar 

  • Lpuridas P, Ebert C (2016) Machine learning. IEEE Softw. https://doi.org/10.1109/MS.2016.114

    Article  Google Scholar 

  • Luo J, Lin S, Ni J, Lei M (2008) An improved fingerprint recognition algorithm using EBFNN. In: 2008 second international conference on genetic and evolutionary computing. IEEE conference, p 504-507

  • Manjunatha Guru VG, Kamalesh VN (2011) Vision based human gait recognition system: observations, pragmatic conditions and datasets. Indian J Sci Technol 8(15):71237

    Google Scholar 

  • Mittal A, Davis LS (2003) M 2 tracker: a multi-view approach to segmenting and tracking people in a cluttered scene. Int J Comp Vis 51(3):189–203

    Article  Google Scholar 

  • Mohamed SS, Tahir NM, Adnan R (2010) Background modelling and background subtraction performance for object detection. In: 2010 6th international colloquium on signal processing & its applications, Mallaca City, Mallaysia. Doi: https://doi.org/10.1109/CSPA.2010.5545291

  • Nithyakani P, Vinothini S, Ganapathy V (2017) Gait analysis for better prediction of silhouettes using wavelet transformation 116(23): 391–397. ISSN: 1311-8080 (printed version)

  • Nixon S, Tan T, Chellappa R (2006) Human identification based on gait. Springer, New York

    Book  Google Scholar 

  • Rathod VJ, Iyer NC, Meena SM (2015) “A survey on fingerprint biometric recognition system”. In: 2015 international conference on green computing and internet of things (ICGIoT)

  • Stevenage SV, Nixon MS, Vince K (1999) Visual analysis of gait as a cue to identity. Appl Cogn Psychol 13:513

    Article  Google Scholar 

  • Tathe SV, Narote SP (2013) Real-time human detection and tracking. In: 2013 annual IEEE India conference (INDICON) 2013, Mumbai, India

  • Vladimir M (2018) Petrovic, “artificial intelligence and virtual worlds—toward human-level AI agents.” IEEE. https://doi.org/10.1109/ACCESS.2018.2855970

    Article  Google Scholar 

  • Wang X (2013) Intelligent multi-camera video surveillance: a review. Pattern Recogn Lett 34(1):3–19

    Article  Google Scholar 

  • Wang L, Tan T, Ning H, Hu W (2003) Silhouette analysis-based gait recognition for human identification. IEEE Trans Pattern Anal Mach Intell 25(12):1505–1518

    Article  Google Scholar 

  • Wang L, Tan T, Hu W, Ning H (2003) Automatic gait recognition based on statistical shape analysis. IEEE Trans Image Process 12(9):1120–1131

    Article  MathSciNet  Google Scholar 

  • Wang C, Zhang J, Pu J, Yuan X, Wang L (2010) Chrono-gait image: a novel temporal template for gait recognition—ECCV. Springer, Berlin, pp 257–270

    Google Scholar 

  • Whittle MW (1996) Clinical gait analysis: a review. Human Mov Sci 15:369

    Article  Google Scholar 

  • Wu Z, Huang Y, Wang L, Wang X, Tan T (2016) A comprehensive study on cross-view gait based human identification with deep CNNs. IEEE Trans Pattern Anal Mach Intell 39(2):209–226

    Article  Google Scholar 

  • Yang M, Lv F, Xu W, Gong Y (2009) Detection driven adaptive multi-cue integration for multiple human tracking. In: 2009 IEEE 12th International Conference on Computer Vision, p 1554–1561

  • Yao G, Lei T, Zhong J, Jiang P, Jia W (2017) Comparative evaluation of background subtraction algorithm in remote scene video captured by MWIR. Sensors 17:1945. https://doi.org/10.3390/s17091945

    Article  Google Scholar 

  • Zhang Y, Yang N, Lio W, Wuo X, Ruan Q (2009) Gait recognition using procrustes shape analysis and shape context" in computer Vision ACCV. Springer, Berlin, pp 256–265

    Google Scholar 

  • Zhang S, Wang C, Chan SC, Wei X, Ho CH (2014) New object detection, tracking, and recognition approaches for video surveillance over camera network. IEEE Sens J 15(5):2679–2691

    Article  Google Scholar 

  • Zhang Y, Li X, Gao X, Zhang C (2016) A simple algorithm of superpixel segmentation with boundary constraint. IEEE Trans Circuits Syst Video Tech 27(7):1502–1514. https://doi.org/10.1109/TCSVT2016.2539839

    Article  Google Scholar 

  • Zheng S, Zhang J, Huang K, He R, Tan T (2011) Robust view transformation model for gait recognition. In: 2011 18th IEEE international conference on image processing (ICIP)

Download references

Acknowledgements

This research was supported by High Performance Computing Centre (HPCC), SRM Institute of Science and Technology for providing the computational facility for training, testing and obtaining the desired result. We thank Centre for Biometrics and Security Research (CASIA) for providing the dataset which consist of 15000+ video of 124 object walking in different angles.

Author information

Authors and Affiliations

  1. School of Computing, SRM Institute of Science and Technology, Kattankulathur, India

    P. Supraja

  2. Senior Engineer, Augusta Hitech Soft Solutions, Coimbatore, India

    Rijo Jackson Tom

  3. School of Computer Science and Engineering, The University of New South Wales, Sydney, Australia

    Ravi Shekhar Tiwari & V. Vijayakumar

  4. Computer Science Department, Director USC Machine Learning Centre, University of Southern California, Los Angeles, USA

    Yan Liu

Authors
  1. P. Supraja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rijo Jackson Tom
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ravi Shekhar Tiwari
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. V. Vijayakumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. Supraja.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Supraja, P., Tom, R.J., Tiwari, R.S. et al. 3D convolution neural network-based person identification using gait cycles. Evolving Systems 12, 1045–1056 (2021). https://doi.org/10.1007/s12530-021-09397-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12530-021-09397-y

Keywords

Search

Navigation