Skip to main content
SpringerLink
Log in

Multi-level features fusion and selection for human gait recognition: an optimized framework of Bayesian model and binomial distribution

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

A biometric classification system is utilized to judge the features of human expression by recognizing distinct parameters. Human Gait Recognition (HGR) is a current research area which is mostly used for various security applications such as video surveillance etc. HGR is also utilized in medical imaging for the investigation of several diseases such as Parkinson disease which is identified by gait features. Still, various challenges occur in this domain that affects system accuracies such as shoe type, change in angle, load carriage and change in walking speed. In this research, a new approach for HGR is proposed which is based on Quartile Deviation of Normal Distribution (QDoND) for human extraction and Bayesian model along with Binomial Distribution for features fusion and best features selection. Initially, in the pre-processing step, the most excellent channel is selected and its motion flow is estimated. The motion regions are extracted by QDoND that are later utilized for shape and texture feature extraction. Afterward, the extracted features are fused by a Bayesian model based on their similarity index. Finally, BDs based best features are selected and recognition is performed on the basis of best features using multi-class support vector machine. Four publicly and famous datasets are utilized for the evaluation of proposed system such as AVA multi-view gait (AVAMVG), CASIA A, CASIA B and CASIA C having an accuracy rate of 100%, 98.8%, 87.7%, and 91.6% respectively. The results reveal that the proposed method outperforms in contrast to existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Akram T, Khan MA, Sharif M, Yasmin M (2018) Skin lesion segmentation and recognition using multichannel saliency estimation and M-SVM on selected serially fused features. J Amb Intell Hum Comput 2018:1–20

    Google Scholar 

  2. Al-Tayyan A, Assaleh K, Shanableh T (2017) Decision-level fusion for single-view gait recognition with various carrying and clothing conditions. Image Vis Comput 61:54–69

    Article  Google Scholar 

  3. Alotaibi M, Mahmood A (2017) Reducing covariate factors of gait recognition using feature selection and dictionary-based sparse coding. SIViP 11(6):1131–1138

    Article  Google Scholar 

  4. Arora P, Hanmandlu M, Srivastava S (2015) Gait based authentication using gait information image features. Pattern Recogn Lett 68:336–342

    Article  Google Scholar 

  5. Barron J, Fleet DJ, Beauchemin SS, Burkitt TA (1992) Performance of optical flow techniques. In: CVPR

  6. Batchuluun G, Naqvi RA, Kim W, Park KR (2018) Body-movement-based human identification using convolutional neural network. Expert Syst Appl 101:56–77

    Article  Google Scholar 

  7. Binsaadoon AG, El-Alfy E-SM (2016) Kernel-based fuzzy local binary pattern for gait recognition. In: Modelling symposium (EMS), 2016, European, IEEE

  8. Castro FM, Marín-Jimenez MJ, Medina-Carnicer R (2014) Pyramidal fisher motion for multiview gait recognition. In: Pattern recognition (ICPR), 2014 22nd international conference on, IEEE

  9. Chaurasia P, Yogarajah P, Condell J, Prasad G (2017) Fusion of random walk and discrete Fourier spectrum methods for gait recognition. IEEE Trans Hum Mach Syst 47(6):751–762

    Article  Google Scholar 

  10. Chhatrala R, Jadhav DV (2016) Multilinear Laplacian discriminant analysis for gait recognition. IET Comput Vis 11(2):153–160

    Article  Google Scholar 

  11. Choudhury SD, Tjahjadi T (2016) Clothing and carrying condition invariant gait recognition based on rotation forest. Pattern Recogn Lett 80:1–7

    Article  Google Scholar 

  12. Dadashi F, Araabi BN, Soltanian-Zadeh H (2009) Gait recognition using wavelet packet silhouette representation and transductive support vector machines. In: Image signal processing, 2009. CISP’09. 2nd international congress on, IEEE

  13. DeCann B, Ross A (2010) Gait curves for human recognition, backpack detection, and silhouette correction in a nighttime environment. In: Biometric technology for human identification VII, international society for optics and photonics

  14. Deng M, Wang C, Cheng F, Zeng W (2017) Fusion of spatial-temporal and kinematic features for gait recognition with deterministic learning. Pattern Recogn 67:186–200

    Article  Google Scholar 

  15. El-Alfy H, Mitsugami I, Yagi Y (2017) Gait recognition based on normal distance maps. IEEE Trans Cybern 48:1526–1539

    Google Scholar 

  16. Geng X, Wang L, Li M, Wu Q, Smith-Miles K (2007) Distance-driven fusion of gait and face for human identification in video. In: Image and vision computing conference, image and vision computing New Zealand

  17. George AS, Roy E, Antony A, Job M (2017) An efficient gait recognition system for human identification using neural networks. Int J Innov Adv Comput Sci 6:76–83

    Google Scholar 

  18. Huang C-C, Hsu C-C, Liao H-Y, Yang S-H, Wang L-L, Chen S-Y (2016) Frontal gait recognition based on spatio-temporal interest points. J Chin Inst Eng 39(8):997–1002

    Article  Google Scholar 

  19. Khan MA, Akram T, Sharif M, Awais M, Javed K, Ali H, Saba T (2018) CCDF: automatic system for segmentation and recognition of fruit crops diseases based on correlation coefficient and deep CNN features. Comput Electron Agric 155:220–236

    Article  Google Scholar 

  20. Khan MA, Akram T, Sharif M, Javed MY, Muhammad N, Yasmin M (2018) An implementation of optimized framework for action classification using multilayers neural network on selected fused features. Pattern Anal Appl 2018:1–21

    Google Scholar 

  21. Khan MA, Sharif M, Javed MY, Akram T, Yasmin M, Saba T (2017) License number plate recognition system using entropy-based features selection approach with SVM. IET Image Proc 12(2):200–209

    Article  Google Scholar 

  22. Khan MH, Li F, Farid MS, Grzegorzek M (2017) Gait recognition using motion trajectory analysis. In: International conference on computer recognition systems. Springer, Berlin

    Google Scholar 

  23. Kumar HM, Nagendraswamy H (2014) LBP for gait recognition: a symbolic approach based on GEI plus RBL of GEI. In: Electronics and communication systems (ICECS), 2014 international conference on, IEEE

  24. Kusakunniran W, Wu Q, Zhang J, Li H (2011) Pairwise shape configuration-based psa for gait recognition under small viewing angle change. In: Advanced video and signal-based surveillance (AVSS), 2011 8th IEEE international conference on, IEEE

  25. Kusakunniran W, Wu Q, Zhang J, Li H (2012) Gait recognition across various walking speeds using higher order shape configuration based on a differential composition model. IEEE Trans Syst Man Cybern Part B (Cybernetics) 42(6):1654–1668

    Article  Google Scholar 

  26. Lee H, Hong S, Kim E (2008) An efficient gait recognition based on a selective neural network ensemble. Int J Imaging Syst Technol 18(4):237–241

    Article  Google Scholar 

  27. Liao R, Cao C, Garcia EB, Yu S, Huang Y (2017) Pose-based temporal-spatial network (PTSN) for gait recognition with carrying and clothing variations. In: Chinese conference on biometric recognition. Springer, Berlin

    Google Scholar 

  28. Liaqat A, Khan MA, Shah JH, Sharif M, Yasmin M, Fernandes SL (2018) Automated ulcer and bleeding classification from WCE images using multiple features fusion and selection. J Mech Med Biol 18:50038

    Article  Google Scholar 

  29. Liu L-F, Jia W, Zhu Y-H (2009) Gait recognition using hough transform and principal component analysis. In: International conference on intelligent computing. Springer, Berlin

    Google Scholar 

  30. López-Fernández D, Madrid-Cuevas F, Carmona-Poyato A, Marín-Jiménez M, Salinas MR (2013) The AVA multi-view dataset for gait recognition (AVAMVG). In: 2nd workshop activity monitoring by multiple distributed sensing (AMMDS). ICPR

  31. López-Fernández D, Madrid-Cuevas FJ, Carmona-Poyato Á, Marín-Jiménez MJ, Muñoz-Salinas R (2014) The AVA multi-view dataset for gait recognition. In: International workshop on activity monitoring by multiple distributed sensing. Springer, Berlin

    Google Scholar 

  32. López-Fernández D, Madrid-Cuevas FJ, Carmona-Poyato A, Marín-Jiménez MJ, Muñoz-Salinas R, Medina-Carnicer R (2016) independent gait recognition through morphological descriptions of 3D human reconstructions. Image Vis Comput 48:1–13

    Article  Google Scholar 

  33. López-Fernández D, Madrid-Cuevas FJ, Carmona-Poyato A, Muñoz-Salinas R, Medina-Carnicer R (2015) Entropy volumes for viewpoint-independent gait recognition. Mach Vis Appl 26(7–8):1079–1094

    Article  Google Scholar 

  34. López-Fernández D, Madrid-Cuevas FJ, Carmona-Poyato A, Muñoz-Salinas R, Medina-Carnicer R (2016) A new approach for multi-view gait recognition on unconstrained paths. J Vis Commun Image Represent 38:396–406

    Article  Google Scholar 

  35. Ma S, Ma H, Xu Y, Li S, Lv C, Zhu M (2018) “A Low-Light Sensor Image Enhancement Algorithm Based on HSI Color Model. " Sensors 18(10):3583

    Article  Google Scholar 

  36. Marín-Jiménez MJ, Castro FM, Carmona-Poyato Á, Guil N (2015) On how to improve tracklet-based gait recognition systems. Pattern Recogn Lett 68:103–110

    Article  Google Scholar 

  37. Martinez-Hernandez U, Dehghani-Sanij AA (2018) Adaptive Bayesian inference system for recognition of walking activities and prediction of gait events using wearable sensors. Neural Netw 102:107–119

    Article  Google Scholar 

  38. Mogan JN, Lee CP, Lim KM, Tan AW (2017) Gait recognition using binarized statistical image features and histograms of oriented gradients. In: Robotics, automation and sciences (ICORAS), 2017 international conference on, IEEE

  39. Mogan JN, Lee CP, Tan AW (2017) Gait recognition using temporal gradient patterns. In: Information and communication technology (ICoIC7), 2017 5th international conference on, IEEE

  40. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59

    Article  Google Scholar 

  41. Ortells J, Mollineda RA, Mederos B, Martín-Félez R (2017) Gait recognition from corrupted silhouettes: a robust statistical approach. Mach Vis Appl 28(1–2):15–33

    Article  Google Scholar 

  42. Portillo-Portillo J, Leyva R, Sanchez V, Sanchez-Perez G, Perez-Meana H, Olivares-Mercado J, Toscano-Medina K, Nakano-Miyatake M (2018) A view-invariant gait recognition algorithm based on a joint-direct linear discriminant analysis. Appl Intell 48(5):1200–1217

    Google Scholar 

  43. Raza M, Sharif M, Yasmin M, Khan MA, Saba T, Fernandes SL (2018) Appearance based pedestrians’ gender recognition by employing stacked auto encoders in deep learning. Future Gen Comput Syst 88:28–39

    Article  Google Scholar 

  44. Rida I, Bouridane A, Marcialis GL, Tuveri P (2015) Improved human gait recognition. In: International conference on image analysis and processing. Springer, Berlin

    Google Scholar 

  45. Shaikh SH, Saeed K, Chaki N (2014) Gait recognition using partial silhouette-based approach. In: Signal processing and integrated networks (SPIN), 2014 international conference on, IEEE

  46. Sharif M, Khan MA, Faisal M, Yasmin M, Fernandes SL (2018) A framework for offline signature verification system: best features selection approach. Pattern Recogn Lett. https://doi.org/10.1016/j.patrec.2018.01.021

    Article  Google Scholar 

  47. Sharif M, Khan MA, Rashid M, Yasmin M, Afza F, Tanik UJ (2018) Deep CNN and geometric features-based gastrointestinal tract diseases detection and classification from wireless capsule endoscopy images. J Exp Theor Artif Intell. https://doi.org/10.1080/0952813X.2019.1572657

    Article  Google Scholar 

  48. Sharif M, Tanvir U, Munir EU, Khan MA, Yasmin M (2018) Brain tumor segmentation and classification by improved binomial thresholding and multi-features selection. J Amb Intell Hum Comput 2018:1–20

    Google Scholar 

  49. Siddiqui S, Khan MA, Bashir K, Sharif M, Azam F, Javed MY (2018) Human action recognition: a construction of codebook by discriminative features selection approach. Int J Appl Pattern Recogn 5(3):206–228

    Article  Google Scholar 

  50. Sokolova A, Konushin A (2017) Pose-based deep gait recognition. arXiv preprint arXiv:1710.06512

  51. Tan D, Huang K, Yu S, Tan T (2006) Efficient night gait recognition based on template matching. In: Pattern recognition, 2006. ICPR 2006. 18th international conference on, IEEE

  52. Tan D, Huang K, Yu S, Tan T (2007) Orthogonal diagonal projections for gait recognition. In: Image processing, 2007. In: ICIP 2007. IEEE international conference on, IEEE

  53. Tan D, Huang K, Yu S, Tan T (2007) Uniprojective features for gait recognition. In: International conference on biometrics. Springer, Berlin

    Google Scholar 

  54. Tan D, Yu S, Huang K, Tan T (2007) Walker recognition without gait cycle estimation. In: International conference on biometrics. Springer, Berlin

    Google Scholar 

  55. Wang L, Tan T, Ning H, Hu W (2003) Silhouette analysis-based gait recognition for human identification. IEEE Trans Pattern Anal Mach Intell 25(12):1505–1518

    Article  Google Scholar 

  56. Wang Y, Shi F, Cao L, Dey N, Wu Q, Ashour AS, Sherratt S, Rajinikanth V, Wu L (2018) Morphological segmentation analysis and texture-based support vector machines classification on mice liver fibrosis microscopic images. Curr Bioinform. https://doi.org/10.2174/1574893614666190304125221

    Article  Google Scholar 

  57. Wu Q, Wang L, Geng X, Li M, He S (2007) Dynamic biometrics fusion at feature level for video-based human recognition. In: Image and vision computing conference, image and vision computing New Zealand

  58. Xue Z, Li SZ, Lu J, Teoh EK (2000) Bayesian model for extracting facial features. In: Sixth international conference on control, automation, robotics & Vision, ICARCV 2000, Dec., Singapore

  59. Yu S, Chen H, Wang Q, Shen L, Huang Y (2017) Invariant feature extraction for gait recognition using only one uniform model. Neurocomputing 239:81–93

    Article  Google Scholar 

  60. Yu S, Tan D, Tan T (2006) A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. In: Pattern recognition, 2006. ICPR 2006. 18th international conference on, IEEE

  61. Zeng W, Wang C (2016) View-invariant gait recognition via deterministic learning. Neurocomputing 175:324–335

    Article  Google Scholar 

  62. Zhang E, Zhao Y, Xiong W (2010) Active energy image plus 2DLPP for gait recognition. Sig Process 90(7):2295–2302

    Article  MATH  Google Scholar 

  63. Zhou N, Wang Y, Gong L, He H, Wu J (2011) Novel single-channel color image encryption algorithm based on chaos and fractional Fourier transform. Opt Commun 284(12):2789–2796

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, COMSATS University Islamabad, Wah Campus, Islamabad, Pakistan

    Habiba Arshad, Muhammad Sharif & Mussarat Yasmin

  2. Department of Computer Science and Engineering, HITEC University, Museum Road, Taxila, Pakistan

    Muhammad Attique Khan & Muhammad Younus Javed

Authors
  1. Habiba Arshad
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Attique Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad Sharif
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mussarat Yasmin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muhammad Younus Javed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Attique Khan.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Arshad, H., Khan, M.A., Sharif, M. et al. Multi-level features fusion and selection for human gait recognition: an optimized framework of Bayesian model and binomial distribution. Int. J. Mach. Learn. & Cyber. 10, 3601–3618 (2019). https://doi.org/10.1007/s13042-019-00947-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-019-00947-0

Keywords

Search

Navigation