Abstract
Research on biometric methods has gained momentum due to the increase in security concerns. Face and gait biometrics are two biometrics that are safe and non-invasive in nature and can be captured without the knowledge of the person. These two biometric can be easily used in surveillance applications. This paper presents a multimodal biometrics system based on face and gait based on principal component analysis (PCA) along with a simplified deep neural network (S-DNN). In the S-DNN analysis, cross entropy instead of Euclidean distance is considered. In the proposed method, PCA is used for feature extraction, and for the re-construction of faces, in place of inverse PCA, an artificial neural network is considered to improve the accuracy. The combination of PCA and ANN is separately used for both the biometrics and the matching score for each biometric identifier is obtained. Finally, the softmax function is used for the fusion of matching scores to get the final matching score. The main advantages of the proposed methodology are higher accuracy (99.51%) and very little processing time.
Similar content being viewed by others
References
Bolle RuudM, Connell JH, Pankanti S, Ratha NK, Senior AW (2013) Guide to biometrics. Springer Science & Business Media, Berlin
Ahmed B (2009) Imaging for forensics and security: from theory to practice. ISBN-0387095322.
Jain AK, Kumar A (2010) Biometrics of next generation: an overview. Second Gen Biometr 12(1):2–3
Campisi P (2013) Security and privacy in biometrics, vol 24. Springer, London
Datta P, Bhardwaj S, Panda SN, Tanwar S, Badotra S (2020) Survey of security and privacy issues on biometric system. Handbook of computer networks and cyber security. Springer, Berlin, pp 763–776
Newman R (2009) Security and access control using biometric technologies. Cengage Learn 2:2
Wang L, Ning H, Tan T, Weiming Hu (2004) Fusion of static and dynamic body biometrics for gait recognition. IEEE Trans Circuits Syst Video Technol 14(2):149–158
Dantcheva A, Elia P, Ross A (2015) What else does your biometric data reveal? A survey on soft biometrics. IEEE Trans Inf Forensics Secur 11(3):441–467
Bouchrika I, Goffredo M, Carter J, Nixon M (2011) On using gait in forensic biometrics. J Forensic Sci 56(4):882–889
Kondapi L, Ajita R, Reza D (2019) Cross-illumination evaluation of hand crafted and deep features for fusion of selfie face and ocular biometrics. In: 2019 IEEE International Symposium on Technologies for Homeland Security (HST), pp 1–4
Xin Y, Kong L, Liu Z, Wang C, Zhu H, Gao M, Zhao C, Xiaoke Xu (2018) Multimodal feature-level fusion for biometrics identification system on IoMT platform. IEEE Access 6:21418–21426
Patterh MS (2017) A biometric fusion based on face and fingerprint recognition using ANN. Int J Recent Innov Trends Comput Commun 5(8):88–92
Chanukya PSVVN, Thivakaran TK (2020) Multimodal biometric cryptosystem for human authentication using fingerprint and ear. Multimed Tools Appl 79(1):659–673
Xing X, Wang K, Lv Z (2015) Fusion of gait and facial features using coupled projections for people identification at a distance. IEEE Signal Process Lett 22(12):2349–2353
Azom V, Aderemi A, Jules-Raymond T (2015) Face and Iris biometrics person identification using hybrid fusion at feature and score-level. In: 2015 Pattern Recognition Association of South Africa and Robotics and Mechatronics International Conference (PRASA-RobMech), pp. 207–212
Toygar Ö, Alqaralleh E, Afaneh A (2018) Symmetric ear and profile face fusion for identical twins and non-twins recognition. SIViP 12(6):1157–1164
Sharifi O, Eskandari M (2016) Optimal face-iris multimodal fusion scheme. Symmetry 8(6):48
Meena K, Malarvizhi N (2016) An efficient human identification through multimodal biometric system. Braz Arch Biol Technol 59:3
Manssor SAF, Shaoyuan S, Mohammed AME (2021) Real-time human recognition at night via integrated face and gait recognition technologies. Sensors 21(13):4323
Minaee S, Amirali A, Hang S, Mohammed B, David Z (2019) Biometrics recognition using deep learning: a survey. arXiv preprint arXiv:1912.00271
Talreja V, Valenti MC, Nasrabadi N (2017) Multibiometric secure system based on deep learning. In: 2017 IEEE Global conference on signal and information processing (globalSIP), pp 298–302
Zhang Qi, Li H, Sun Z, Tan T (2018) Deep feature fusion for iris and periocular biometrics on mobile devices. IEEE Trans Inf Forensics Secur 13(11):2897–2912
Umer S, Sardar A, Dhara BC, Rout RK, Pandey HM (2020) Person identification using fusion of iris and periocular deep features. Neural Netw 122:407–419
Jomaa M, Rami HM, Bazi Y, Islam MS (2020) End-to-end deep learning fusion of fingerprint and electrocardiogram signals for presentation attack detection. Sensors 20(7):2085
Tiong LCO, Kim ST, Ro YM (2019) Implementation of multimodal biometric recognition via multi-feature deep learning networks and feature fusion. Multimed Tools Appl 78(16):22743–22772
Huang Yi, Dong Xu, Nie F (2012) Patch distribution compatible semisupervised dimension reduction for face and human gait recognition. IEEE Trans Circuits Syst Video Technol 22(3):479–488
El-Alfy EM., BinMakhashen GM (2012) Improved personal identification using face and hand geometry fusion and support vector machines. In: International Conference on Networked Digital Technologies. Springer, Berlin, pp 253–261
Gawande U, Zaveri M, Kapur A (2013) A novel algorithm for feature level fusion using SVM classifier for multibiometrics-based person identification. Appl Comput Intell Soft Comput 20:13
Kant C (2015) A multimodal approach to improve the performance of biometric system. BVICA M’s Int J Inform Technol 7(2):891
Punyani P, Gupta R, Kumar A (2022) A multimodal biometric system using match score and decision level fusion. Int J Inf Technol 14(2):725–730
Farooq H, Naaz S (2020) Performance analysis of biometric recognition system based on palmprint. Int J Inf Technol 12(4):1281–1289
Patil P, Jagtap S (2020) Multi-modal biometric system using finger knuckle image and retina image with template security using PolyU and DRIVE database. Int J Inf Technol 12(4):1043–1050
Wang X, Feng S, Yan WQ (2019) Human gait recognition based on self-adaptive hidden Markov model. IEEE/ACM Trans Comput Biol Bioinform 18(3):963–972
Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86
Sarkar S, Jonathon Phillips P, Liu Z, Vega IR, Grother P, Bowyer KW (2005) The humanid gait challenge problem: Data sets, performance, and analysis. IEEE Trans Pattern Anal Mach Intell 27(2):162–177
Zhang Z, Xuecai Yu, You F, Siedel G, He W, Yang L (2015) A front vehicle detection algorithm for intelligent vehicle based on improved gabor filter and SVM. Recent Patents Comput Sci 8(1):32–40
Khan S, Hussain M, Aboalsamh H, Bebis G (2017) A comparison of different Gabor feature extraction approaches for mass classification in mammography. Multimed Tools Appl 76(1):33–57
Tao D, Li X, Xindong Wu, Maybank SJ (2007) General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans Pattern Anal Mach Intell 29(10):1700–1715
Zhou T, Wang Y, Wang C-X, Salous S, Liu L, Tao C (2020) Multi-feature fusion based recognition and relevance analysis of propagation scenes for high-speed railway channels. IEEE Trans Veh Technol 69(8):8107–8118
Maity S, Abdel-Mottaleb M, Asfour SS (2021) Multimodal low resolution face and frontal gait recognition from surveillance video. Electronics 10(9):1013
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kumar, A., Jain, S. & Kumar, M. Face and gait biometrics authentication system based on simplified deep neural networks. Int. j. inf. tecnol. 15, 1005–1014 (2023). https://doi.org/10.1007/s41870-022-01087-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41870-022-01087-5