Abstract
In this paper we propose a novel multimodal Bayesian approach based on PCA-LDA processing for person identification from low resolution surveillance video with cues extracted from gait and face biometrics. The experimental evaluation of the proposed scheme on a publicly available database [2] showed that the combined PCA-LDA face and gait features can lead to powerful identity verification and can capture the inherent multimodality in walking gait patterns and discriminate the identity from low resolution surveillance videos.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Murray, M.P., Drought, A.B., Kory, R.C.: Walking pattern of movement. American Journal of Medicine 46(1), 290–332 (1967)
Schuldt, C., Laptev, I., Caputo, B.: Recognizing Human Actions: A Local SVM Approach. In: Proceedings ICPR (2004)
Bringer, J., Chabanne, H.: Biometric Identification Paradigm Towards Privacy and Confidentiality Protection. In: Nichols, E.R. (ed.) Biometric: Theory, Application and Issues, pp. 123–141 (2011)
Zhao, W.-Y., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face Recognition: A Literature Survey. ACM Computing Surveys 35, 399–458 (2003)
Cox, I.J., Ghosn, J., Yianilos, P.N.: Feature-based face recognition using mixture-distance. In: Proc. IEEE Conf. CVPR, pp. 209–216 (1996)
Wiskott, L., Fellous, J.M., Kruger, N., Malsburg, C.V.D.: Face Recognition by Elastic Bunch Graph Matching. IEEE Trans. on Pattern Analysis and Machine Intelligence 19, 775–779 (1997)
Turk, M., Pentland, A.: Eigenfaces For Recognition. J. Cognitive Neuroscience 3, 71–86 (1991)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Pattern Analysis and Machine Intelligence 19, 711–720 (1997)
Zhou, S., Chellappa, R.: Beyond a single still image: Face recognition from multiple still images and videos. In: Face Processing: Advanced Modeling and Methods. Academic Press (2005)
Bowyer, K.W., Chang, K., Flynn, P.J.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Computer Vision and Image Understanding 101, 1–15 (2006)
Kong, S.G., et al.: Recent advances in visual and infrared face recognition - a review. Computer Vision and Image Understanding 97, 103–135 (2005)
Ross, A., Jain, A.K.: Information fusion in biometrics. Pattern Recognition Letters 24, 2115–2125 (2003)
Jain, A.K., Hong, L., Kulkarni, Y.: A multimodal biometric system using fingerprints, face and speech. In: 2nd Int’l Conf. AVBPA, pp. 182–187 (1999)
Wang, Y., Tan, T., Jain, A.K.: Combining face and iris biometrics for identity verification. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 805–813. Springer, Heidelberg (2003)
Chang, K., Bowyer, K.W., Sarkar, S.: Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics. IEEE Trans. PAMI 25, 1160–1165 (2003)
Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20, 226–239 (1998)
Chetty, G., White, M.: Multimedia Sensor Fusion for Retrieving Identity in Biometric Access Control Systems. ACM Transaction on Multimedia Computing, Communications and Applications (Special Issue on Sensor Fusion) (2010)
Chetty, G., Wagner, M.: Robust face-voice based speaker identity verification using multilevel fusion. Image and Vision Computing 26, 1249–1260 (2008)
Zhou, X., Bhanu, B.: Feature fusion of side face and gait for video-based human identification. In: 2007 Pattern Recognition Society. Elsevier (2007)
Hossain, S.M.E., Chetty, G.: Next Generation Identity Verification Based on Face-Gait Biometrics. In: International Conference on Biomedical Engineering and Technology, IPCBEE, vol. 11 (2011)
Chakraborthy, R., Rengamani, H., Kumaraguru, P., Rao, R.: The UID Project: Lessons Learned from the Waste and Challenges Identified for India. Cyber Security, Cyber Crime and Cyber Forensics: Application and Perspective (2011)
Bringer, J., Chabanne, H.: Biometric Identification Paradigm Towards Privacy and Confidentiality Protection. In: Nichols, E.R. (ed.) Biometric: Theory, Application and Issues, pp. 123–141 (2011)
Schuckers, M.E.: Bayesian Method Computational Methods in Biometric Authentication: Statistical Method for performance evolution. Springer, London Limited (2010)
Cunningham, P., Delany, S.J.: k-Nearest Neighbor Classifiers, University College Dublin, Padraig.Cunningham@ucd.ie Dublin Institute of Technology Sarahjane.Delany@comp.dit.ie Technical Report UCD-CSI-2007-4 (2007)
Smith, L.I.: A tutorial on Principal Components Analysis (2002)
Sergios, T., Konstantinos, K.: Pattern Recognition. Academic Press (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hossain, E., Chetty, G. (2011). Multimodal Identity Verification Based on Learning Face and Gait Cues. In: Lu, BL., Zhang, L., Kwok, J. (eds) Neural Information Processing. ICONIP 2011. Lecture Notes in Computer Science, vol 7064. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24965-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-24965-5_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24964-8
Online ISBN: 978-3-642-24965-5
eBook Packages: Computer ScienceComputer Science (R0)