Abstract
Human recognition from arbitrary views is an important task for many applications, such as visual surveillance, covert security and access control. It has been found to be difficult in reality, especially when a person is walking at a distance in real-world outdoor conditions. For optimal performance, the system should use as much information as possible from the observations. In this chapter, we introduce a video based system which combines cues of face profile and gait silhouette from the single camera video sequences. It is difficult to get reliable face profile information directly from a low-resolution video frame because of limited resolution. To overcome this problem, we first construct a high-resolution face profile image from multiple adjacent low-resolution frames for each video sequence. Then, we extract face features from the high-resolution profile image. Finally, dynamic time warping (DTW) is used as the matching method to compute the similarity of two face profiles based on the absolute values of curvature. For gait, we use gait energy image (GEI), a spatio-temporal compact representation, to characterize human walking properties. Gait recognition is carried out based on the direct GEI matching. Several schemes are considered for fusion of face profile and gait. A number of dynamic video sequences are tested to evaluate the performance of our system. Experimental results are compared and discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akimoto, T., Suenaga, Y., Wallace, R.S.: Automatic creation of 3d facial models. IEEE Trans. Comput. Graph. Appl. 13, 16–22 (1993)
Bhanu, B., Zhou, X.: Face recognition from face profile using dynamic time warping. In: Proceedings of International Conference on Pattern Recognition, vol. 4, pp. 499–502 (2004)
Campos, J.C., Linney, A.D., Moss, J.P.: The analysis of facial profiles using scale space techniques. Pattern Recognit. 26, 819–824 (1993)
Dariush, B., Kang, S.B., Waters, K.: Spatiotemporal analysis of face profiles: detection, segmentation, and registration. In: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, pp. 248–253 (1998)
Galton, F.: Numeralised profiles for classification and recognition. Nature 83, 127–130 (1910)
Han, J., Bhanu, B.: Performance prediction for individual recognition by gait. Pattern Recognit. Lett. 26(5), 615–624 (2005)
Han, J., Bhanu, B.: Individual recognition using gait energy image. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 316–322 (2006)
Harmon, L.D., Hunt, W.F.: Automatic recognition of human face profiles. Comput. Graph. Image Process. 6, 135–156 (1977)
Harmon, L.D., Khan, M.K., Lasch, R., Ramig, P.F.: Machine identification of human faces. Pattern Recognit. 13, 97–110 (1981)
Hewitt, P.A., Dobberfuhl, D.: The science and art of proportionality. Sci. Scope 27, 30–31 (2004)
Irani, M., Peleg, S.: Motion analysis for image enhancement: resolution, occlusion, and transparency. J. Vis. Commun. Image Represent 4, 324–335 (1993)
Kale, A., Roy-chowdhury, A., Chellappa, R.: Fusion of gait and face for human identification. In: Proceedings of Acoustics, Speech, and Signal Processing, vol. 5, pp. 901–904 (2004)
Keogh, E.: Exact indexing of dynamic time warping. In: Proceedings of Conference on Very Large Data Bases (2002)
Kittler, J., Hatef, M., Duin, R., Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20(3), 226–239 (1998)
Needleman, S.B., Wunsch, C.D.: A general method applicable to the search for similarities in the amino acid sequences of two proteins. J. Mol. Biol. 48, 443–453 (1977)
O’Mara, D.: Automated facial metrology. PhD Thesis, The University of Western Australia
Shakhnarovich, G., Darrell, T.: On probabilistic combination of face and gait cues for identification. In: Proceedings of Automatic Face and Gesture Recognition, vol. 5, pp. 169–174 (2002)
Shakhnarovich, G., Lee, L., Darrell, T.: Integrated face and gait recognition from multiple views. In: Proceedings of IEEE Workshop on Visual Motion, vol. 1, pp. 439–446 (2001)
Tsai, R.Y., Huang, T.S.: Multiframe Image Restoration and Registration, vol. 1. JAI Press, London (1984)
Zhou, X., Bhanu, B., Han, J.: Human recognition at a distance in video by integrating face profile and gait. In: Proceedings of Audio- and Video-Based Biometric Person Authentication, pp. 533–543 (2005)
Zuev, Y., Ivanon, S.: The voting as a way to increase the decision reliability. J. Franklin Inst. 336(2), 361–378 (1999)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2010 Springer-Verlag London Limited
About this chapter
Cite this chapter
Bhanu, B., Han, J. (2010). Integrating Face Profile and Gait at a Distance. In: Human Recognition at a Distance in Video. Advances in Pattern Recognition. Springer, London. https://doi.org/10.1007/978-0-85729-124-0_9
Download citation
DOI: https://doi.org/10.1007/978-0-85729-124-0_9
Publisher Name: Springer, London
Print ISBN: 978-0-85729-123-3
Online ISBN: 978-0-85729-124-0
eBook Packages: Computer ScienceComputer Science (R0)