Abstract
In order to analyse surveillance video, we need to efficiently explore large datasets containing videos of walking humans. At survei llance-image resolution, the human walk (their gait) can be determined automatically, and more readily than other features such as the face. Effective analysis of such data relies on retrieval of video data which has been enriched using semantic annotations. A manual annotation process is time-consuming and prone to error due to subject bias. We explore the content-based retrieval of videos containing walking subjects, using semantic queries. We evaluate current biometric research using gait, unique in its effectiveness at recognising people at a distance. We introduce a set of semantic traits discernible by humans at a distance, outlining their psychological validity. Working under the premise that similarity of the chosen gait signature implies similarity of certain semantic traits we perform a set of semantic retrieval experiments using popular latent semantic analysis techniques from the information retrieval community.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aggarwal, J.K., Cai, Q.: Human motion analysis: A review. Computer Vision and Image Understanding: CVIU 73(3), 428–440 (1999)
Barbujani, G.: Human races: Classifying people vs understanding diversity. Current Genomics 6, 215–226 (2005)
BenAbdelkader, C., Cutler, R., Davis, L.: Stride and cadence as a biometric in automatic person identification and verification. In: Proc. 5th IEEEFG, pp. 372–377 (May 2002)
Bennetto, J.: Big brother britain 2006: we are waking up to a surveillance society all around us. The Independant (2006)
Bertillon, A.: Signaletic Instructions including the theory and practice of Anthropometrical Identification. The Werner Company (1896)
Chapman, G.B., Johnson, E.J.: Incorporating the irrelevant: Anchors in judgments of belief and value. In: Heuristics and Biases: The Psychology of Intuitive Judgment, pp. 120–138. Cambridge University Press, Cambridge (2002)
Davies, A., Velastin, S.: A Progress Review of Intelligent CCTV Surveillance Systems. In: IEEEIDAACS 2005., pp. 417–423 (September 2005)
Dawes, R.M.: Suppose We Measured Height With Rating Scales Instead of Rulers. App. Psych. Meas. 1(2), 267–273 (1977)
Deerwester, S.C., Dumais, S.T., Landauer, T.K., Furnas, G.W., Harshman, R.A.: Indexing by latent semantic analysis. J. of the American Society of Information Science 41(6), 391–407 (1990)
Ellis, H.D.: Practical aspects of facial memory. In: Eyewitness Testimony: Psychological perspectives, section 2, pp. 12–37. Cambridge University Press, Cambridge (1984)
Flin, R.H., Shepherd, J.W.: Tall stories: Eyewitnesses ability to estimate height and weight characteristics. Human Learning, 5 (1986)
Gould, S.J.: The Geometer of Race. Discover, pp. 65–69 (1994)
Han, J., Bhanu, B.: Statistical feature fusion for gait-based human recognition. In: Proc. IEEE CVPR 2004, vol. 2 , II–pp. 842–II–847 (June-July 2, 2004)
Hare, J.S., Lewis, P.H., Enser, P.G.B., Sandom, C.J.: A linear-algebraic technique with an application in semantic image retrieval. In: Sundaram, H., Naphade, M., Smith, J.R., Rui, Y. (eds.) CIVR 2006. LNCS, vol. 4071, pp. 31–40. Springer, Heidelberg (2006)
Hayfron-Acquah, J.B., Nixon, M.S., Carter, J.N.: Automatic Gait Recognition by Symmetry Analysis. Pattern Recognition Letters 24(13), 2175–2183 (2003)
Hu, W., Tan, T., Wang, L., Maybank, S.: A survey on visual surveillance of object motion and behaviors. IEEETSMC(A) 34(3), 334–352 (2004)
Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. Trans. CSVT 14, 4–19 (2004)
Johansson, G.: Visual perception of biological motion and a model for its analysis. Percept. Phychophys. 14(2), 201–211 (1973)
Koppen, P.V., Lochun, S.K.: Portraying perpetrators; the validity of offender descriptions by witnesses. Law and Human Behavior 21(6), 662–685 (1997)
Landauer, T., Littman, M.: Fully automatic cross-language document retrieval using latent semantic indexing. In: 6th Annual Conference of the UW Centre for the New OED, pp. 31–38 (1990)
Li, X., Maybank, S., Yan, S., Tao, D., Xu, D.: Gait components and their application to gender recognition. IEEETSMC(C) 38(2), 145–155 (2008)
Lindsay, R., Martin, R., Webber, L.: Default values in eyewitness descriptions. Law and Human Behavior 18(5), 527–541 (1994)
Little, J., Boyd, J.: Describing motion for recognition. In: SCV 1995, page 5A Motion II (1995)
Liu, Z., Sarkar, S.: Simplest representation yet for gait recognition: averaged silhouette. In: Proc. ICPR 2004, vol. 4, pp. 211–214 (August 2004)
MacLeod, M.D., Frowley, J.N., Shepherd, J.W.: Whole body information: Its relevance to eyewitnesses. In: Adult Eyewitness Testimony, ch. 6. Cambridge University Press, Cambridge (1994)
Macrae, C.N., Bodenhausen, G.V.: Social Cognition: Thinking Categorically about Others. Ann. Review of Psych. 51(1), 93–120 (2000)
Murase, H., Sakai, R.: Moving object recognition in eigenspace representation: gait analysis and lip reading. Pattern Recogn. Lett. 17(2), 155–162 (1996)
Nandakumar, K., Dass, S.C., Jain, A.K.: Soft biometric traits for personal recognition systems. In: Zhang, D., Jain, A.K. (eds.) ICBA 2004, vol. 3072, pp. 731–738. Springer, Heidelberg (2004)
Nixon, M., Carter, J.: Automatic recognition by gait. Proc. of the IEEE 94(11), 2013–2024 (2006)
Nixon, M.S., Carter, J.N.: Automatic recognition by gait. Proceedings of the IEEE 94(11), 2013–2024 (2006)
Niyogi, S., Adelson, E.: Analyzing and recognizing walking figures in XYT. In: Proc. CVPR 1994, pp. 469–474 (June 1994)
O’Toole, A.J.: Psychological and Neural Perspectives on Human Face Recognition. In: Handbook of Face Recognition. Springer, Heidelberg (2004)
Ponterotto, J.G., Mallinckrodt, B.: Introduction to the special section on racial and ethnic identity in counseling psychology: Conceptual and methodological challenges and proposed solutions. J. of Counselling Psych. 54(3), 219–223 (2007)
Rosse, C., Mejino, J.L.V.: A reference ontology for biomedical informatics: the foundational model of anatomy. J. of Biomed. Informatics 36(6), 478–500 (2003)
Samangooei, S., Guo, B., Nixon, M.S.: The use of semantic human description as a soft biometric. In: BTAS (September 2008)
Shutler, J., Grant, M., Nixon, M.S., Carter, J.N.: On a large sequence-based human gait database. In: RASC 2006, pp. 66–72 (2002)
Skillicorn, D.: Understanding Complex Datasets. In: Singular Value Decomposition (SVD), ch. 3. Chapman & Hall/CRC (2007)
Tajfel, H.: Social Psychology of Intergroup Relations. Ann. Rev. of Psych. 33, 1–39 (1982)
Troje, N.F., Sadr, J., Nakayama, K.: Axes vs averages: High-level representations of dynamic point-light forms. Vis. Cog. 14, 119–122 (2006)
Veres, G., Gordon, L., Carter, J., Nixon, M.: What image information is important in silhouette-based gait recognition? In: Proc. IEEE CVPR 2004, vol. 2, pp. II-776–II-782 (June-July 2, 2004)
Vrusias, B., Makris, D., Renno, J.-P., Newbold, N., Ahmad, K., Jones, G.: A framework for ontology enriched semantic annotation of cctv video. In: WIAMIS 2007, p. 5 (June 2007)
Wells, G.L., Olson, E.A.: Eyewitness testimony. Ann. Rev. of Psych. 54, 277–295 (2003)
Yarmey, A.D., Yarmey, M.J.: Eyewitness recall and duration estimates in field settings. J. of App. Soc. Psych. 27(4), 330–344 (1997)
Zhao, R., Grosky, W.: Bridging the Semantic Gap in Image Retrieval. IEEE Transactions on Multimedia 4, 189–200 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Samangooei, S., Nixon, M.S. (2008). Performing Content-Based Retrieval of Humans Using Gait Biometrics. In: Duke, D., Hardman, L., Hauptmann, A., Paulus, D., Staab, S. (eds) Semantic Multimedia. SAMT 2008. Lecture Notes in Computer Science, vol 5392. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92235-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-92235-3_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92234-6
Online ISBN: 978-3-540-92235-3
eBook Packages: Computer ScienceComputer Science (R0)