Skip to main content

Performing Content-Based Retrieval of Humans Using Gait Biometrics

  • Conference paper
Semantic Multimedia (SAMT 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5392))

Included in the following conference series:

Abstract

In order to analyse surveillance video, we need to efficiently explore large datasets containing videos of walking humans. At survei llance-image resolution, the human walk (their gait) can be determined automatically, and more readily than other features such as the face. Effective analysis of such data relies on retrieval of video data which has been enriched using semantic annotations. A manual annotation process is time-consuming and prone to error due to subject bias. We explore the content-based retrieval of videos containing walking subjects, using semantic queries. We evaluate current biometric research using gait, unique in its effectiveness at recognising people at a distance. We introduce a set of semantic traits discernible by humans at a distance, outlining their psychological validity. Working under the premise that similarity of the chosen gait signature implies similarity of certain semantic traits we perform a set of semantic retrieval experiments using popular latent semantic analysis techniques from the information retrieval community.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aggarwal, J.K., Cai, Q.: Human motion analysis: A review. Computer Vision and Image Understanding: CVIU 73(3), 428–440 (1999)

    Article  Google Scholar 

  2. Barbujani, G.: Human races: Classifying people vs understanding diversity. Current Genomics 6, 215–226 (2005)

    Article  Google Scholar 

  3. BenAbdelkader, C., Cutler, R., Davis, L.: Stride and cadence as a biometric in automatic person identification and verification. In: Proc. 5th IEEEFG, pp. 372–377 (May 2002)

    Google Scholar 

  4. Bennetto, J.: Big brother britain 2006: we are waking up to a surveillance society all around us. The Independant (2006)

    Google Scholar 

  5. Bertillon, A.: Signaletic Instructions including the theory and practice of Anthropometrical Identification. The Werner Company (1896)

    Google Scholar 

  6. Chapman, G.B., Johnson, E.J.: Incorporating the irrelevant: Anchors in judgments of belief and value. In: Heuristics and Biases: The Psychology of Intuitive Judgment, pp. 120–138. Cambridge University Press, Cambridge (2002)

    Chapter  Google Scholar 

  7. Davies, A., Velastin, S.: A Progress Review of Intelligent CCTV Surveillance Systems. In: IEEEIDAACS 2005., pp. 417–423 (September 2005)

    Google Scholar 

  8. Dawes, R.M.: Suppose We Measured Height With Rating Scales Instead of Rulers. App. Psych. Meas. 1(2), 267–273 (1977)

    Article  Google Scholar 

  9. Deerwester, S.C., Dumais, S.T., Landauer, T.K., Furnas, G.W., Harshman, R.A.: Indexing by latent semantic analysis. J. of the American Society of Information Science 41(6), 391–407 (1990)

    Article  Google Scholar 

  10. Ellis, H.D.: Practical aspects of facial memory. In: Eyewitness Testimony: Psychological perspectives, section 2, pp. 12–37. Cambridge University Press, Cambridge (1984)

    Google Scholar 

  11. Flin, R.H., Shepherd, J.W.: Tall stories: Eyewitnesses ability to estimate height and weight characteristics. Human Learning, 5 (1986)

    Google Scholar 

  12. Gould, S.J.: The Geometer of Race. Discover, pp. 65–69 (1994)

    Google Scholar 

  13. Han, J., Bhanu, B.: Statistical feature fusion for gait-based human recognition. In: Proc. IEEE CVPR 2004, vol. 2 , II–pp. 842–II–847 (June-July 2, 2004)

    Google Scholar 

  14. Hare, J.S., Lewis, P.H., Enser, P.G.B., Sandom, C.J.: A linear-algebraic technique with an application in semantic image retrieval. In: Sundaram, H., Naphade, M., Smith, J.R., Rui, Y. (eds.) CIVR 2006. LNCS, vol. 4071, pp. 31–40. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  15. Hayfron-Acquah, J.B., Nixon, M.S., Carter, J.N.: Automatic Gait Recognition by Symmetry Analysis. Pattern Recognition Letters 24(13), 2175–2183 (2003)

    Article  MATH  Google Scholar 

  16. Hu, W., Tan, T., Wang, L., Maybank, S.: A survey on visual surveillance of object motion and behaviors. IEEETSMC(A) 34(3), 334–352 (2004)

    Google Scholar 

  17. Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. Trans. CSVT 14, 4–19 (2004)

    Google Scholar 

  18. Johansson, G.: Visual perception of biological motion and a model for its analysis. Percept. Phychophys. 14(2), 201–211 (1973)

    Article  Google Scholar 

  19. Koppen, P.V., Lochun, S.K.: Portraying perpetrators; the validity of offender descriptions by witnesses. Law and Human Behavior 21(6), 662–685 (1997)

    Google Scholar 

  20. Landauer, T., Littman, M.: Fully automatic cross-language document retrieval using latent semantic indexing. In: 6th Annual Conference of the UW Centre for the New OED, pp. 31–38 (1990)

    Google Scholar 

  21. Li, X., Maybank, S., Yan, S., Tao, D., Xu, D.: Gait components and their application to gender recognition. IEEETSMC(C) 38(2), 145–155 (2008)

    Google Scholar 

  22. Lindsay, R., Martin, R., Webber, L.: Default values in eyewitness descriptions. Law and Human Behavior 18(5), 527–541 (1994)

    Article  Google Scholar 

  23. Little, J., Boyd, J.: Describing motion for recognition. In: SCV 1995, page 5A Motion II (1995)

    Google Scholar 

  24. Liu, Z., Sarkar, S.: Simplest representation yet for gait recognition: averaged silhouette. In: Proc. ICPR 2004, vol. 4, pp. 211–214 (August 2004)

    Google Scholar 

  25. MacLeod, M.D., Frowley, J.N., Shepherd, J.W.: Whole body information: Its relevance to eyewitnesses. In: Adult Eyewitness Testimony, ch. 6. Cambridge University Press, Cambridge (1994)

    Google Scholar 

  26. Macrae, C.N., Bodenhausen, G.V.: Social Cognition: Thinking Categorically about Others. Ann. Review of Psych. 51(1), 93–120 (2000)

    Article  Google Scholar 

  27. Murase, H., Sakai, R.: Moving object recognition in eigenspace representation: gait analysis and lip reading. Pattern Recogn. Lett. 17(2), 155–162 (1996)

    Article  Google Scholar 

  28. Nandakumar, K., Dass, S.C., Jain, A.K.: Soft biometric traits for personal recognition systems. In: Zhang, D., Jain, A.K. (eds.) ICBA 2004, vol. 3072, pp. 731–738. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  29. Nixon, M., Carter, J.: Automatic recognition by gait. Proc. of the IEEE 94(11), 2013–2024 (2006)

    Article  Google Scholar 

  30. Nixon, M.S., Carter, J.N.: Automatic recognition by gait. Proceedings of the IEEE 94(11), 2013–2024 (2006)

    Article  Google Scholar 

  31. Niyogi, S., Adelson, E.: Analyzing and recognizing walking figures in XYT. In: Proc. CVPR 1994, pp. 469–474 (June 1994)

    Google Scholar 

  32. O’Toole, A.J.: Psychological and Neural Perspectives on Human Face Recognition. In: Handbook of Face Recognition. Springer, Heidelberg (2004)

    Google Scholar 

  33. Ponterotto, J.G., Mallinckrodt, B.: Introduction to the special section on racial and ethnic identity in counseling psychology: Conceptual and methodological challenges and proposed solutions. J. of Counselling Psych. 54(3), 219–223 (2007)

    Article  Google Scholar 

  34. Rosse, C., Mejino, J.L.V.: A reference ontology for biomedical informatics: the foundational model of anatomy. J. of Biomed. Informatics 36(6), 478–500 (2003)

    Article  Google Scholar 

  35. Samangooei, S., Guo, B., Nixon, M.S.: The use of semantic human description as a soft biometric. In: BTAS (September 2008)

    Google Scholar 

  36. Shutler, J., Grant, M., Nixon, M.S., Carter, J.N.: On a large sequence-based human gait database. In: RASC 2006, pp. 66–72 (2002)

    Google Scholar 

  37. Skillicorn, D.: Understanding Complex Datasets. In: Singular Value Decomposition (SVD), ch. 3. Chapman & Hall/CRC (2007)

    Google Scholar 

  38. Tajfel, H.: Social Psychology of Intergroup Relations. Ann. Rev. of Psych. 33, 1–39 (1982)

    Article  Google Scholar 

  39. Troje, N.F., Sadr, J., Nakayama, K.: Axes vs averages: High-level representations of dynamic point-light forms. Vis. Cog. 14, 119–122 (2006)

    Google Scholar 

  40. Veres, G., Gordon, L., Carter, J., Nixon, M.: What image information is important in silhouette-based gait recognition? In: Proc. IEEE CVPR 2004, vol. 2, pp. II-776–II-782 (June-July 2, 2004)

    Google Scholar 

  41. Vrusias, B., Makris, D., Renno, J.-P., Newbold, N., Ahmad, K., Jones, G.: A framework for ontology enriched semantic annotation of cctv video. In: WIAMIS 2007, p. 5 (June 2007)

    Google Scholar 

  42. Wells, G.L., Olson, E.A.: Eyewitness testimony. Ann. Rev. of Psych. 54, 277–295 (2003)

    Article  Google Scholar 

  43. Yarmey, A.D., Yarmey, M.J.: Eyewitness recall and duration estimates in field settings. J. of App. Soc. Psych. 27(4), 330–344 (1997)

    Article  Google Scholar 

  44. Zhao, R., Grosky, W.: Bridging the Semantic Gap in Image Retrieval. IEEE Transactions on Multimedia 4, 189–200 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Samangooei, S., Nixon, M.S. (2008). Performing Content-Based Retrieval of Humans Using Gait Biometrics. In: Duke, D., Hardman, L., Hauptmann, A., Paulus, D., Staab, S. (eds) Semantic Multimedia. SAMT 2008. Lecture Notes in Computer Science, vol 5392. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92235-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-92235-3_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-92234-6

  • Online ISBN: 978-3-540-92235-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics