Skip to main content

Robust Real-Time Human Activity Recognition from Tracked Face Displacements

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 3808)

Abstract

We are interested in the challenging scientific pursuit of how to characterize human activities in any formal meeting situation by tracking people’s positions with a computer vision system. We present a human activity recognition algorithm that works within the framework of CAMEO (the Camera Assisted Meeting Event Observer), a panoramic vision system designed to operate in real-time and in uncalibrated environments. Human activity is difficult to characterize within the constraints that the CAMEO must operate, including uncalibrated deployment and unmodeled occlusions. This paper describes these challenges and how we address them by identifying invariant features and robust activity models. We present experimental results of our recognizer correctly classifying person data.

Keywords

  • Hide Markov Model
  • Activity Recognition
  • State Sequence
  • Viterbi Algorithm
  • Dynamic Bayesian Network

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This research was supported by the National Business Center (NBC) of the Department of the Interior (DOI) under a subcontract from SRI International. The views and conclusions contained in this document are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, by the NBC, DOI, SRI, or the US Government.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Rybski, P.E., de la Torre, F., Patil, R., Vallespi, C., Veloso, M.M., Browning, B.: Cameo: The camera assisted meeting event observer. In: International Conference on Robotics and Automation, New Orleans (2004)

    Google Scholar 

  2. Murphy, K.: Dynamic Bayesian Networks: representation, Inference and Learning. PhD thesis, UC Berkeley, Computer Science Division (2002)

    Google Scholar 

  3. Rabiner, L.R.: A tutorial on Hidden Markov Models and selected applications in speech recognition. Proceedings of the IEEE 77, 257–286 (1989)

    CrossRef  Google Scholar 

  4. Hamid, R., Huang, Y., Essa, I.: ARGMode – activity recognition using graphical models. In: Conference on Computer Vision and Pattern Recognition Workshop, Madison, WI, vol. 4, pp. 38–44 (2003)

    Google Scholar 

  5. Hong, P., Turk, M., Huang, T.S.: Gesture modeling and recognition using finite state machines. In: Proceedings of the Fourth IEEE International Conference and Gesture Recognition, Grenoble, France (2000)

    Google Scholar 

  6. Nguyen, N., Bui, H., Venkatesh, S., West, G.: Recognizing and monitoring high level behaviours in complex spatial environments. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (2003)

    Google Scholar 

  7. Darrell, T., Gordon, G., Harville, M., Woodfill, J.: Integrated person tracking using stereo, color, and pattern detection. International Journal of Computer Vision 37, 175–185 (2000)

    CrossRef  MATH  Google Scholar 

  8. Han, K., Veloso, M.: Automated robot behavior recognition applied to robotic soccer. In: Hollerbach, J., Koditschek, D. (eds.) Robotics Research: the Ninth International Symposium, pp. 199–204. Springer, London (2000); Also in the Proceedings of IJCAI 1999 Workshop on Team Behaviors and Plan Recognition

    Google Scholar 

  9. Bruce, J., Bowling, M., Browning, B., Veloso, M.: Multi-robot team response to a multi-robot opponent team. In: Proceedings of ICRA 2003, the 2003 IEEE International Conference on Robotics and Automation, Taiwan (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rybski, P.E., Veloso, M.M. (2005). Robust Real-Time Human Activity Recognition from Tracked Face Displacements. In: Bento, C., Cardoso, A., Dias, G. (eds) Progress in Artificial Intelligence. EPIA 2005. Lecture Notes in Computer Science(), vol 3808. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11595014_9

Download citation

  • DOI: https://doi.org/10.1007/11595014_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-30737-2

  • Online ISBN: 978-3-540-31646-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics