A Formal Fuzzy Framework for Representation and Recognition of Human Activities

  • Suphot Chunwiphat
  • Patrick Reignier
  • Augustin Lux
Part of the IFIP International Federation for Information Processing book series (IFIPAICT, volume 296)


This paper focuses on the problem of human activity representation and automatic recognition. We first describe an approach for human activity representation. We define the concepts of roles, relations, situations and temporal graph of situations (the context model). This context model is transformed into a Fuzzy Petri Net which naturally expresses the smooth changes of activity states from one state to another with gradual and continuous membership functions. Afterward, we present an algorithm for recognizing human activities observed in a scene. The recognition algorithm is a hierarchical fusion model based on fuzzy measures and fuzzy integrals. The fusion process nonlinearly combines events, produced by an activity representation model, based on an assumption that all occurred events support the appearance of a modeled scenario. The goal is to determine, from an observed sequence, the confidence factor that each modeled scenario (predefined in a library) is indeed describing this sequence. We have successfully evaluated our approach on the video sequences taken from the European CAVIAR project1.


Activity Recognition Context Model Fuzzy Measure Transition Firing Fuzzy Condition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    D. Andreu, J. C. Pascal, R. Valette, Fuzzy Petri Net-Based Programmable Logic Controller, IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetic, 27(6), 1997, pp. 952–961.CrossRefGoogle Scholar
  2. 2.
    J. L. Crowley, J. Coutaz, G. Rey, P. Reignier, Perceptual Components for Context Aware Computing, In Proceedings International Conference on Ubiquitous Computing, 2002, pp. 117–134.Google Scholar
  3. 3.
    T. V. Duong, H. H. Bui, D. Q. Phung, S. Venkatesh, Activity Recognition and Abnormality Detection with the Switching Hidden Semi-markov Model. In Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005, pp. 838–845.Google Scholar
  4. 4.
    N. M. Ghanem, Petri Net Models for Events Recognition in Surveillance Video, PhD thesis, University of Maryland, USA, 2007.Google Scholar
  5. 5.
    S. Hongeng, F. Bremond, R. Nevatia, Bayesian Framework for Video Surveillance Application, In Proceedings 15th International Conference on Pattern Recognition, 2000, pp. 164–170.Google Scholar
  6. 6.
    A. Madabhushi, J. K. Aggarwal, A Bayesian Approach to Human Activity Recognition, In Proceedings 2nd International Workshop on Visual Surveillance, Fort Collins, 1999, pp. 25– 32.Google Scholar
  7. 7.
    T. Murofushi, M. Sugeno, An Interpretation of Fuzzy Measures and the Choquet Integral as an Integral with respect to a Fuzzy Measure, Fuzzy Sets System, 29(2), 1989, pp. 201–227.MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Y. Shi, D. Huang, Y. Minnen, A. F. Bobick, I. A. Essa, Propagation networks for recognition of partially ordered sequential action, In Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004, pp. 862–869.Google Scholar
  9. 9.
    M. Sugeno, Fuzzy Measures and Fuzzy Integrals — A Survey, In: M.M. Gupta, G.N. Saridis, B.R. Gaines (Eds.), Fuzzy Automata and Decision Processes, Amsterdam, 1977, pp. 89–102.Google Scholar
  10. 10.
    J. Yamato, J. Ohya, K. Ishii, Recognizing Human Action in Time-Sequential Images using Hidden Markov Model. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition, 1992, pp. 379–385.Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2009

Authors and Affiliations

  • Suphot Chunwiphat
    • 1
  • Patrick Reignier
    • 2
  • Augustin Lux
    • 2
  1. 1.Department of Electronic Engineering Technology, College of Industrial TechnologyKing Mongkut's University of Technology North BangkokBangsueThailand
  2. 2.LIG — PRIMA — INRIA Rhône-AlpesSaint Ismier cedexFrance

Personalised recommendations