A Multi-agent System for Human Activity Recognition in Smart Environments

  • Irina Mocanu
  • Adina Magda Florea
Part of the Studies in Computational Intelligence book series (SCI, volume 382)


Activity recognition is an important component for the ambient assisted living systems, which perform home monitoring and assistance of elderly people or patients with risk factors. The paper presents a prototype system for activity recognition based on a multi-agent architecture. In the system, the context of the person is first detected using a domain ontology. Next, the human position is obtained and together with the context forms a sub-activity. The sequence of successive sub-activities is then assembled in a human activity, which is recognized using a stochastic grammar.


Activity Recognition Domain Ontology Image Annotation Human Activity Recognition Smart Environment 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Intille, S.S., Larson, K., Tapia, E.M., Beaudin, J.S., Kaushik, P., Nawyn, J., Rockinson, R.: Using a live-in laboratory for ubiquitous computing research. In: Fishkin, K.P., Schiele, B., Nixon, P., Quigley, A. (eds.) PERVASIVE 2006. LNCS, vol. 3968, pp. 349–365. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  3. 3.
    Ivanov, Y.A., Bobick, A.F.: Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8), 852–872 (2000)CrossRefGoogle Scholar
  4. 4.
    Iwaki, H., Srivastava, G., Kosaka, A., Park, J., Kah, A.: A novel evidence accumulation framework for robust multi-camera person detection. In: ACM/IEEE International Conference on Distributed Smart Cameras, pp. 117–124 (2008)Google Scholar
  5. 5.
    Joo, S., Chellappa, R.: Recognition of multi-object events using attribute grammars. In: IEEE International Conference on Image Processing, pp. 2897–2900 (2006)Google Scholar
  6. 6.
    Lymberopoulos, D., Barton-Sweeney, A., Savvides, A.: An easy-to-program sensor system for parsing out human activities. In: IEEE INFOCOM, pp. 900–908 (2009)Google Scholar
  7. 7.
    Mocanu, I.: From content-based image retrieval by shape to image annotation. Advances in Electrical and Computer Engineering (2010)Google Scholar
  8. 8.
    Mocanu, I., Kalisz, E., Negreanu, L.: Genetic algorithms viewed as anticipatory systems. In: AIP Conf. Proc., pp. 207–215 (2010)Google Scholar
  9. 9.
    Mocanu, S., Mocanu, I., Anton, S., Munteanu, C.: AmIHomCare: A complex ambient intelligent system for home medical assistance. In: Proceedings of the 10th International Conference on Applied Computer and Applied Computational Science, pp. 181–186 (2011)Google Scholar
  10. 10.
    Ryoo, M., Agarwal, J.: Recognition of composite human activities through context-free grammar based representation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1709–1718 (2006)Google Scholar
  11. 11.
    Turaga, P., Chellappa, R., Subrahmanian, V.S., Udrea, O.: Machine recognition of human activities: A survey. IEEE Transactions on Circuits and System for Video Technology 18(11), 1473–1488 (2008)CrossRefGoogle Scholar
  12. 12.
    Vail, D.L., Veloso, M.M., Lafferty, J.D.: Conditional random fields for activity recognition. In: International Conference on Intelligent Robots and Systems, pp. 3379–3384 (2007)Google Scholar
  13. 13.
    Vogler, C., Metaxas, D.: A framework for recognizing the simultaneous aspects of american sigh language. Computer Vision and Image Understanding 81(3), 358–384 (2001)zbMATHCrossRefGoogle Scholar
  14. 14.
    Yamato, J., Ohaya, J., Ishii, K.: Recognizing human action in time-sequential images using hidden markov model. In: Computer Vision and Pattern Recognition, pp. 379–385 (1992)Google Scholar
  15. 15.
    Zeng, Z., Ji, Q.: Knowledge based activity recognition with dynamic bayesian network. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6316, pp. 532–546. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  16. 16.
    Zhang, D., Perez, D., McCowan, I.: Semi-supervised adapted HMMs for unusual event detection. In: Computer Vision and Pattern Recognition, pp. 611–618 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Irina Mocanu
    • 1
  • Adina Magda Florea
    • 1
  1. 1.Computer Science DepartmentUniversity “Politehnica” of BucharestBucharestRomania

Personalised recommendations