Human Activity Analysis for Geriatric Care in Nursing Homes

  • Ming-Yu Chen
  • Alexander Hauptmann
  • Ashok Bharucha
  • Howard Wactlar
  • Yi Yang
Conference paper


As our society is increasingly aging, it is urgent to develop computer aided techniques to improve the quality-of-care (QoC) and quality-of-life (QoL) of geriatric patients. In this paper, we focus on automatic human activities analysis in video surveillance recorded in complicated environments at a nursing home. This will enable the automatic exploration of the statistical patterns between patients’ daily activities and their clinical diagnosis. We also discuss potential future research directions in this area. Experiment demonstrate the proposed approach is effective for human activity analysis.


Video analysis CareMedia Informedia Multimedia information systems 



This material is based upon the work supported in part by the National Institutes of Health (NIH) Grant No. 1RC1MH090021-0110, and in part by the National Science Foundation under Grants IIS-0812465 and CNS-0751185. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Institutes of Health and National Science Foundation.


  1. 1.
    German, P.S., Rovner, B.W., Burton, L.C., Brant, L.J., and Clark, R.: The role of mental morbidity in the nursing home experience. In: Gerontologist, 32(2):152–158, 1992CrossRefGoogle Scholar
  2. 2.
    C. Steele et al.: Psychiatric Consultation in the Nursinig Home. In: Am J. Geriatric Psycbitatry, 147(8):1049–1051, 1990.Google Scholar
  3. 3.
    U. G. A. Office.: Nursing homes: Prevalence of serious quality problems remains unacceptably high, despite some decline. Washington, D.C.: U.S. General Accounting Office, 2003.Google Scholar
  4. 4.
    Hauptmann, A.G., Gao, J., Yan, R., Qi, Y., Yang, J., Wactlar, H.D.: Automated Analysis of Nursing Home Observations, IEEE Pervasive Computing, 3(2)15–21, 2004.CrossRefGoogle Scholar
  5. 5.
    Bharucha A., Wactlar H., Stevens S., Pollock B., Dew M., D. Chen, and Atkeson. C., Caremedia: Automated video and sensor analysis for geriatric care. In Proceedings of the Fifth Annual WPIC Research Day, University of Pittsburgh School of Medicine, 2005.Google Scholar
  6. 6.
    Chen, M-Y. and Hauptmann, A, MoSIFT: Recognizing Human Actions in Surveillance Videos. CMU-CS-09-161, Carnegie Mellon University, 2009.Google Scholar
  7. 7.
    Hu, W., Tan, T., Wang, L., and Maybank, S.: A Survey on Visual Surveillance of Object Motion and Behaviors. In: IEEE Transactions of Systems, Man, and Cybernetics, 34(3):334–352, 2004.CrossRefGoogle Scholar
  8. 8.
    Weinland D., Ronfard R., Boyer E.: A survey of vision-based methods for action representation, segmentation and recognition. In: Computer Vision and Image Understanding. 115(2):224–241, 2011.CrossRefGoogle Scholar
  9. 9.
    Bregler, C.: Learning and recognizing human dynamics in video sequences, In CVPR, 1997.Google Scholar
  10. 10.
    Bobick, A.F. and Davis, J.W.: The recognition of human movement using temporal templates. In: IEEE Trans. PAMI, 2001.Google Scholar
  11. 11.
    Laptev I., Marszalek M., Schmid C., and Rozenfeld B.. Learning realistic human actions from movies. In: CVPR, 2008.Google Scholar
  12. 12.
    Blank M., Gorelick L., Shechtman E., Irani M., Basri R..: Actions as spaceCtime shapes, In: ICCV, 2005.Google Scholar
  13. 13.
    Liu J., Ali S., Shah M., Recognizing human actions using multiple features, In: CVPR, 2008.Google Scholar
  14. 14.
    Scovanner P., Ali S., Shah M., A 3-dimensional sift descriptor and its application to action recognition, In: ACM International Conference on Multimedia, 2007.Google Scholar
  15. 15.
    Sminchisescu C., Kanaujia, A. Li Z., Metaxas D.: Conditional models for contextual human motion recognition, In: ICCV, 2005.Google Scholar
  16. 16.
    Schindler K., van Gool L., Action snippets: how many frames does human action recognition require? In: CVPR, 2008.Google Scholar
  17. 17.
    Laptev, I. and Lindeberg, T.: Space-time interest points, In: ICCV, 2003.Google Scholar
  18. 18.
    Yang. Y., Shen. H., Ma Z., Huang Z and Zhou X.: L21-Norm Regularized Discriminative Feature Selection for Unsupervised Learning, In: IJCAI 2011.Google Scholar
  19. 19.
    Nie, F., Xiang, S. and Zhang C.: Neighborhood MinMax Projections, In: IJCAI, 2007.Google Scholar
  20. 20.
    Yang Y., Nie F., Xu D., Luo J., Zhuang Y. and Pan Y.: A Multimedia Retrieval Framework based on Semi-Supervised Ranking and Relevance Feedback. In: IEEE Trans. PAMI, 2011.Google Scholar
  21. 21.
    Wang M., Hua X.: Active Learning in Multimedia Annotation and Retrieval: A Survey. In: ACM Transactions on Intelligent Systems and Technology. 2(2): 10–31, 2011.MathSciNetGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2013

Authors and Affiliations

  • Ming-Yu Chen
    • 1
  • Alexander Hauptmann
    • 1
  • Ashok Bharucha
    • 1
  • Howard Wactlar
    • 1
  • Yi Yang
    • 1
  1. 1.School of Computer ScienceCarnegie Mellon UniversityPittsburghUSA

Personalised recommendations