Unsupervised Learning Spatio-temporal Features for Human Activity Recognition from RGB-D Video Data

  • Guang Chen
  • Feihu Zhang
  • Manuel Giuliani
  • Christian Buckl
  • Alois Knoll
Conference paper

DOI: 10.1007/978-3-319-02675-6_34

Part of the Lecture Notes in Computer Science book series (LNCS, volume 8239)
Cite this paper as:
Chen G., Zhang F., Giuliani M., Buckl C., Knoll A. (2013) Unsupervised Learning Spatio-temporal Features for Human Activity Recognition from RGB-D Video Data. In: Herrmann G., Pearson M.J., Lenz A., Bremner P., Spiers A., Leonards U. (eds) Social Robotics. ICSR 2013. Lecture Notes in Computer Science, vol 8239. Springer, Cham

Abstract

Being able to recognize human activities is essential for several applications, including social robotics. The recently developed commodity depth sensors open up new possibilities of dealing with this problem. Existing techniques extract hand-tuned features, such as HOG3D or STIP, from video data. They are not adapting easily to new modalities. In addition, as the depth video data is low quality due to the noise, we face a problem: does the depth video data provide extra information for activity recognition? To address this issue, we propose to use an unsupervised learning approach generally adapted to RGB and depth video data. we further employ the multi kernel learning (MKL) classifier to take into account the combinations of different modalities. We show that the low-quality depth video is discriminative for activity recognition. We also demonstrate that our approach achieves superior performance to the state-of-the-art approaches on two challenging RGB-D activity recognition datasets.

Keywords

activity recognition unsupervised learning depth video 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Guang Chen
    • 1
  • Feihu Zhang
    • 1
  • Manuel Giuliani
    • 2
  • Christian Buckl
    • 2
  • Alois Knoll
    • 1
  1. 1.Institut für Informatik VITechnische Universität MünchenGarchingGermany
  2. 2.fortiss GmbHMunichGermany

Personalised recommendations