Recognizing Actions across Cameras by Exploring the Correlated Subspace

  • Chun-Hao Huang
  • Yi-Ren Yeh
  • Yu-Chiang Frank Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7583)


We present a novel transfer learning approach to cross-camera action recognition. Inspired by canonical correlation analysis (CCA), we first extract the spatio-temporal visual words from videos captured at different views, and derive a correlation subspace as a joint representation for different bag-of-words models at different views. Different from prior CCA-based approaches which simply train standard classifiers such as SVM in the resulting subspace, we explore the domain transfer ability of CCA in the correlation subspace, in which each dimension has a different capability in correlating source and target data. In our work, we propose a novel SVM with a correlation regularizer which incorporates such ability into the design of the SVM. Experiments on the IXMAS dataset verify the effectiveness of our method, which is shown to outperform state-of-the-art transfer learning approaches without taking such domain transfer ability into consideration.


Support Vector Machine Action Recognition Canonical Correlation Analysis Target Domain Transfer Learning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Holte, M., Tran, C., Trivedi, M., Moeslund, T.: Human action recognition using multiple views: a comparative perspective on recent developments. In: ACM MM Joint Workshop on HGBU (2011)Google Scholar
  2. 2.
    Rao, C., Yilmaz, A., Shah, M.: View-invariant representation and recognition of actions. IJCV 50, 203–226 (2002)zbMATHCrossRefGoogle Scholar
  3. 3.
    Weinland, D., Ronfard, R., Boyer, E.: Free viewpoint action recognition using motion history volumes. CVIU 104, 249–257 (2006)Google Scholar
  4. 4.
    Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE TKDE 22, 1345–1359 (2010)Google Scholar
  5. 5.
    Farhadi, A., Tabrizi, M.K.: Learning to Recognize Activities from the Wrong View Point. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 154–166. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  6. 6.
    Liu, J., Shah, M., Kuipers, B., Savarese, S.: Cross-view action recognition via view knowledge transfer. In: CVPR (2011)Google Scholar
  7. 7.
    Hotelling, H.: Relations between two sets of variates. Biometrika 28, 321–377 (1936)zbMATHGoogle Scholar
  8. 8.
    Poppe, R.: A survey on vision-based human action recognition. IVC 28, 976–990 (2010)CrossRefGoogle Scholar
  9. 9.
    Tran, C., Trivedi, M.: Human body modelling and tracking using volumetric representation: Selected recent studies and possibilities for extensions. In: ICDSC (2008)Google Scholar
  10. 10.
    Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. In: ICCV (2005)Google Scholar
  11. 11.
    Dollár, P., Rabaud, V., Cottrell, G., Belongie, S.: Behavior recognition via sparse spatio-temporal features. In: ICCV Joint Workshop on VS-PETS (2005)Google Scholar
  12. 12.
    Laptev, I.: On space-time interest points. IJCV 64, 107–123 (2005)CrossRefGoogle Scholar
  13. 13.
    ul Haq, A., Gondal, I., Murshed, M.: On dynamic scene geometry for view-invariant action matching. In: CVPR (2011)Google Scholar
  14. 14.
    Li, R., Zickler, T.: Discriminative virtual views for cross-view action recognition. In: CVPR (2012)Google Scholar
  15. 15.
    Blitzer, J., Foster, D., Kakade, S.: Domain adaptation with coupled subspaces. In: AISTATS (2011)Google Scholar
  16. 16.
    Hardoon, D.R., Szedmak, S., Shawe-Taylor, J.: Canonical correlation analysis: An overview with application to learning methods. Neural Computation 16, 2639–2664 (2004)zbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Chun-Hao Huang
    • 1
  • Yi-Ren Yeh
    • 1
  • Yu-Chiang Frank Wang
    • 1
  1. 1.Research Center for IT Innovation, Academia SinicaTaipeiTaiwan

Personalised recommendations