European Conference on Computer Vision

ECCV 2014: Computer Vision – ECCV 2014 pp 581-595

Action Recognition with Stacked Fisher Vectors

  • Xiaojiang Peng
  • Changqing Zou
  • Yu Qiao
  • Qiang Peng
Conference paper

DOI: 10.1007/978-3-319-10602-1_38

Volume 8693 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Peng X., Zou C., Qiao Y., Peng Q. (2014) Action Recognition with Stacked Fisher Vectors. In: Fleet D., Pajdla T., Schiele B., Tuytelaars T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8693. Springer, Cham

Abstract

Representation of video is a vital problem in action recognition. This paper proposes Stacked Fisher Vectors (SFV), a new representation with multi-layer nested Fisher vector encoding, for action recognition. In the first layer, we densely sample large subvolumes from input videos, extract local features, and encode them using Fisher vectors (FVs). The second layer compresses the FVs of subvolumes obtained in previous layer, and then encodes them again with Fisher vectors. Compared with standard FV, SFV allows refining the representation and abstracting semantic information in a hierarchical way. Compared with recent mid-level based action representations, SFV need not to mine discriminative action parts but can preserve mid-level information through Fisher vector encoding in higher layer. We evaluate the proposed methods on three challenging datasets, namely Youtube, J-HMDB, and HMDB51. Experimental results demonstrate the effectiveness of SFV, and the combination of the traditional FV and SFV outperforms state-of-the-art methods on these datasets with a large margin.

Keywords

Action recognition Fisher vectors stacked Fisher vectors max-margin dimensionality reduction 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Xiaojiang Peng
    • 1
    • 3
    • 2
  • Changqing Zou
    • 3
    • 2
  • Yu Qiao
    • 2
    • 4
  • Qiang Peng
    • 1
  1. 1.Southwest Jiaotong UniversityChengduChina
  2. 2.Shenzhen Key Lab of CVPRShenzhen Institutes of Advanced Technology, CASChina
  3. 3.Department of Computer ScienceHengyang Normal UniversityHengyangChina
  4. 4.The Chinese University of Hong KongChina