CCBR 2012: Biometric Recognition pp 1-8 | Cite as
Patch-Based Bag of Features for Face Recognition in Videos
Abstract
Video-based face recognition is a fundamental topic in image processing and video representation, and presents various challenges and opportunities. In this paper, we introduce an efficient patch-based bag of features (PBoF) method to video-based face recognition that plenty exploits the spatiotemporal information in videos, and does not make any assumptions about the pose, expressions or illumination of face. First, descriptors are used for feature extraction from patches, then with the quantization of a codebook, each descriptor is converted into code. Next, codes from each region are pooled together into a histogram. Finally, representation of the image is generated by concatenating the histograms from all regions, which is employed to do the categorization. In our experiments, 100% recognition rate is achieved on the Honda/UCSD database, which outperforms the state of the arts. And from the theoretical and experimental results, it can be derived that, when choosing a single descriptor and no prior knowledge about the data set and object is available, the dense SIFT with ScSPM is recommended. Experimental results demonstrate the effectiveness and flexibility of our proposed method.
Keywords
Face recognition video-based face recognition bag of feature sparse codingPreview
Unable to display preview. Download preview PDF.
References
- 1.Aggarwal, G., Chowdhury, A., Chellappa, R.: A system identification approach for video-based face recognition. In: ICPR, pp. 175–178 (2004)Google Scholar
- 2.Lee, K., Ho, J., Yang, M., Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds. In: CVPR, pp. 313–320Google Scholar
- 3.Hadid, A., Pietikäinen, M.: Combining appearance and motion for face and gender recognition from videos. PR 42(11), 2818–2827 (2009)CrossRefGoogle Scholar
- 4.Mian, A.: Online learning from local features for video-based face recognition. PR 44(5), 1068–1075 (2011)MATHCrossRefGoogle Scholar
- 5.Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: CVPR, pp. 2169–2178 (2006)Google Scholar
- 6.Van De Sande, K., Gevers, T., Snoek, C.: Evaluating color descriptors for object and scene recognition. IEEE Trans. PAMI 32, 1582–1596 (2009)CrossRefGoogle Scholar
- 7.Lowe, D.: Distinctive image features from scale-invariant keypoints. IJCV 60(2), 91–110 (2004)CrossRefGoogle Scholar
- 8.Zhang, L., Chu, R., Xiang, S., Liao, S., Li, S.: Face detection based on multi-block lbp representation. Advances in Biometrics, 11–18 (2007)Google Scholar
- 9.Ahonen, T., Matas, J., He, C., Pietikäinen, M.: Rotation invariant image description with local binary pattern histogram fourier features. Image Analysis, 61–70 (2009)Google Scholar
- 10.Yang, J., Yu, K., Gong, Y., Huang, T.: Linear spatial pyramid matching using sparse coding for image classification. In: CVPR, pp. 1794–1801 (2009)Google Scholar
- 11.Lee, K., Ho, J., Yang, M., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. CVIU 99, 303–331 (2005)Google Scholar
- 12.Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: CVPR, Intel, Microprocessor Research Labs, p. 511 (2001)Google Scholar
- 13.Carnegie, R.C.: Mean-shift blob tracking through scale space. In: CVPR, pp. 234–240 (2003)Google Scholar
- 14.Hsieh, C., Chang, K., Lin, C., Keerthi, S., Sundararajan, S.: A dual coordinate descent method for large-scale linear svm. In: ICML, pp. 408–415 (2008)Google Scholar
- 15.Chang, C., Lin, C.: Libsvm: a library for support vector machines (2001)Google Scholar
- 16.Vedaldi, A., Zisserman, A.: Efficient additive kernels via explicit feature maps. In: CVPR, pp. 3539–3546 (2010)Google Scholar