Abstract
In this paper, we explore the real-world Still-to-Video (S2V) face recognition scenario, where only very few (single, in many cases) still images per person are enrolled into the gallery while it is usually possible to capture one or multiple video clips as probe. Typical application of S2V is mug-shot based watch list screening. Generally, in this scenario, the still image(s) were collected under controlled environment, thus of high quality and resolution, in frontal view, with normal lighting and neutral expression. On the contrary, the testing video frames are of low resolution and low quality, possibly with blur, and captured under poor lighting, in non-frontal view. We reveal that the S2V face recognition has been heavily overlooked in the past. Therefore, we provide a benchmarking in terms of both a large scale dataset and a new solution to the problem. Specifically, we collect (and release) a new dataset named COX-S2V, which contains 1,000 subjects, with each subject a high quality photo and four video clips captured simulating video surveillance scenario. Together with the database, a clear evaluation protocol is designed for benchmarking. In addition, in addressing this problem, we further propose a novel method named Partial and Local Linear Discriminant Analysis (PaLo-LDA). We then evaluated the method on COX-S2V and compared with several classic methods including LDA, LPP, ScSR. Evaluation results not only show the grand challenges of the COX-S2V, but also validate the effectiveness of the proposed PaLo-LDA method over the competitive methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Liu, X., Cheng, T.: Video-based face recognition using adaptive hidden markov models. In: CVPR, pp. 340–345 (2003)
Arandjelović, O., Shakhnarovich, G., Fisher, J., Cipolla, R., Darrell, T.: Face recognition with image sets using manifold density divergence. In: CVPR, vol. 1, pp. 581–588 (2005)
Kim, T., Kittler, J., Cipolla, R.: Discriminative learning and recognition of image set classes using canonical correlations. IEEE T-PAMI 29, 1005–1018 (2007)
Cevikalp, H., Triggs, B.: Face recognition based on image sets. In: CVPR, pp. 2567–2573 (2010)
Wang, R., Guo, H., Davis, L., Dai, Q.: Covariance discriminative learning: A natural and efficient approach to image set classification. In: CVPR, pp. 2496–2503 (2012)
Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video. CVIU 91, 214–245 (2003)
Zhou, S., Chellappa, R.: Beyond one still image: Face recognition from multiple still images or a video sequence. In: Face Processing: Advanced Modeling and Methods, pp. 547–567 (2005)
Hwang, W., Huang, X., Noh, K., Kim, J.: Face recognition system using extended curvature gabor classifier bunch for low-resolution face image. In: CVPRW on Biometrics, pp. 15–22 (2011)
Baker, S., Kanade, T.: Hallucinating faces. In: AFGR, pp. 83–88 (2000)
Liu, C., Shum, H., Zhang, C.: A two-step approach to hallucinating faces: Global parametric model and local nonparametric model. In: CVPR (2001)
Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T.: Coupled dictionary training for image super-resolution. IEEE T-IP 21, 3467–3478 (2012)
Gunturk, B., Batur, A., Altunbasak, Y., Hayes III, M., Mersereau, R.: Eigenface-domain super-resolution for face recognition. IEEE T-IP 12, 597–606 (2003)
Hennings-Yeomans, P., Baker, S., Kumar, B.: Simultaneous super-resolution and feature extraction for recognition of low-resolution faces. In: CVPR (2008)
Li, B., Chang, H., Shan, S., Chen, X.: Low-resolution face recognition via coupled locality preserving mappings. Signal Processing Letters 17, 20–23 (2010)
Huang, H., He, H.: Super-resolution method for face recognition using nonlinear mappings on coherent features. IEEE T-NN 22, 121–130 (2011)
Arandjelović, O., Cipolla, R.: A manifold approach to face recognition from low quality video across illumination and pose using implicit super-resolution. In: ICCV (2007)
Jia, K., Gong, S.: Generalized face super-resolution. IEEE T-IP 17, 873–886 (2008)
He, X., Niyogi, P.: Locality preserving projections. In: Advances in Neural Information Processing Systems, vol. 16, pp. 153–160 (2004)
Huang, G., Mattar, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: A database for studying face recognition in unconstrained environments. In: Workshop on Faces in ’Real-Life’ Images: Detection, Alignment, and Recognition (2008)
Fisher, R.: The use of multiple measurements in taxonomic problems. Annals of Human Genetics 7, 179–188 (1936)
Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE T-PAMI 19, 711–720 (1997)
Sugiyama, M.: Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. The Journal of Machine Learning Research 8, 1027–1061 (2007)
Perona, P., Zelnik-Manor, L.: Self-tuning spectral clustering. In: Advances in Neural Information Processing Systems, vol. 17, pp. 1601–1608 (2004)
Lin, D., Tang, X.: Inter-modality Face Recognition. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 13–26. Springer, Heidelberg (2006)
Jolliffe, I.: MyiLibrary: Principal component analysis. vol, 2. Wiley Online Library (2002)
Lu, J., Tan, Y.: Locality repulsion projections for image-to-set face recognition. In: ICME, pp. 1–6 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Huang, Z., Shan, S., Zhang, H., Lao, S., Kuerban, A., Chen, X. (2013). Benchmarking Still-to-Video Face Recognition via Partial and Local Linear Discriminant Analysis on COX-S2V Dataset. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7725. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37444-9_46
Download citation
DOI: https://doi.org/10.1007/978-3-642-37444-9_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37443-2
Online ISBN: 978-3-642-37444-9
eBook Packages: Computer ScienceComputer Science (R0)