Set Based Discriminative Ranking for Recognition

  • Yang Wu
  • Michihiko Minoh
  • Masayuki Mukunoki
  • Shihong Lao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7574)


Recently both face recognition and body-based person re-identification have been extended from single-image based scenarios to video-based or even more generally image-set based problems. Set-based recognition brings new research and application opportunities while at the same time raises great modeling and optimization challenges. How to make the best use of the available multiple samples for each individual while at the same time not be disturbed by the great within-set variations is considered by us to be the major issue. Due to the difficulty of designing a global optimal learning model, most existing solutions are still based on unsupervised matching, which can be further categorized into three groups: a) set-based signature generation, b) direct set-to-set matching, and c) between-set distance finding. The first two count on good feature representation while the third explores data set structure and set-based distance measurement. The main shortage of them is the lack of learning-based discrimination ability. In this paper, we propose a set-based discriminative ranking model (SBDR), which iterates between set-to-set distance finding and discriminative feature space projection to achieve simultaneous optimization of these two. Extensive experiments on widely-used face recognition and person re-identification datasets not only demonstrate the superiority of our approach, but also shed some light on its properties and application domain.


Face Recognition Simultaneous Optimization Geometric Distance Object Recognition Task Convex Approximation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Cevikalp, H., Triggs, B.: Face recognition based on image sets. In: CVPR, pp. 2567–2573 (2010)Google Scholar
  2. 2.
    Hu, Y., Mian, A.S., Owens, R.: Sparse Approximated Nearest Points for Image Set Classification. In: CVPR, 121–128 (2011)Google Scholar
  3. 3.
    Farenzena, M., Bazzani, L., Perina, A., Murino, V., Cristani, M.: Person re-identification by symmetry-driven accumulation of local features. In: CVPR (2010)Google Scholar
  4. 4.
    Bak, S., Corvee, E., Bremond, F., Thonnat, M.: Multiple-shot Human Re-Identification by Mean Riemannian Covariance Grid. In: Advanced Video and Signal-Based Surveillance (2011)Google Scholar
  5. 5.
    Arandjelovic, O., Shakhnarovich, G., Fisher, J., Cipolla, R., Darrell, T.: Face recognition with image sets using manifold density divergence. In: CVPR, pp. 581–588 (2005)Google Scholar
  6. 6.
    Yamaguchi, O., Fukui, K., Maeda, K.: Face recognition using temporal image sequence. In: IEEE International Conference on Automatic Face and Gesture Recognition, p. 318 (1998)Google Scholar
  7. 7.
    Li, X., Fukui, K., Zheng, N.: Image-Set Based Face Recognition Using Boosted Global and Local Principal Angles. In: Zha, H., Taniguchi, R.-i., Maybank, S. (eds.) ACCV 2009, Part I. LNCS, vol. 5994, pp. 323–332. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  8. 8.
    Kim, T.K., Kittler, J., Cipolla, R.: Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans. Pattern Anal. Mach. Intell. 29, 1005–1018 (2007)CrossRefGoogle Scholar
  9. 9.
    Wang, R., Shan, S., Chen, X., Gao, W.: Manifold-manifold distance with application to face recognition based on image set. In: CVPR (2008)Google Scholar
  10. 10.
    Bazzani, L., Cristani, M., Perina, A., Farenzena, M., Murino, V.: Multiple-shot person re-identification by hpe signature. In: ICPR, pp. 1413–1416 (2010)Google Scholar
  11. 11.
    Gheissari, N., Sebastian, T.B., Hartley, R.: Person reidentification using spatiotemporal appearance. In: CVPR, pp. 1528–1535 (2006)Google Scholar
  12. 12.
    Tuzel, O., Porikli, F., Meer, P.: Region Covariance: A Fast Descriptor for Detection and Classification. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part II. LNCS, vol. 3952, pp. 589–600. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  13. 13.
    Prosser, B., Zheng, W.S., Gong, S., Xiang, T.: Person re-identification by support vector ranking. In: BMVC (2010)Google Scholar
  14. 14.
    Wu, Y., Mukunoki, M., Funatomi, T., Minoh, M., Lao, S.: Optimizing Mean Reciprocal Rank for Person Re-identification. In: 2011 8th IEEE International Conference on Advanced Video and Signal-Based Surveillancei (AVSS), p. 6 (2011)Google Scholar
  15. 15.
    Joachims, T.: A support vector method for multivariate performance measures. In: ICML, pp. 377–384 (2005)Google Scholar
  16. 16.
    McFee, B., Lanckriet, G.: Metric learning to rank. In: ICML, pp. 775–782 (2010)Google Scholar
  17. 17.
    Zheng, W.-S., Gong, S., Xiang, T.: Person Re-identification by Probabilistic Relative Distance Comparison. In: CVPR, pp. 649–656 (2011)Google Scholar
  18. 18.
    Joachims, T., Finley, T., Yu, C.N.: Cutting-plane training of structural svms. Machine Learning 77, 27–59 (2009)zbMATHCrossRefGoogle Scholar
  19. 19.
    Lee, K., Ho, J., Yang, M.H., Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds. In: CVPR, pp. 313–320 (2003)Google Scholar
  20. 20.
    Gross, R., Shi, J.: The cmu motion of body (mobo) database. Technical Report CMU-RI-TR-01-18, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA (2001)Google Scholar
  21. 21.
    Schwartz, W.R., Davis, L.S.: Learning discriminative appearance-based models using partial least squares. In: SIBGRAPI, pp. 322–329 (2009)Google Scholar
  22. 22.
    Zheng, W.S., Gong, S., Xiang, T.: Associating groups of people. In: BMVC (2009)Google Scholar
  23. 23.
    Gray, D., Tao, H.: Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 262–275. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  24. 24.
    Joachims, T.: Optimizing search engines using clickthrough data. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 133–142 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Yang Wu
    • 1
  • Michihiko Minoh
    • 1
  • Masayuki Mukunoki
    • 1
  • Shihong Lao
    • 2
  1. 1.Academic Center for Computing and Media StudiesKyoto UniversityJapan
  2. 2.OMRON Social Solutions Co., Ltd.KyotoJapan

Personalised recommendations