Robust Multi-view Common Component Learning

  • Jiamiao Xu
  • Xinge You
  • Shi Yin
  • Peng Zhang
  • Wei Yuan
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 773)


In many computer vision applications, one object usually exists more than one data representation. This paper focuses on the specific problem of cross-view recognition, which aims to recognize objects from different views. A majority of representative works mainly attempt to seek a common subspace, in which the Euclidean distance of within-class data is short. Intuitively, the recognition performance will be better if the various data from the same object have completely same representation in the common space. Therefore, this paper proposes robust multi-view common component learning (RMCCL) algorithm, which learns multiple linear transforms to extract the common component of multi-view data from the same instance. To enhance the discriminant ability and robustness of subspace, we introduce binary label matrix technology and serve Cauchy loss as our error measurement. RMCCL can be decomposed into two subproblems by Alternating optimization method, and each subproblem can be optimized by Iteratively Reweight Residuals (IRR) technique. Extensive experiments in both two-view and multi-view datasets demonstrate that the our method outperforms other state-of-the-art approaches.


Cross-view recognition Multi-view learning Common space 



This work was supported partially by National Key Technology Research and Development Program of the Ministry of Science and Technology of China (No. 2015BAK36B00), in part by the Key Science and Technology of Shen zhen (No. CXZZ20150814155434903), in part by the Key Program for International S&T Cooperation Projects of China (No. 2016YFE0121200), in part by the National Natural Science Foundation of China (No. 61571205), in part by the National Natural Science Foundation of China (No. 61772220).


  1. 1.
    Chen, N., Zhu, J., Xing, E.P.: Predictive subspace learning for multi-view data: a large margin approach. In: Advances in Neural Information Processing Systems, pp. 361–369 (2010)Google Scholar
  2. 2.
    Chen, Y., Wang, L., Wang, W., Zhang, Z.: Continuum regression for cross-modal multimedia retrieval. In: 2012 19th IEEE International Conference on Image Processing (ICIP), pp. 1949–1952. IEEE (2012)Google Scholar
  3. 3.
    Diethe, T., Hardoon, D.R., Shawe-Taylor, J.: Constructing nonlinear discriminants from multiple data views. In: Balcázar, J.L., Bonchi, F., Gionis, A., Sebag, M. (eds.) ECML PKDD 2010. LNCS (LNAI), vol. 6321, pp. 328–343. Springer, Heidelberg (2010). CrossRefGoogle Scholar
  4. 4.
    Diethe, T., Hardoon, D.R., Shawe-Taylor, J.: Multiview fisher discriminant analysis. In: NIPS Workshop on Learning from Multiple Sources (2008)Google Scholar
  5. 5.
    Ding, Z., Fu, Y.: Low-rank common subspace for multi-view learning. In: 2014 IEEE International Conference on Data Mining (ICDM), pp. 110–119. IEEE (2014)Google Scholar
  6. 6.
    Gopalan, R., Li, R., Chellappa, R.: Domain adaptation for object recognition: an unsupervised approach. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 999–1006. IEEE (2011)Google Scholar
  7. 7.
    Gui, J., Jia, W., Zhu, L., Wang, S.L., Huang, D.S.: Locality preserving discriminant projections for face and palmprint recognition. Neurocomputing 73(13), 2696–2707 (2010)CrossRefGoogle Scholar
  8. 8.
    Gui, J., Sun, Z., Jia, W., Hu, R., Lei, Y., Ji, S.: Discriminant sparse neighborhood preserving embedding for face recognition. Pattern Recogn. 45(8), 2884–2893 (2012)CrossRefzbMATHGoogle Scholar
  9. 9.
    Hotelling, H.: Relations between two sets of variates. Biometrika 28(3/4), 321–377 (1936)CrossRefzbMATHGoogle Scholar
  10. 10.
    Huber, P.J.: Robust Statistics. Springer, Heidelberg (2011). CrossRefGoogle Scholar
  11. 11.
    Kan, M., Shan, S., Zhang, H., Lao, S., Chen, X.: Multi-view discriminant analysis. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 808–821. Springer, Heidelberg (2012). CrossRefGoogle Scholar
  12. 12.
    Kan, M., Shan, S., Zhang, H., Lao, S., Chen, X.: Multi-view discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 188–194 (2016)CrossRefGoogle Scholar
  13. 13.
    Li, J., Wu, Y., Zhao, J., Lu, K.: Low-rank discriminant embedding for multiview learning. IEEE Trans. Cybern. 47(11), 3516–3529 (2017)CrossRefGoogle Scholar
  14. 14.
    Li, S., Fu, Y.: Robust subspace discovery through supervised low-rank constraints. In: Proceedings of the 2014 SIAM International Conference on Data Mining, pp. 163–171. SIAM (2014)Google Scholar
  15. 15.
    Li, S.Z., Lei, Z., Ao, M.: The HFB face database for heterogeneous face biometrics research. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009, pp. 1–8. IEEE (2009)Google Scholar
  16. 16.
    Li, W., Wang, X.: Locally aligned feature transforms across views. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3594–3601 (2013)Google Scholar
  17. 17.
    Lin, D., Tang, X.: Inter-modality face recognition. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 13–26. Springer, Heidelberg (2006). CrossRefGoogle Scholar
  18. 18.
    Nielsen, A.A.: Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data. IEEE Trans. Image Process. 11(3), 293–305 (2002)CrossRefGoogle Scholar
  19. 19.
    Rosipal, R., Krämer, N.: Overview and recent advances in partial least squares. In: Saunders, C., Grobelnik, M., Gunn, S., Shawe-Taylor, J. (eds.) SLSFS 2005. LNCS, vol. 3940, pp. 34–51. Springer, Heidelberg (2006). CrossRefGoogle Scholar
  20. 20.
    Rupnik, J., Shawe-Taylor, J.: Multi-view canonical correlation analysis. In: Conference on Data Mining and Data Warehouses (SiKDD 2010), pp. 1–4 (2010)Google Scholar
  21. 21.
    Sharma, A., Jacobs, D.W.: Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 593–600. IEEE (2011)Google Scholar
  22. 22.
    Sim, T., Zhang, S., Li, J., Chen, Y.: Simultaneous and orthogonal decomposition of data using multimodal discriminant analysis. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 452–459. IEEE (2009)Google Scholar
  23. 23.
    Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: Subspace learning from image gradient orientations. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2454–2466 (2012)CrossRefGoogle Scholar
  24. 24.
    Voß, H., Eckhardt, U.: Linear convergence of generalized Weiszfeld’s method. Computing 25(3), 243–251 (1980)MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    Wang, K., He, R., Wang, W., Wang, L., Tan, T.: Learning coupled feature spaces for cross-modal matching. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2088–2095 (2013)Google Scholar
  26. 26.
    Xiao, M., Guo, Y.: Feature space independent semi-supervised domain adaptation via kernel matching. IEEE Trans. Pattern Anal. Mach. Intell. 37(1), 54–66 (2015)CrossRefGoogle Scholar
  27. 27.
    Xu, C., Tao, D., Xu, C.: Multi-view intact space learning. IEEE Trans. Pattern Anal. Mach. Intell. 37(12), 2531–2544 (2015)CrossRefGoogle Scholar
  28. 28.
    Xu, Y., Fang, X., Wu, J., Li, X., Zhang, D.: Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans. Image Process. 25(2), 850–863 (2016)MathSciNetCrossRefGoogle Scholar
  29. 29.
    You, X., Guo, W., Yu, S., Li, K., Príncipe, J.C., Tao, D.: Kernel learning for dynamic texture synthesis. IEEE Trans. Image Process. 25(10), 4782–4795 (2016)MathSciNetCrossRefGoogle Scholar
  30. 30.
    Yu, S., Abraham, Z.: Concept drift detection with hierarchical hypothesis testing. In: Proceedings of the 2017 SIAM International Conference on Data Mining, pp. 768–776. SIAM (2017)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2017

Authors and Affiliations

  • Jiamiao Xu
    • 1
  • Xinge You
    • 1
  • Shi Yin
    • 1
  • Peng Zhang
    • 1
  • Wei Yuan
    • 1
  1. 1.School of Electronics and Information EngineeringHuazhong University of Science and TechnologyWuhanChina

Personalised recommendations