Skip to main content

Robust Manifold Learning Based Ordinal Discriminative Correlation Regression

  • Conference paper
  • First Online:
Cloud Computing and Security (ICCCS 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11068))

Included in the following conference series:

  • 1482 Accesses

Abstract

Canonical correlation analysis (CCA) is a typical learning paradigm of capturing the correlation components across multi-views of the same data. When countered with such data with ordinal labels, the accuracy performance yielded by traditional CCA is usually not desirable because of ignoring the ordinal relationships among data labels. In order to incorporate the ordinal information into the objective function of CCA, the so-called ordinal discriminative CCA (OR-DisCCA) was presented. Although OR-DisCCA can yield better ordinal regression results, its performance will be deteriorated when the data are corrupted with outliers because the ordered class centers easily tend to be biased by the outliers. To address this issue, in this work we construct robust manifold ordinal discriminative correlation regression (rmODCR) by replacing the traditional (\(l_2\)-norm) class centers with \(l_p\)-norm centers in objective optimization. Finally, we experimentally evaluate the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Breukelen, M.V., Duin, R.P.W., Tax, D.M.J., Hartog, J.E.D.: Handwritten digit recognition by combined classifiers. Kybern. Praha 34, 381–386 (1998)

    MATH  Google Scholar 

  2. David, H., John Shawe, T.: Sparse canonical correlation analysis. Mach. Learn. 83, 331–353 (2011)

    Article  MathSciNet  Google Scholar 

  3. Feng, L., et al.: Spectral embedding-based multiview features fusion for content-based image retrieval. J. Electron. Imaging 26, 1 (2017)

    Article  Google Scholar 

  4. Han, Y., Wu, F., Tao, D., Shao, J., Zhuang, Y., Jiang, J.: Sparse unsupervised dimensionality reduction for multiple view data. IEEE Trans. Circuits Syst. Video Technol. 22, 1485–1496 (2012)

    Article  Google Scholar 

  5. Hou, C., Zhang, C., Wu, Y., Nie, F.: Multiple view semi-supervised dimensionality reduction. Pattern Recognit. 43, 720–730 (2010)

    Article  Google Scholar 

  6. Huang, H., He, H., Fan, X., Zhang, J.: Super-resolution of human face image using canonical correlation analysis. Pattern Recognit. 43, 2532–2543 (2010)

    Article  Google Scholar 

  7. Ji, H., Shen, X., Sun, Q., Ji, Z.: Sparse discrimination based multiset canonical correlation analysis for multi-feature fusion and recognition. In: British Machine Vision Conference, pp. 141.1–141.9 (2015)

    Google Scholar 

  8. Juefei-Xu, F., Pal, D.K., Savvides, M.: NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction. In: Computer Vision and Pattern Recognition Workshops, pp. 141–150 (2015)

    Google Scholar 

  9. Kamada, C., Kanezaki, A., Harada, T.: Probabilistic semi-canonical correlation analysis. In: ACM International Conference on Multimedia, pp. 1131–1134 (2015)

    Google Scholar 

  10. Kawashima, T., Ogawa, T., Haseyama, M.: A rating prediction method for e-commerce application using ordinal regression based on LDA with multi-modal features. In: Consumer Electronics, pp. 260–261 (2013)

    Google Scholar 

  11. Kettenring, J.R.: Canonical analysis of several sets of variables. Biometrika 58, 433–451 (1971)

    Article  MathSciNet  Google Scholar 

  12. Kobayashi, T., Otsu, N.: Image feature extraction using gradient local auto-correlations. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5302, pp. 346–358. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88682-2_27

    Chapter  Google Scholar 

  13. Lai, P.L., Fyfe, C.: Kernel and nonlinear canonical correlation analysis. Int. J. Neural Syst. 10, 365–377 (2000)

    Article  Google Scholar 

  14. Lawrence, C.T.: A computationally efficient feasible sequential quadratic programming algorithm. Soc. Ind. Appl. Math. 11, 1092–1118 (2000)

    MathSciNet  MATH  Google Scholar 

  15. Melzer, T., Reiter, M., Bischof, H.: Appearance models based on kernel canonical correlation analysis. Pattern Recognit. 36, 1961–1971 (2003)

    Article  Google Scholar 

  16. Meng, R., Rice, S.G., Wang, J., Sun, X.: A fusion steganographic algorithm based on faster R-CNN. Comput. Mater. Contin. 55, 1–16 (2018)

    Google Scholar 

  17. Parkhomenko, E.: Sparse canonical correlation analysis. Stat. Appl. Genet. Mol. Biol. 8, 1 (2008)

    Article  MathSciNet  Google Scholar 

  18. Pearson, E.S.: Relations between two sets of variates. Biometrika 28, 321–377 (1936)

    Article  Google Scholar 

  19. Radoslav, L.: Sequential Quadratic Programming. Springer, Boston (2006). https://doi.org/10.1007/978-0-387-40065-5

    Book  Google Scholar 

  20. Rupnik, J., Grobelnik, M.: Cross-lingual search over 22 european languages. In: International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 883–883 (2008)

    Google Scholar 

  21. Sargin, M.E., Erzin, E., Yemez, Y., Tekalp, A.M.: Multimodal speaker identification using canonical correlation analysis. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2006, pp. 613–616 (2006)

    Google Scholar 

  22. Sargin, M.E., Yemez, Y., Erzin, E., Tekalp, A.M.: Audiovisual synchronization and fusion using canonical correlation analysis. IEEE Trans. Multimed. 9, 1396–1403 (2007)

    Article  Google Scholar 

  23. Sun, B.Y., Li, J., Wu, D.D., Zhang, X.M., Li, W.B.: Kernel discriminant learning for ordinal regression. IEEE Trans. Knowl. Data Eng. 22, 906–910 (2009)

    Article  Google Scholar 

  24. Sun, T., Chen, S., Yang, J., Shi, P.: A novel method of combined feature extraction for recognition. In: Eighth IEEE International Conference on Data Mining, pp. 1043–1048 (2008a)

    Google Scholar 

  25. Sun, T.K., Chen, S.C., Jin, Z., Yang, J.Y.: Kernelized discriminative canonical correlation analysis. In: International Conference on Wavelet Analysis and Pattern Recognition, pp. 1283–1287 (2008b)

    Google Scholar 

  26. Tae-Kyun, K., Roberto, C.: Canonical correlation analysis of video volume tensors for action categorization and detection. IEEE Trans. Pattern Anal. Mach. Intell. 31, 1415–1428 (2009)

    Article  Google Scholar 

  27. Tian, Q., Chen, S.: Cross-heterogeneous-database age estimation through correlation representation learning. Neurocomputing 238, 286–295 (2017)

    Article  Google Scholar 

  28. Vinokourov, A., Shawe-Taylor, J., Cristianini, N.: Inferring a semantic representation of text via cross-language correlation analysis. In: Advances of Neural Information Processing Systems, pp. 1497–1504 (2002)

    Google Scholar 

  29. Wang, L., Chen, S.: Joint representation classification for collective face recognition. Pattern Recognit. 63, 182–192 (2017)

    Article  Google Scholar 

  30. Zeng, D., Dai, Y., Li, F., Sherratt, R.S., Wang, J.: Adversarial learning for distant supervised relation extraction. Comput. Mater. Contin. 55, 1–16 (2018)

    Google Scholar 

  31. Zhou, H.X., Chen, S.C.: Ordinal discriminative canonical correlation analysis. J. Softw. 25, 2018–2025 (2014)

    MATH  Google Scholar 

Download references

Acknowledgment

This work was partially supported by the National Natural Science Foundation of China under grant 61702273, the Natural Science Foundation of Jiangsu Province under grant BK20170956, the Natural Science Foundation of the Jiangsu Higher Education Institutions of China under grant 17KJB520022, a Project Funded by the Priority Academic Program Development of Jiangsu Higer Education Institutions, and the Startup Foundation for Talents of Nanjing University of Information Science and Technology.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qing Tian .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tian, Q., Zhang, W., Wang, L. (2018). Robust Manifold Learning Based Ordinal Discriminative Correlation Regression. In: Sun, X., Pan, Z., Bertino, E. (eds) Cloud Computing and Security. ICCCS 2018. Lecture Notes in Computer Science(), vol 11068. Springer, Cham. https://doi.org/10.1007/978-3-030-00021-9_60

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00021-9_60

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00020-2

  • Online ISBN: 978-3-030-00021-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics