Multiview Supervised Learning

  • Shiliang SunEmail author
  • Liang Mao
  • Ziang Dong
  • Lidan Wu


Multiview supervised learning algorithm can exploit the multiview nature of the data by the consensus of the views, that is, to seek predictors from different views that agree on the same example. In this chapter, we introduce three categories of multiview supervised learning methods. The first one contains the multiview large margin-based classifiers, which regularize the classifiers from different views with their agreements on classification margins to enforce view consensus. The second one contains multiple kernel learning, where the feature mappings underlying multiple kernels will map the views to new feature spaces where the classifiers are more likely to agree on the views. The third one contains some Gaussian process related models, in which case the predict functions themselves are taken as random variables. We also briefly introduce some other methods at the end of this chapter.


  1. Bach FR, Lanckriet GRG, Jordan MI (2004) Multiple kernel learning, conic duality, and the SMO algorithm. In: Proceedings of the 21st international conference on machine learning. ACM, p 6Google Scholar
  2. Chao G, Sun S (2016) Alternative multiview maximum entropy discrimination. IEEE Trans Neural Netw 27(7):1445–1456MathSciNetCrossRefGoogle Scholar
  3. Farquhar JDR, Hardoon DR, Meng H, Shawe-Taylor J, Szedmak S (2006) Two view learning: SVM-2K, theory and practice. In: Advances in neural information processing systems, vol 18, pp 355–362Google Scholar
  4. Gönen M, Alpaydın E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12(Jul):2211–2268Google Scholar
  5. Herbrich R, Lawrence ND, Seeger M (2003) Fast sparse gaussian process methods: the informative vector machine. Adv Neural Inf Process Syst 15:625–632Google Scholar
  6. Jaakkola TS, Meila M, Jebara T (2000) Maximum entropy discrimination. In: Advances in neural information processing systems, vol 12, pp 470–476Google Scholar
  7. Joachims T, Cristianini N, Shawe-Taylor J (2001) Composite kernels for hypertext categorisation. In: Proceedings of the 18th international conference on machine learning. ACM, pp 250–257Google Scholar
  8. Lanckriet GR, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5:27–72MathSciNetzbMATHGoogle Scholar
  9. Li J, Sun S (2010) Nonlinear combination of multiple kernels for support vector machines. In: Proceedings of the 20th international conference on pattern recognition, pp 2889–2892Google Scholar
  10. Liu Q, Sun S (2017a) Multi-view regularized gaussian processes. In: Proceedings of the 21st Pacific-Asia conference on knowledge discovery and data mining. Springer, pp 655–667Google Scholar
  11. Liu Q, Sun S (2017b) Sparse multimodal Gaussian processes. In: Proceedings of 2017 international conference on intelligent science and big data engineering, pp 28–40Google Scholar
  12. Mao L, Sun S (2016) Soft margin consistency based scalable multi-view maximum entropy discrimination. In: Proceedings of the 25th international joint conference on artificial intelligence, pp 1839–1845Google Scholar
  13. Rakotomamonjy A, Bach FR, Canu S, Grandvalet Y (2008) SimpleMKL. J Mach Learn Res 9(11):2491–2521MathSciNetzbMATHGoogle Scholar
  14. Sun S, Chao G (2013) Multi-view maximum entropy discrimination. In: Proceedings of the 23rd international joint conference on artificial intelligence, pp 1706–1712Google Scholar
  15. Sun S, Hussain Z, Shawe-Taylor J (2014) Manifold-preserving graph reduction for sparse semi-supervised learning. Neurocomputing 124(1):13–21CrossRefGoogle Scholar
  16. Sun S, Shawe-Taylor J, Mao L (2017) Pac-bayes analysis of multi-view learning. Inf Fusion 35:117–131CrossRefGoogle Scholar
  17. Tang J, Tian Y, Zhang P, Liu X (2018) Multiview pivileged support vector machines. IEEE Trans Neural Netw 29(8):3463–3477MathSciNetCrossRefGoogle Scholar
  18. Xu C, Tao D, Xu C (2014) Large-margin multi-view information bottleneck. IEEE Trans Pattern Anal Mach Intell 36(8):1559–1572CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Department of Computer Science and TechnologyEast China Normal UniversityShanghaiChina

Personalised recommendations