A Multi-view Regularization Method for Semi-supervised Learning

  • Jiao Wang
  • Siwei Luo
  • Yan Li
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6063)


Multi-view semi-supervised learning is a hot research topic recently. In this paper, we consider the regularization problem in multi-view semi-supervised learning. A regularization method adaptive to the given data is proposed, which can use unlabeled data to adjust the degree of regularization automatically. This new regularization method comprises two levels of regularization simultaneously. Experimental evidence on real word dataset shows its effectivity.


multi-view learning semi-supervised learning regularization  machine learning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning. MIT Press, Cambridge (2006)Google Scholar
  2. 2.
    Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th Annual Conference on Computational Learning Theory, Madison, WI, pp. 92–100 (1998)Google Scholar
  3. 3.
    Kakade, S.M., Foster, D.P.: Multi-view regression via canonical correlation analysis. In: The 20th Annual Conference on Learning Theory, pp. 82–96 (2007)Google Scholar
  4. 4.
    Zhou, Z.-H., Li, M.: Tri-training: exploiting unlabeled data using three classifiers. IEEE Transactions on knowledge and data engineering 17(11), 1529–1541 (2005)CrossRefGoogle Scholar
  5. 5.
    Zhou, Z.-H., Zhan, D.-C., Yang, Q.: Semi-supervised learning with very few labeled training examples. In: Proceedings of the 22nd AAAI Conference on Artificial Intelligence, Vancouver, Canada, pp. 675–680 (2007)Google Scholar
  6. 6.
    Peng, Y., Zhang, D.Q.: Semi-supervised canonical correlation analysis. Journal of Software 19(11), 2822–2832 (2008) (in chinese)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Schuurmans, D., Southey, F.: Metric-based methods for adaptive model selection and regularization. Machine Learning 48(1-3), 51–84 (2002)zbMATHCrossRefGoogle Scholar
  8. 8.
    Dasgupta, S., Littman, M.L., McAllester, D.: PAC generalization bounds for co-training. In: Advances in Neural Information Processing Systems, vol. 14, pp. 375–382. MIT Press, Cambridge (2002)Google Scholar
  9. 9.
    Sindhwani, V., Niyogi, P., Belkin, M.: A co-regularized approach to semi-supervised learning with multiple views. In: Working Notes of the ICML 2005 Workshop on Learning with Multiple Views, Bonn, Germany (2005)Google Scholar
  10. 10.
    Vapnik, V.N.: Statistical Learning Theory. Wiley Interscience, New York (1998)zbMATHGoogle Scholar
  11. 11.
    McCallum, A.: Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering (1996),

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jiao Wang
    • 1
  • Siwei Luo
    • 1
  • Yan Li
    • 1
  1. 1.School of Computer and Information TechnologyBeijing Jiaotong UniversityBeijingChina

Personalised recommendations