Semi-supervised Learning Based on Coupled Graph Laplacian Regularization

  • Xuejuan Zhao
  • Di WangEmail author
  • Xiaoqin Zhang
  • Nannan Gu
  • Xiuzi Ye
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 528)


This paper aims at constructing coupled graph to discover the intrinsic sample structures under the Semi-Supervised Learning (SSL). Specifically, we first select some anchors by a clustering method such as K-means, and build the weight matrix by local reconstruction coefficients that represent each sample as a linear combination of its neighboring anchors. Then the graph Laplacian matrices over anchors and samples are respectively constructed by the weight matrix. On one hand, the anchor graph gives the coarse data structure and reduces the influences of the noise of training samples and outliers. On the other hand, the sample graph gives the detailed description for the fine structures of samples. We integrate the two graphs into a unified optimization framework, and propose the coupled graph Laplacian regularized semi-supervised learning approach. Experiments on several publicly datasets show that the proposed approach achieves the superior classification performances, while the computational costs are comparable to state-of-the-art methods.


Semi-supervised learning Coupled graph Anchor graph 



This work is supported in part by the National Natural Science Foundation of China [grant nos. 61772374, 61503263, 61472285], in part by the Zhejiang Provincial Natural Science Foundation [grant nos. LY17F030004, LR17F030001, LY16F020023], in part by the project of science and technology plans of Zhejiang Province [grants no. 2015C31168], in part by the Key Innovative Team Support and Project of science and technology plans of Wenzhou City [grant nos. G20160002, C20170008, G20150017, ZG2017016].


  1. 1.
    T. Joachims, Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms (Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002)CrossRefGoogle Scholar
  2. 2.
    X. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using Gaussian fields and harmonic functions, in Proceeding of the Twentieth International Conference on Machine Learning (2003), pp. 912–919Google Scholar
  3. 3.
    D. Zhou, O. Bousquet, T.N. Lal, J. Weston, B. Schlkopf, Learning with local and global consistency, in Neural Information Processing Systems (2004), pp. 321–328Google Scholar
  4. 4.
    O. Chapelle, A. Zien, Semi-supervised classification by low density separation, in Proceeding of the International Conference on Artificial Intelligence and Statistics (vol. 1) (2005), pp. 57–64Google Scholar
  5. 5.
    B.B. Liu, Z.M. Lu, Image colourisation using graph-based semi-supervised learning. Image Process. 3, 115–120 (2009)CrossRefGoogle Scholar
  6. 6.
    B.B. Ni, S.C. Yan, A.A. Kassim, Learning a propagable graph for semisupervised learning: classification and regression. IEEE Trans. Knowl. Data Eng. 24(1), 114–126 (2012)CrossRefGoogle Scholar
  7. 7.
    M. Sokol, K. Avrachenkov, P. Goncalves, A. Mishenin, Generalized optimization framework for graph-based semi-supervised learning, in Siam International Conference on Data Mining (2012), pp. 966–974Google Scholar
  8. 8.
    T. Zhang, R. Ji, W. Liu, D. Tao, G. Hua, Semi-supervised learning with manifold fitted graphs, in Proceeding of the International Joint Conference on Artificial Intelligence (2013), pp. 1896–1902Google Scholar
  9. 9.
    C. Gonga, K. Fu, Q. Wu, E. Tu, J. Yang, Semi-supervised classification with pairwise constraints. Neurocomputing 139, 130–137 (2014)CrossRefGoogle Scholar
  10. 10.
    Z. Lu, L. Wang, Noise-robust semi-supervised learning via fast sparse coding. Pattern Recognit. 48(2), 605–612 (2015)MathSciNetCrossRefGoogle Scholar
  11. 11.
    D. Wang, X. Zhang, M. Fan, X. Ye, Semi-supervised dictionary learning via structural sparse preserving, in Proceeding of the Thirtieth American Association for Artificial Intelligence (2016), pp. 2137–2144Google Scholar
  12. 12.
    L.S. Zhuang, Z.H. Zhou, S.H. Gao, J.W. Yin, Z.C. Lin, Y. Ma, Label information guided graph construction for semi-supervised learning (IEEE Trans, Image Process, 2017)CrossRefGoogle Scholar
  13. 13.
    X.J. Zhu, J. Lafferty, Harmonic mixtures: combining mixture models and graph-based methods for inductive and scalable semi-supervised learning, in Proceeding of the International Conference on Machine Learning (2005)Google Scholar
  14. 14.
    M. Belkin, P. Niyogi, V. Sindhwani, Mandifold regularization: a geometric framework for learning from labeled and unlabeled examples. J. Mach. Learn. Res. 7(11), 2399–2434 (2006)MathSciNetzbMATHGoogle Scholar
  15. 15.
    P.K. Mallapragada, R. Jin, A.K. Jain, Y. Liu, Semiboost: boosting for semi-supervised learning. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 2000–2014 (2009)CrossRefGoogle Scholar
  16. 16.
    M.Y. Fan, N.N. Gu, H. Qiao, B. Zhang, Sparse regularization for semi-supervised classification. Pattern Recognit. 1777–1784 (2011)Google Scholar
  17. 17.
    L. Chen, I.W. Tsang, D. Xu, Laplacian embedded regression for scalable manifold regularization. IEEE Trans. Neural Netw. 23(6), 902–915 (2012)CrossRefGoogle Scholar
  18. 18.
    R.G. Soares, H. Chen, X. Yao, Semisupervised classification with cluster regularization. IEEE Trans. Neural Netw. 23(11), 1779–1792 (2012)CrossRefGoogle Scholar
  19. 19.
    Z. Zhang, T.W.S. Chow, M.B. Zhao, Trace ratio optimization-based semi-supervised nonlinear dimensionality reduction for marginal manifold visualization. IEEE Trans. Knowl. Data Eng. 25(5), 1148–1161 (2013)CrossRefGoogle Scholar
  20. 20.
    M. Zhang, Z. Zhou, Exploiting unlabeled data to enhance ensemble diversity. Int. Conf. Data Min. 26(1), 98–129 (2013)MathSciNetzbMATHGoogle Scholar
  21. 21.
    G. Huang, S. Song, J.N. Gupta, C. Wu, Semi-supervised and unsupervised extreme learning machines. IEEE Trans. Syst. Man Cybern. 44(12), 2405–2417 (2014)Google Scholar
  22. 22.
    D. Wang, X.Q. Zhang, M.Y. Fan, X.Z. Ye, An efficient semi-supervised classifier based on block-polynomial mapping. IEEE Trans. Signal Process. 22(10), 1776–1780 (2015)CrossRefGoogle Scholar
  23. 23.
    Z. Zhang, M.B. Zhao, T.W.S. Chow, Graph based constrained semi-supervised learning framework via propagation over adaptive neighborhood. IEEE Trans. Knowl. Data Eng. 27(9), 2362–2374 (2015)CrossRefGoogle Scholar
  24. 24.
    K. Zhang, J.T. Kwok, B. Parvin, Prototype vector machine for large scale semi-supervised learning, in Proceeding of the International Conference on Machine Learning (2009), pp. 1233–1240Google Scholar
  25. 25.
    W. Liu, J.F. He, S.F. Chang, Large graph construction for scalable semi-supervised learning, in Proceeding of the International Conference on Machine Learning (2010)Google Scholar
  26. 26.
    W. Liu, J. Wang, S.F. Chang, Robust and scalable graph-based semisupervised learning. Proc. IEEE 100(9), 2624–2638 (2012)CrossRefGoogle Scholar
  27. 27.
    C. Deng, R. Ji, W. Liu, D. Tao, X. Gao, Visual reranking through weakly supervised multi-graph learning, in Proceeding of the International Conference on Computer Vision (Dec. 2013), pp. 2600–2607Google Scholar
  28. 28.
    S. Kim, S. Choi, Multi-view anchor graph hashing, in in Proceeding of the International Conference on Acoustics, Speech, and Signal Processing (May 2013), pp. 3123–3127Google Scholar
  29. 29.
    Y. Xiong, W. Liu, D. Zhao, X. Tang, Face recognition via archetype hull ranking, in Proceeding of the International Conference on Computer Vision (Dec. 2013), pp. 585–592Google Scholar
  30. 30.
    Y. Wu, M. Pei, M. Yang, J. Yuan, Y. Jia, Robust discriminative tracking via landmark-based label propagation. IEEE Trans. Image Process. 24(5), 1510–1523 (2015)MathSciNetCrossRefGoogle Scholar
  31. 31.
    M. Wang, W.J. Fu, S.J. Hao, D.C. Tao, X.D. Wu, Scalable semi-supervised learning by efficient anchor graph regularization. IEEE Trans. Knowl. Data Eng. 28(7), 1864–1875 (2016)CrossRefGoogle Scholar
  32. 32.
    D. Cai, X. Chen, Large scale spectral clustering with landmark-based representation, in Proceeding of the National Conference on Artificial Intelligence (vol. 45, no. 8) (2015), pp. 1669–1680Google Scholar
  33. 33.
    Z. Yang, E. Oja, Clustering by low-rank doubly stochastic matrix decomposition, in Proceeding of the International Conference on Machine Learning (2012), pp. 831–838Google Scholar
  34. 34.
    G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: theory and applications. Neurocomputing 70(1), 489–501 (2006)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Xuejuan Zhao
    • 1
  • Di Wang
    • 1
    Email author
  • Xiaoqin Zhang
    • 1
  • Nannan Gu
    • 2
  • Xiuzi Ye
    • 1
  1. 1.Department of Computer ScienceWenzhou UniversityWenzhouChina
  2. 2.School of StatisticsCapital University of Economics and BusinessBeijingChina

Personalised recommendations