Abstract
This paper aims at constructing coupled graph to discover the intrinsic sample structures under the Semi-Supervised Learning (SSL). Specifically, we first select some anchors by a clustering method such as K-means, and build the weight matrix by local reconstruction coefficients that represent each sample as a linear combination of its neighboring anchors. Then the graph Laplacian matrices over anchors and samples are respectively constructed by the weight matrix. On one hand, the anchor graph gives the coarse data structure and reduces the influences of the noise of training samples and outliers. On the other hand, the sample graph gives the detailed description for the fine structures of samples. We integrate the two graphs into a unified optimization framework, and propose the coupled graph Laplacian regularized semi-supervised learning approach. Experiments on several publicly datasets show that the proposed approach achieves the superior classification performances, while the computational costs are comparable to state-of-the-art methods.
Keywords
- Semi-supervised learning
- Coupled graph
- Anchor graph
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
T. Joachims, Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms (Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002)
X. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using Gaussian fields and harmonic functions, in Proceeding of the Twentieth International Conference on Machine Learning (2003), pp. 912–919
D. Zhou, O. Bousquet, T.N. Lal, J. Weston, B. Schlkopf, Learning with local and global consistency, in Neural Information Processing Systems (2004), pp. 321–328
O. Chapelle, A. Zien, Semi-supervised classification by low density separation, in Proceeding of the International Conference on Artificial Intelligence and Statistics (vol. 1) (2005), pp. 57–64
B.B. Liu, Z.M. Lu, Image colourisation using graph-based semi-supervised learning. Image Process. 3, 115–120 (2009)
B.B. Ni, S.C. Yan, A.A. Kassim, Learning a propagable graph for semisupervised learning: classification and regression. IEEE Trans. Knowl. Data Eng. 24(1), 114–126 (2012)
M. Sokol, K. Avrachenkov, P. Goncalves, A. Mishenin, Generalized optimization framework for graph-based semi-supervised learning, in Siam International Conference on Data Mining (2012), pp. 966–974
T. Zhang, R. Ji, W. Liu, D. Tao, G. Hua, Semi-supervised learning with manifold fitted graphs, in Proceeding of the International Joint Conference on Artificial Intelligence (2013), pp. 1896–1902
C. Gonga, K. Fu, Q. Wu, E. Tu, J. Yang, Semi-supervised classification with pairwise constraints. Neurocomputing 139, 130–137 (2014)
Z. Lu, L. Wang, Noise-robust semi-supervised learning via fast sparse coding. Pattern Recognit. 48(2), 605–612 (2015)
D. Wang, X. Zhang, M. Fan, X. Ye, Semi-supervised dictionary learning via structural sparse preserving, in Proceeding of the Thirtieth American Association for Artificial Intelligence (2016), pp. 2137–2144
L.S. Zhuang, Z.H. Zhou, S.H. Gao, J.W. Yin, Z.C. Lin, Y. Ma, Label information guided graph construction for semi-supervised learning (IEEE Trans, Image Process, 2017)
X.J. Zhu, J. Lafferty, Harmonic mixtures: combining mixture models and graph-based methods for inductive and scalable semi-supervised learning, in Proceeding of the International Conference on Machine Learning (2005)
M. Belkin, P. Niyogi, V. Sindhwani, Mandifold regularization: a geometric framework for learning from labeled and unlabeled examples. J. Mach. Learn. Res. 7(11), 2399–2434 (2006)
P.K. Mallapragada, R. Jin, A.K. Jain, Y. Liu, Semiboost: boosting for semi-supervised learning. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 2000–2014 (2009)
M.Y. Fan, N.N. Gu, H. Qiao, B. Zhang, Sparse regularization for semi-supervised classification. Pattern Recognit. 1777–1784 (2011)
L. Chen, I.W. Tsang, D. Xu, Laplacian embedded regression for scalable manifold regularization. IEEE Trans. Neural Netw. 23(6), 902–915 (2012)
R.G. Soares, H. Chen, X. Yao, Semisupervised classification with cluster regularization. IEEE Trans. Neural Netw. 23(11), 1779–1792 (2012)
Z. Zhang, T.W.S. Chow, M.B. Zhao, Trace ratio optimization-based semi-supervised nonlinear dimensionality reduction for marginal manifold visualization. IEEE Trans. Knowl. Data Eng. 25(5), 1148–1161 (2013)
M. Zhang, Z. Zhou, Exploiting unlabeled data to enhance ensemble diversity. Int. Conf. Data Min. 26(1), 98–129 (2013)
G. Huang, S. Song, J.N. Gupta, C. Wu, Semi-supervised and unsupervised extreme learning machines. IEEE Trans. Syst. Man Cybern. 44(12), 2405–2417 (2014)
D. Wang, X.Q. Zhang, M.Y. Fan, X.Z. Ye, An efficient semi-supervised classifier based on block-polynomial mapping. IEEE Trans. Signal Process. 22(10), 1776–1780 (2015)
Z. Zhang, M.B. Zhao, T.W.S. Chow, Graph based constrained semi-supervised learning framework via propagation over adaptive neighborhood. IEEE Trans. Knowl. Data Eng. 27(9), 2362–2374 (2015)
K. Zhang, J.T. Kwok, B. Parvin, Prototype vector machine for large scale semi-supervised learning, in Proceeding of the International Conference on Machine Learning (2009), pp. 1233–1240
W. Liu, J.F. He, S.F. Chang, Large graph construction for scalable semi-supervised learning, in Proceeding of the International Conference on Machine Learning (2010)
W. Liu, J. Wang, S.F. Chang, Robust and scalable graph-based semisupervised learning. Proc. IEEE 100(9), 2624–2638 (2012)
C. Deng, R. Ji, W. Liu, D. Tao, X. Gao, Visual reranking through weakly supervised multi-graph learning, in Proceeding of the International Conference on Computer Vision (Dec. 2013), pp. 2600–2607
S. Kim, S. Choi, Multi-view anchor graph hashing, in in Proceeding of the International Conference on Acoustics, Speech, and Signal Processing (May 2013), pp. 3123–3127
Y. Xiong, W. Liu, D. Zhao, X. Tang, Face recognition via archetype hull ranking, in Proceeding of the International Conference on Computer Vision (Dec. 2013), pp. 585–592
Y. Wu, M. Pei, M. Yang, J. Yuan, Y. Jia, Robust discriminative tracking via landmark-based label propagation. IEEE Trans. Image Process. 24(5), 1510–1523 (2015)
M. Wang, W.J. Fu, S.J. Hao, D.C. Tao, X.D. Wu, Scalable semi-supervised learning by efficient anchor graph regularization. IEEE Trans. Knowl. Data Eng. 28(7), 1864–1875 (2016)
D. Cai, X. Chen, Large scale spectral clustering with landmark-based representation, in Proceeding of the National Conference on Artificial Intelligence (vol. 45, no. 8) (2015), pp. 1669–1680
Z. Yang, E. Oja, Clustering by low-rank doubly stochastic matrix decomposition, in Proceeding of the International Conference on Machine Learning (2012), pp. 831–838
G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: theory and applications. Neurocomputing 70(1), 489–501 (2006)
Acknowledgements
This work is supported in part by the National Natural Science Foundation of China [grant nos. 61772374, 61503263, 61472285], in part by the Zhejiang Provincial Natural Science Foundation [grant nos. LY17F030004, LR17F030001, LY16F020023], in part by the project of science and technology plans of Zhejiang Province [grants no. 2015C31168], in part by the Key Innovative Team Support and Project of science and technology plans of Wenzhou City [grant nos. G20160002, C20170008, G20150017, ZG2017016].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhao, X., Wang, D., Zhang, X., Gu, N., Ye, X. (2019). Semi-supervised Learning Based on Coupled Graph Laplacian Regularization. In: Jia, Y., Du, J., Zhang, W. (eds) Proceedings of 2018 Chinese Intelligent Systems Conference. Lecture Notes in Electrical Engineering, vol 528. Springer, Singapore. https://doi.org/10.1007/978-981-13-2288-4_14
Download citation
DOI: https://doi.org/10.1007/978-981-13-2288-4_14
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-2287-7
Online ISBN: 978-981-13-2288-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)