Abstract
Semi-supervised learning combines both labeled and unlabeled examples in order to find better future predictions. Semi-supervised support vector machines (SSSVM) present a non-convex optimization problem. In this paper a genetic algorithm is used to optimize the non-convex error - GSSSVM. It is experimented with multiple datasets and the performance of the genetic algorithm is compared to its supervised equivalent and shows very good results. A tailor-made modification of the genetic algorithm is also proposed which uses less unlabeled examples – the closest neighbors of the labeled instances.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chapelle, O., Schölkopf, B., Zien, A.: Semi-supervised Learning. MIT Press, Cambridge (2006)
Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the eleventh Annual Conference on Computational Learning Theory, pp. 92–100 (1998)
Tang, F., Brennan, S., Zhao, Q., Tao, H.: Co-tracking using semi-supervised support vector machines. In: IEEE 11th International Conference on Computer Vision ICCV 2007, vol. 14, pp. 1–8 (2007)
Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Mach. Learn. 46, 131–159 (2002)
Brefeld, U., Scheffer, T.: Co-EM support vector learning. In: Proceedings of the Twenty-First International Conference on Machine learning, p. 16 (2004)
Bennett, K., Demiriz, A.: Semi-supervised support vector machines. Adv. Neural Inf. Process. Syst. 368–374 (1999)
Fung, G., Mangasarian, O.: Semi-supervised support vector machines for unlabeled data classification. Optim. Methods Softw. 15, 29–44 (2001)
Chapelle, O., Sindhwani, V., Keerthi, S.S.: Optimization techniques for semi-supervised support vector machines. J. Mach. Learn. Res. 9, 203–233 (2008)
Zhu, X., Goldberg, A.: Introduction to Semi-supervised Learning: Synthesis Lectures on Artificial Intelligence and Machine Learning. Morgan and Claypool Publishers, San Rafael (2009)
Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)
Golberg, D.: Genetic algorithms in search, optimization, and machine learning. Addison wesley, Boston (1989)
Whiteley, D.: Applying genetic algorithms to neural network problems. Neural Netw. 1, 230 (1988)
Bache, K., Lichman, M.: UCI Machine Learning Repository (2013)
Farquhar, J., Hardoon, D., Meng, H., Shawe-taylor, J., Szedmak, S.: Two view learning: SVM-2K, theory and practice. In: Advances in neural information processing systems, pp. 355–362 (2005)
Lazarova, G.: Semi-supervised image segmentation. In: Agre, G., Hitzler, P., Krisnadhi, A.A., Kuznetsov, S.O. (eds.) Artificial Intelligence: Methodology, Systems, and Applications. Lecture Notes in Computer Science, vol. 8722, pp. 59–68. Springer, Heidelberg (2014)
Lazarova, G.: Semi-supervised Multi-view Sentiment Analysis. In: Núñez, M., Nguyen, N.T., Camacho, D., Trawiński, B. (eds.) Computational Collective Intelligence 2015. Lecture Notes in Computer Science, vol. 9329, pp. 181–190. Springer, Heidelberg (2014)
Joachims, T.: Transductive inference for text classification using support vector machines. In: ICML, pp. 200–209 (1999)
Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: AISTATS, pp. 57–64 (2005)
Chapelle, O., Chi, M., Zien A.: A continuation method for semi-supervised SVMs. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 185–192 (2006)
Sindhwani, V., Keerthi, S.S., Chapelle, O.: Deterministic annealing for semi-supervised kernel machines. In Proceedings of the 23rd International Conference on Machine Learning, pp. 841–848 (2006)
Chapelle, O., Sindhwani, V., Keerthi, S.: Branch and bound for semi-supervised support vector machines. In: Advances in Neural Information Processing Systems, pp. 217–224 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Lazarova, G. (2016). Semi-supervised Support Vector Machines - A Genetic Algorithm Approach. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds) Neural Information Processing. ICONIP 2016. Lecture Notes in Computer Science(), vol 9948. Springer, Cham. https://doi.org/10.1007/978-3-319-46672-9_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-46672-9_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46671-2
Online ISBN: 978-3-319-46672-9
eBook Packages: Computer ScienceComputer Science (R0)