Skip to main content

Semi-supervised Support Vector Machines - A Genetic Algorithm Approach

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9948))

Included in the following conference series:

  • 2791 Accesses

Abstract

Semi-supervised learning combines both labeled and unlabeled examples in order to find better future predictions. Semi-supervised support vector machines (SSSVM) present a non-convex optimization problem. In this paper a genetic algorithm is used to optimize the non-convex error - GSSSVM. It is experimented with multiple datasets and the performance of the genetic algorithm is compared to its supervised equivalent and shows very good results. A tailor-made modification of the genetic algorithm is also proposed which uses less unlabeled examples – the closest neighbors of the labeled instances.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chapelle, O., Schölkopf, B., Zien, A.: Semi-supervised Learning. MIT Press, Cambridge (2006)

    Book  Google Scholar 

  2. Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the eleventh Annual Conference on Computational Learning Theory, pp. 92–100 (1998)

    Google Scholar 

  3. Tang, F., Brennan, S., Zhao, Q., Tao, H.: Co-tracking using semi-supervised support vector machines. In: IEEE 11th International Conference on Computer Vision ICCV 2007, vol. 14, pp. 1–8 (2007)

    Google Scholar 

  4. Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Mach. Learn. 46, 131–159 (2002)

    Article  MATH  Google Scholar 

  5. Brefeld, U., Scheffer, T.: Co-EM support vector learning. In: Proceedings of the Twenty-First International Conference on Machine learning, p. 16 (2004)

    Google Scholar 

  6. Bennett, K., Demiriz, A.: Semi-supervised support vector machines. Adv. Neural Inf. Process. Syst. 368–374 (1999)

    Google Scholar 

  7. Fung, G., Mangasarian, O.: Semi-supervised support vector machines for unlabeled data classification. Optim. Methods Softw. 15, 29–44 (2001)

    Article  MATH  Google Scholar 

  8. Chapelle, O., Sindhwani, V., Keerthi, S.S.: Optimization techniques for semi-supervised support vector machines. J. Mach. Learn. Res. 9, 203–233 (2008)

    MATH  Google Scholar 

  9. Zhu, X., Goldberg, A.: Introduction to Semi-supervised Learning: Synthesis Lectures on Artificial Intelligence and Machine Learning. Morgan and Claypool Publishers, San Rafael (2009)

    Google Scholar 

  10. Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)

    MATH  Google Scholar 

  11. Golberg, D.: Genetic algorithms in search, optimization, and machine learning. Addison wesley, Boston (1989)

    Google Scholar 

  12. Whiteley, D.: Applying genetic algorithms to neural network problems. Neural Netw. 1, 230 (1988)

    Article  Google Scholar 

  13. Bache, K., Lichman, M.: UCI Machine Learning Repository (2013)

    Google Scholar 

  14. Farquhar, J., Hardoon, D., Meng, H., Shawe-taylor, J., Szedmak, S.: Two view learning: SVM-2K, theory and practice. In: Advances in neural information processing systems, pp. 355–362 (2005)

    Google Scholar 

  15. Lazarova, G.: Semi-supervised image segmentation. In: Agre, G., Hitzler, P., Krisnadhi, A.A., Kuznetsov, S.O. (eds.) Artificial Intelligence: Methodology, Systems, and Applications. Lecture Notes in Computer Science, vol. 8722, pp. 59–68. Springer, Heidelberg (2014)

    Google Scholar 

  16. Lazarova, G.: Semi-supervised Multi-view Sentiment Analysis. In: Núñez, M., Nguyen, N.T., Camacho, D., Trawiński, B. (eds.) Computational Collective Intelligence 2015. Lecture Notes in Computer Science, vol. 9329, pp. 181–190. Springer, Heidelberg (2014)

    Chapter  Google Scholar 

  17. Joachims, T.: Transductive inference for text classification using support vector machines. In: ICML, pp. 200–209 (1999)

    Google Scholar 

  18. Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: AISTATS, pp. 57–64 (2005)

    Google Scholar 

  19. Chapelle, O., Chi, M., Zien A.: A continuation method for semi-supervised SVMs. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 185–192 (2006)

    Google Scholar 

  20. Sindhwani, V., Keerthi, S.S., Chapelle, O.: Deterministic annealing for semi-supervised kernel machines. In Proceedings of the 23rd International Conference on Machine Learning, pp. 841–848 (2006)

    Google Scholar 

  21. Chapelle, O., Sindhwani, V., Keerthi, S.: Branch and bound for semi-supervised support vector machines. In: Advances in Neural Information Processing Systems, pp. 217–224 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gergana Lazarova .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Lazarova, G. (2016). Semi-supervised Support Vector Machines - A Genetic Algorithm Approach. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds) Neural Information Processing. ICONIP 2016. Lecture Notes in Computer Science(), vol 9948. Springer, Cham. https://doi.org/10.1007/978-3-319-46672-9_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46672-9_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46671-2

  • Online ISBN: 978-3-319-46672-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics