Fuzzy Semi-supervised Large Margin One-Class Support Vector Machine

  • Trung LeEmail author
  • Van Nguyen
  • Thien Pham
  • Mi Dinh
  • Thai Hoang Le
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 341)


One-class Support Vector Machine (OCSVM) is one of state-of-the-art kernel-based methods for one-class classification problem. OCSVM produces the good performance for imbalanced dataset. Nonetheless, it cannot make use of negative data samples and also cannot utilize unlabeled data to boost the classifier. In this paper, we first extend the model of OCSVM to make use of the information carried by negative data samples for classification and then propose how to integrate the semi-supervised paradigm to the extended OCSVM for utilizing the unlabeled data to increase the classifier’s generalization ability. Finally, we show how to apply the fuzzy theory to the proposed semi-supervised one-class classification method for efficiently handling noises and outliers.


One-class classification Novelty detection Support vector machine Semi-supervised learning S3VM Fuzzy membership 


  1. 1.
    Chapelle, O., Sindhwani, V., Keerthi, S.S.: Optimization techniques for semi-supervised support vector machines. J. Mach. Learn. Res. 9, 203–233 (2008)zbMATHGoogle Scholar
  2. 2.
    Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  3. 3.
    Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Disc. 2, 121–167 (1998)CrossRefGoogle Scholar
  4. 4.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New York (1995)CrossRefzbMATHGoogle Scholar
  5. 5.
    Vapnik, V.: The Nature of Statistical Learning Theory, 2nd edn. Springer, New York (1999)Google Scholar
  6. 6.
    Vapnik, V., Sterin, A.: On Structural Risk Minimization or Overall Risk in a Problem of Pattern Recognition. Autom. Remote Control 10(3), 1495–1503 (1977)Google Scholar
  7. 7.
    Joachims, T.: Transductive inference for text classification using support vector machines. In: International Conference on Machine Learning (ICML), pp. 200–209. Bled, Slowenien (1999)Google Scholar
  8. 8.
    De Bie, T., Cristianini, N.: Semi-supervised learning using semi-definite programming. In: O. Chapelle, B. Schšolkopf, A. Zien, eds, Semi-supervised Learning, MIT Press, Cambridge (2006)Google Scholar
  9. 9.
    Xu, L., Neufeld, J., Larson, B., Schuurmans, D.: Maximum margin clustering. In: Advances in Neural Information Processing Systems 17, pp. 1537–1544. MIT Press (2005)Google Scholar
  10. 10.
    Sindhwani, V., Keerthi, S.S., Chapelle, O.: Deterministic annealing for semi-supervised kernel machines. In: Proceedings of the 23rd International Conference on Machine Learning (ICML’06), pp. 841–848. ACM, New York (2006)Google Scholar
  11. 11.
    Bennett, K.P., Demiriz, A.: Semi-supervised support vector machines. In: Advances in Neural Information Processing Systems, pp. 368–374. MIT Press (1998)Google Scholar
  12. 12.
    Chapelle, O., Zien A.: Semi-Supervised Classification by Low Density Separation (2005)Google Scholar
  13. 13.
    Chapelle, O., Chi, M., Zien, A.: A continuation method for semi-supervised svms. In: Proceedings of the 23rd International Conference on Machine Learning (ICML’06), pp. 185–192. ACM, New York (2006)Google Scholar
  14. 14.
    Fung, G., Mangasarian, O.L.: Semi-supervised support vector machines for unlabeled data classification. Optim. Methods Softw. 15, 29–44 (2001)CrossRefzbMATHGoogle Scholar
  15. 15.
    Collobert, R., Sinz, F., Weston, J., Bottou, L., Joachims, T.: Large scale transductive svms. J Mach. Learn. Res. (2006)Google Scholar
  16. 16.
    Lee, K., Kim, W., Lee, K.H., Lee, D.: Density-induced support vector data description. IEEE Trans. Neural Netw. 18(1), 284–289 (2007)CrossRefGoogle Scholar
  17. 17.
    Schölkopf, B., Platt, J.C., Shawe-Taylor, J.C., Smola, A.J., Williamson, R.C.: Estimating the support of a high-dimensional distribution. Neural Comput. 13(7), 1443–1471 (2001)CrossRefzbMATHGoogle Scholar
  18. 18.
    Tax, D.M.J., Duin, R.P.W.: Support vector domain description. Pattern Recogn. Lett. 20, 1191–1199 (1999)CrossRefGoogle Scholar
  19. 19.
    Jayadeva, R., Khemchandani, R., Chandrab, S.: Fast and robust learning through fuzzy linear proximal support vector machines. Neurocomputing 61, 401–411 (2004)CrossRefGoogle Scholar
  20. 20.
    Lin, C.-F., Wang, S.-D.: Fuzzy support vector machines. IEEE Trans. Neural Netw. 13(2), 464–471 (2002)CrossRefGoogle Scholar
  21. 21.
    Le, T., Tran, D., Ma, W., Sharma, D.: A new fuzzy membership computation method for fuzzy support vector machines. In: 2010 Third International Conference on Communications and Electronics (ICCE) (2010)Google Scholar
  22. 22.
    Nguyen, P., Le, T., Tran, D., Huang, X., Sharma, D.: Fuzzy support vector machines for age and gender classification. In INTERSPEECH, pp. 2806–2809 (2010)Google Scholar
  23. 23.
    Keller, J.M., Hunt, D.J.: Incorporating fuzzy membership functions into the perceptron algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 6, 693–699 (1985)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Trung Le
    • 1
    Email author
  • Van Nguyen
    • 1
  • Thien Pham
    • 1
  • Mi Dinh
    • 1
  • Thai Hoang Le
    • 2
  1. 1.Faculty of Information TechnologyHCMc University of PedagogyHo Chi Minh CityVietnam
  2. 2.Faculty of Information TechnologyHCMc University of ScienceHo Chi Minh CityVietnam

Personalised recommendations