A New Approach to Multi-class SVM Learning Based on OC-SVM for Huge Databases

  • Djeffal Abdelhamid
  • Babahenini Mohamed Chaouki
  • Taleb-Ahmed Abdelmalik
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 252)


In this paper, we propose a new learning method for multi-class support vector machines based on single class SVM learning method. Unlike the methods 1vs1 and 1vsR, used in the literature and mainly based on binary SVM method, our method learns a classifier for each class from only its samples and then uses these classifiers to obtain a multiclass decision model. To enhance the accuracy of our method, we build from the obtained hyperplanes new hyperplanes, similar to those of the 1vsR method, for use in classification. Our method represents a considerable improvement in the speed of training and classification as well the decision model size while maintaining the same accuracy as other methods.


Support vector machine Multiclass SVM One-class SVM 1vs1 1vsR 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Dogan, U., Glasmachers, T., Igel, C.: Fast Training of Multi-class Support Vector Machines, Technical Report no. 03/2011, Faculty of science, university of Copenhagen (2011)Google Scholar
  2. [2]
    Abe, S.: Analysis of multiclass support vector machines. In: Proceedings of International Conference on Computational Intelligence for Modelling Control and Automation (CIMCA 2003), pp. 385–396 (2003)Google Scholar
  3. [3]
    Guermeur, Y.: Multi-class Support vector machine, Theory and Applications, HDR thesis, IAEM Lorraine (2007)Google Scholar
  4. [4]
    Liu, Y., Wang, R., Zeng, Y., He, H.: An Improvement of One-against-all Method for Multiclass Support Vector Machine. In: 4th International Conference: Sciences of Electronic, Technologies of Information and telecommunications, Tunisia, March 25-29 (2007)Google Scholar
  5. [5]
    Seo, N.: A Comparison of Multi-class Support Vector Machine Methods for Face Recognition, Research report, The University of Maryland (December 2007)Google Scholar
  6. [6]
    Anthony, G., Gregg, H., Tshilidzi, M.: Image Classification Using SVMs: One-against-One Vs One-against-All. In: Proccedings of the 28th Asian Conference on Remote Sensing (2007)Google Scholar
  7. [7]
    Foody, M.G., Mathur, A.: A Relative Evaluation of Multiclass Image Classification by Support Vector Machines. IEEE Transactions on Geoscience and Remote Sensing 42, 1335–1343 (2004)CrossRefGoogle Scholar
  8. [8]
    Frank, A., Asuncion, A.: UCI Machine Learning Repository. University of California, School of Information and Computer Science, Irvine, CA (2010),
  9. [9]
    Huang, T., Kecman, V., Kopriva, I.: Kernel Based Algorithms for Mining Huge Data Sets. Springer, Heidelberg (2006)zbMATHGoogle Scholar
  10. [10]
    Wang, L. (ed.): Support Vector Machines: Theory and Applications. Springer, Heidelberg (2005)zbMATHGoogle Scholar
  11. [11]
    Osuna, E., Freund, R., Girosi, F.: An improved training algorithm for support vector machines. In: ICNNSP 1997, New York, pp. 276–285 (1997)Google Scholar
  12. [12]
    Scholkopf, B., Smola, A.J.: Learning with Kernels Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Djeffal Abdelhamid
    • 1
  • Babahenini Mohamed Chaouki
    • 1
  • Taleb-Ahmed Abdelmalik
    • 2
  1. 1.Computer Science Department, LESIA LaboratoryBiskra UniversityAlgeria
  2. 2.LAMIH Laboratory FRE CNRS 3304 UVHCValenciennes UniversityFrance

Personalised recommendations