Multi-class Twin Support Vector Machine for Pattern Classification

  • Divya Tomar
  • Sonali Agarwal
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 43)


In this paper, we propose a novel algorithm for multi-class classification, called as Multi-class Twin Support Vector Machine (MTWSVM) which is an extension of the binary Twin Support Vector Machine (TWSVM). MTWSVM is based on “one-against-one” strategy in which the patterns of each class are trained with the patterns of another class. To speed up the training phase, optimization problems are solved by Successive Over Relaxation (SOR) technique. The experiment is performed on eight benchmark datasets and the performance of the proposed approach is compared with the existing multi-class approaches based on Support Vector Machines and Twin Support Vector Machines.


Twin support vector machine Multi-class twin support vector machine Successive over relaxation Pattern classification 


  1. 1.
    Cortes, C., Vapnik, V.: Support-vector networks. Machine learning 20(3), 273–297 (1995)zbMATHGoogle Scholar
  2. 2.
    Vapnik, V.: The nature of statistical learning theory. Springer (2000)Google Scholar
  3. 3.
    Cristianini, N., Shawe-Taylor, J.: An introduction to support vector machines and other kernel-based learning methods. Cambridge university press (2000)Google Scholar
  4. 4.
    Wang, T.Y., Chiang, H.M.: One-against-one fuzzy support vector machine classifier: an approach to text categorization. Expert Syst. Appl. 36(6), 10030–10034 (2009)CrossRefGoogle Scholar
  5. 5.
    Wang, T.Y., Chiang, H.M.: Fuzzy support vector machine for multi-class text categorization. Inf. Process. Manage. 43(4), 914–929 (2007)CrossRefGoogle Scholar
  6. 6.
    Ganapathiraju, A., Hamaker, J.E., Picone, J.: Applications of support vector machines to speech recognition. Sig. Process. IEEE Trans. 52(8), 2348–2355 (2004)CrossRefGoogle Scholar
  7. 7.
    Manikandan, J., Venkataramani, B.: Design of a real time automatic speech recognition system using modified one against All SVM classifier. Microprocess. Microsyst. 35(6), 568–578 (2011)Google Scholar
  8. 8.
    Elish, K.O., Elish, M.O.: Predicting defect-prone software modules using support vector machines. J. Syst. Softw. 81(5), 649–660 (2008)CrossRefGoogle Scholar
  9. 9.
    Can, H., Jianchun, X., Ruide, Z., Juelong, L., Qiliang, Y., Liqiang, X.: A new model for software defect prediction using particle swarm optimization and support vector machine. In 25th Control and Decision Conference (CCDC), Chinese, pp. 4106–4110 (2013)Google Scholar
  10. 10.
    Chen, H.L., Yang, B., Liu, J., Liu, D.Y.: A support vector machine classifier with rough set-based feature selection for breast cancer diagnosis. Expert Syst. Appl. 38(7), 9014–9022 (2011)CrossRefGoogle Scholar
  11. 11.
    Übeyli, E.D.: Multiclass support vector machines for diagnosis of erythemato-squamous diseases. Expert Syst. Appl. 35(4), 1733–1740 (2008)CrossRefGoogle Scholar
  12. 12.
    Sweilam, N.H., Tharwat, A.A., Abdel Moniem, N.K.: Support vector machine for diagnosis cancer disease: a comparative study. Egypt. Inform. J. 11(2), 81–92 (2010)Google Scholar
  13. 13.
    Li, Y., Xia, J., Zhang, S., Yan, J., Ai, X., Dai, K.: An efficient intrusion detection system based on support vector machines and gradually feature removal method. Expert Syst. Appl. 39(1), 424–430 (2012)CrossRefGoogle Scholar
  14. 14.
    Kuang, F., Xu, W., Zhang, S.: A novel hybrid KPCA and SVM with GA model for intrusion detection. Appl. Soft Comput. 18, 178–184 (2014)CrossRefGoogle Scholar
  15. 15.
    Shin, K.S., Lee, T.S., Kim, H.J.: An application of support vector machines in bankruptcy prediction model. Expert Syst. Appl. 28(1), 127–135 (2005)CrossRefGoogle Scholar
  16. 16.
    Min, S.H., Lee, J., Han, I.: Hybrid genetic algorithms and support vector machines for bankruptcy prediction. Expert Syst. Appl. 31(3), 652–660 (2006)CrossRefGoogle Scholar
  17. 17.
    Han, B.J., Ho, S., Dannenberg, R.B., Hwang, E.: SMERS: Music emotion recognition using support vector regression (2009)Google Scholar
  18. 18.
    Guo, G., Li, S.Z., Chan, K.L.: Support vector machines for face recognition. Image Vis. Comput. 19(9), 631–638 (2001)CrossRefGoogle Scholar
  19. 19.
    Kim, K.J.: Financial time series forecasting using support vector machines. Neurocomputing 55(1), 307–319 (2003)CrossRefGoogle Scholar
  20. 20.
    Hsu, C.W., Lin, C.J.: A comparison of methods for multiclass support vector machines. Neural Netw. IEEE Trans. 13(2), 415–425 (2002)CrossRefGoogle Scholar
  21. 21.
    Kerebel, U.H.G.: Pairwise Classification and Support Vector Machines: In Advances in Kernel Methods, pp. 255–268. MIT Press, Cambridge (1999)Google Scholar
  22. 22.
    Weston, J., Watkins, C.: Multi-class support vector machines. Technical Report CSD-TR-98–04, Department of Computer Science, Royal Holloway, University of London, May (1998)Google Scholar
  23. 23.
    Lee, Y., Lin, Y., Wahba, G.: Multicategory support vector machines. In Proceedings of the 33rd Symposium on the Interface (2001)Google Scholar
  24. 24.
    Platt, J.C., Cristianini, N., Shawe-Taylor, J.: Large Margin Dags For Multiclass Classification. In NIPS, vol. 12, 547–553 (1999)Google Scholar
  25. 25.
    Jayadeva, K., Khemchandani, R., Chandra, S.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–910 (2007)Google Scholar
  26. 26.
    Shao, Y.H., Zhang, C.H., Wang, X.B., Deng, N.Y.: Improvements on twin support vector machines. IEEE Trans. on Neural Netw. 22(6), 962–968 (2011)CrossRefGoogle Scholar
  27. 27.
    Mangasarian, O.L., Musicant, D.R.: Successive overrelaxation for support vector machines. IEEE Trans. Neural Netw. 10(5), 1032–1037 (1999)CrossRefGoogle Scholar
  28. 28.
  29. 29.
    Yang, Z.X., Shao, Y.H., Zhang, X.S.: Multiple birth support vector machine for multi-class classification. Neural Comput. Appl. 22(1), 153–161 (2013)CrossRefGoogle Scholar
  30. 30.
    Xu, Y., Guo, R., Wang, L.: A twin multi-class classification support vector machine. Cognitive Comput. 5(4), 580–588 (2013)CrossRefGoogle Scholar

Copyright information

© Springer India 2016

Authors and Affiliations

  1. 1.Indian Institute of Information TechnologyAllahabadIndia

Personalised recommendations