Abstract
Support Vector Machine (SVM) is mainly used to classify the data into two categories. To solve the multi-category problems using SVM, researchers used two approaches. The first approach based on solving multiple SVM binary classifiers, whereas another approach based on solving a single optimization problem. In this paper, we have used the first approach and proposed an Efficient Multiclass Support Vector Machine (ESVM) algorithm using a skewed binary tree. To construct the skewed binary tree, no extra efforts are required as compared to the binary tree approach. The algorithm is tested on the benchmark data sets, and the results are compared with both the multiclass approaches of SVM. The ESVM’s results are compared with five techniques of solving multiple binary SVM classifiers and four techniques of solving a single optimization problem. The comparative experiments prove the efficiency of the ESVM in terms of its accuracy as compared to other contemporary algorithms. Further, ESVM is successfully applied for classification of the email dataset into positive, negative and neutral sentiments.
Similar content being viewed by others
References
Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20(3):273–297
Vapnik V, Golowich S, Smola A (1997) Support vector method for function approximation, regression estimation and signal processing. In: Advances in neural information processing systems. MIT Press, pp 281–287
Hsu C, Lin C (2002) A comparison of methods for multiclass support vector machines. IEEE Trans Neural Netw 13(2):415–425. https://doi.org/10.1109/72.991427
Weston J, Watkins C (1999) Support vector machines for multi-class pattern recognition. ESANN 99:219–224
Madzarov D, Gjorgjevikj G, Chorbey I (2009) A multi-class SVM classifier utilizing binary decision tree. Informatica 33:233–241
Ben-Hur A, Weston J (2010) A user’s guide to support vector machines. In: Data mining techniques for the life sciences, pp 223–239
Platt J, Cristianini N, Shawe-Taylor J (2000) Large margin DAG’s for multiclass classification. In: Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553
Fei B, Liu J (2006) Binary tree of SVM: a new fast multiclass training and classification algorithm. IEEE Trans Neural Netw 17(3):696–704. https://doi.org/10.1109/TNN.2006.872343
Liu Y, Wang R, Zeng Y, He H (2007) An improvement of one-against-one method for multi-class support vector machine. Proc IEEE Int Conf Mach Learn Cybern. https://doi.org/10.1109/ICMLC.2007.4370646
Sidaoui B, Sadouni K (2012) Efficient binary tree multiclass SVM using genetic algorithms for vowels recognition[J]. J Commun Comput 9(10):1116–1123
Wang X, Lu S, Zhai J (2008) Fast fuzzy multicategory SVM based on support vector domain description. Int J Pattern Recogn Artif Intell 22(1):109–120
Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:27:1–27:27. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm
Enron Email Dataset, http://www.cs.cmu.edu/~enron/
Crammer K, Singer Y (2002) On the learnability and design of output codes for multiclass problems. Mach Learn 47(2):201–233
Lee Y, Lin Y, Wahba G (2004) Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J Am Stat Assoc 99(465):67–81
Liu Y, Yuan M (2011) Reinforced multicategory support vector machines. J Comput Graph Stat 20 (4):901–919
Zhang C, Liu Y, Wang J, Zhu H (2016) Reinforced angle-based multicategory support vector machines. J Comput Graph Stat 25(3):806–825
Dogan U, Glasmachers T, Igel C (2016) A unified view on multi-class support vector classification. J Mach Learn Res 17(45):1–32
Bogawar P, Bhoyar K (2016) Soft computing approaches to classification of emails for sentiment analysis. In: Proceedings of the international conference on informatics and analytics. ACM, pp 22–28. https://doi.org/10.1145/2980258.2980304
Lin Y (2004) A note on margin-based loss functions in classification. Stat Probab Lett 68(1):73–82k
Acknowledgments
I am very thankful to Dr. Piyush G. Gampawar for his valuable suggestions in the paper writing. I am very grateful to the reviewers of the paper as there valuable suggestions were very helpful for drafting the well organized paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bogawar, P.S., Bhoyar, K.K. An improved multiclass support vector machine classifier using reduced hyper-plane with skewed binary tree. Appl Intell 48, 4382–4391 (2018). https://doi.org/10.1007/s10489-018-1218-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-018-1218-y