Ensemble Approaches of Support Vector Machines for Multiclass Classification
Support vector machine (SVM) which was originally designed for binary classification has achieved superior performance in various classification problems. In order to extend it to multiclass classification, one popular approach is to consider the problem as a collection of binary classification problems. Majority voting or winner-takes-all is then applied to combine those outputs, but it often causes problems to consider tie-breaks and tune the weights of individual classifiers. This paper presents two novel ensemble approaches: probabilistic ordering of one-vs-rest (OVR) SVMs with naïve Bayes classifier and multiple decision templates of OVR SVMs. Experiments with multiclass datasets have shown the usefulness of the ensemble methods.
KeywordsSupport vector machines Ensemble Naïve Bayes Multiple decision templates Cancer classification Fingerprint classification
- 2.Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines. Cambridge University Press, Cambridge (2000)Google Scholar
- 4.Arenas-Garcia, J., Perez-Cruz, F.: Multi-Class Support Vector Machines: A New Approach. In: 2003 IEEE Int. Conf. Acoustics, Speech, and Signal Processing, pp. II-781–784 (2003) Google Scholar
- 7.Lee, Y., Lin, Y., Wahba, G.: Multicategory Support Vector Machines. Tech. Rep. 1043, Dept. Statistics, Univ. of Wisconsin (2001) Google Scholar