Abstract
We consider the problem of multiclass decomposition schemes for Support Vector Machines with Linear, Polynomial and RBF kernels. Our aim is to compare and discuss popular multiclass decomposing approaches such as the One versus the Rest, One versus One, Decision Directed Acyclic Graphs, Tree Structured, Error Correcting Output Codes. We conducted our experiments on benchmark datastes consisting of camera images of 3D objects. In our experiments we found that all the multiclass decomposing schemes for SVMs performed comparably very well with no significant statistical differences in cases of nonlinear kernels. In case of linear kernels the multiclass schemes OvR, OvO and DDAG outperform Tree Structured and ECOC.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing Multiclass to Binary: Unifying Approach for Margin Classifiers. In: Proc. 17th Int’l Conf. on Machine Learning, pp. 9–16 (2000)
Cortes, C., Vapnik, V.: Support Vector Networks. Machine Learning 20, 273–297 (1995)
Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. Jour. of Artificial Intelligence Research 2, 263–286 (1995)
Duda, R., Hart, P., Stork, D.: Pattern Classification. John Wiley & Sons, New York (2001)
Fay, R., Kaufmann, U., Schwenker, F., Palm, G.: Learning Object Recognition in a NeuroBotic System. In: Groß, H.-M., Debes, K., Böhme, H.-J. (eds.) 3rd Workshop on Self Organization of AdaptiVE Behavior SOAVE 2004, VDI, Dsseldorf, pp. 198–209 (2004)
Freeman, W.T., Roth, M.: Orientation histogram for hand gesture recognition. In: IEEE Int’l Workshop on Automatic Face and Gesture Recognition, Zurich, pp. 296–301 (1995)
Friedman, J.H.: Another approach to polychotomous classification. Technical report, Stanford University, Department of Statistics (1996)
Hastie, T., Tibshirani, R.: Classification by pairwise coupling. The Annals of Statistics 2, 451–471 (1998)
Hastie, T., Tibshirani, R., Friedman, J.H.: The elements of statistical learning: data mining, inference, and prediction. Springer, New York (2001)
Kreßel, U.: Pairwise classification and support vector machines. In: Schölkopf, B., Burges, C., Smola, A. (eds.) Advances in Kernel Methods, ch. 15, pp. 255–268. MIT Press, Cambridge (1999)
Lawrence, S., Giles, L., Tsoi, A.C., Back, A.D.: Face recognition: A convolutional neural network approach. IEEE TNN 8(1), 98–113 (1997)
Mel, B.W.: SEEMORE: Combining color, shape and texture histogramming in a neurally-inspired approach to visual object recognition. Neural Computation 9(4), 777–804 (1997)
Nene, S., Nayar, S., Murase, H.: Columbia Object Image Library. Technical Report CUCS-005-96 and CUCS-006-96, Columbia University (1996)
Nilsback, M.E., Caputo, B.: Cue integration through discriminative accumulation. In: CVPR (2), pp. 578–585 (2004)
Platt, J.C.: Sequential Minimal Optimization: A Fast Algorithm for Training SVMs. Technical Report MSR-TR-98-14, Microsoft Research (1998)
Platt, J.C., Cristianini, N., Shawe-Taylor, J.: Large Margin DAGS for Multiclass Classification. In: Solla, S.A., Leen, T.K., Mueller, K.-R. (eds.) Advances in Neural Information Processing Systems, vol. 12, pp. 547–553 (2000)
Rifkin, R., Klautau, A.: In defense of one-vs-all classification. Journal of Machine Learning Research 5, 101–141 (2004)
Schölkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, Cambridge (2002)
Schwenker, F.: Solving Multi-Class Pattern Recognition Problems with Tree Structured Support Vector Machines. In: Radig, B., Florczyk, S. (eds.) Mustererkennung 2001, pp. 283–290. Springer, Heidelberg (2001)
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, N.Y (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kahsay, L., Schwenker, F., Palm, G. (2005). Comparison of Multiclass SVM Decomposition Schemes for Visual Object Recognition. In: Kropatsch, W.G., Sablatnig, R., Hanbury, A. (eds) Pattern Recognition. DAGM 2005. Lecture Notes in Computer Science, vol 3663. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550518_42
Download citation
DOI: https://doi.org/10.1007/11550518_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28703-2
Online ISBN: 978-3-540-31942-9
eBook Packages: Computer ScienceComputer Science (R0)