TrueSkill-Based Pairwise Coupling for Multi-class Classification
A multi-class classification problem can be solved efficiently via decomposition of the problem into multiple binary classification problems. As a way of such decomposition, we propose a novel pairwise coupling method based on the TrueSkill ranking system. Instead of aggregating all pairwise binary classification results for the final decision, the proposed method keeps track of the ranks of the classes during the successive binary classification procedure. Especially, selection of a binary classifier at a certain step is done in such a way that the multi-class classification decision using the binary classification results up to the step converges to the final one as quickly as possible. Thus, the number of binary classifications can be reduced, which in turn reduces the computational complexity of the whole classification system. Experimental results show that the complexity is reduced significantly for no or minor loss of classification performance.
KeywordsTrueSkill multi-class classification classifier fusion match-making pairwise coupling on-line ranking
Unable to display preview. Download preview PDF.
- 3.Crammer, K., Singer, Y.: On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2, 265–292 (2001)Google Scholar
- 5.Elo, A.E.: The Rating of Chessplayers, Past and Present. Arco Publishing, New York (1986)Google Scholar
- 6.Frank, A., Asuncion, A.: UCI machine learning repository. School of Information and Computer Science, University of California, Irvine (2010)Google Scholar
- 8.Glickmann, M.E.: Parameter estimation in large dynamic paired comparison experiments. Appl. Statist. 48, 377–394 (1999)Google Scholar
- 10.Herbrich, R., Minka, T., Graepel, T.: Trueskill: a Bayesian skill rating system. In: Adv. Neural Info. Process. Syst., vol. 19, pp. 569–576. MIT Press, Cambridge (2007)Google Scholar
- 12.Kreßel, U.: Pairwise classification and support vector machines. In: Schölkopf, B., Burges, C.J.C., Smola, A.J. (eds.) Advances in Kernel Methods-Support Vector Learning, pp. 255–268. MIT Press, Cambridge (1999)Google Scholar