A Multiclass Classification Method Based on Output Design

  • Qi Qiang
  • Qinming He
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3918)


Output coding is a general framework for solving multiclass categorization problems. Some researchers have presented the notion of continuous codes and methods for designing output codes. However these methods are time-consuming and expensive. This paper describes a new framework, which we call Strong-to-Weak-to-Strong (SWS). We transform a “strong” learning algorithm to a “weak” algorithm by decreasing its iterative numbers of optimization while preserving its other characteristics like geometric properties and then make use of the kernel trick for “weak” algorithms to work in high dimensional spaces, finally improve the performances. An inspiring experimental results show that this approach is competitive with the other methods.


High Dimensional Space Binary Classifier Polynomial Kernel Output Code Kernel Trick 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Crammer, K., Singer, Y.: On the Learnability and Design of Output Codes for Multiclass Problems. In: Proceedings of the Thirteenth Annual Conference on Computational Learning Theory, pp. 35–46 (2000)Google Scholar
  2. 2.
    Lanckriet, R.G., Ghaoui, L.E., Bhattacharyya, C., Jordan, M.I.: A robust minimax approach to classification. Journal of Machine Learning Research 3, 555–582 (2002)MathSciNetMATHGoogle Scholar
  3. 3.
    Vapnik, V.: The Nature of Statistical Learning Theory. Spinger, New York (1995)CrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Qi Qiang
    • 1
  • Qinming He
    • 1
    • 2
  1. 1.College of Computer ScienceZhejiang UniversityHangzhouChina
  2. 2.Ningbo Institute of TechnologyZhejiang UniversityNingboChina

Personalised recommendations