Advertisement

A General Coding Method for Error-Correcting Output Codes

  • Yan-huang Jiang
  • Qiang-li Zhao
  • Xue-jun Yang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3056)

Abstract

ECOC approach can be used to reduce a multiclass categorization problem to multiple binary problems and to improve the generalization of classifiers. Yet there is no single coding method that can generate ECOCs suitable for any number of classes. This paper provides a search-coding method that associates nonnegative integers with binary strings. Given any number of classes and an expected minimum hamming distance, the method can find out a satisfied output code through searching an integer range. Experimental results show that, as a general coding method, the search-coding method can improve the generalization for both stable and unstable classifiers efficiently

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In: Parallel Distributed Processing-Explorations in the Microstructure of Cognition, ch. 8, pp. 318–362. MIT Press, Cambridge (1986)Google Scholar
  2. 2.
    Hastie, T., Tibshirani, R.: Classification by pairwise coupling. The Annals of Statistics 26.2, 451–471 (1998)MathSciNetGoogle Scholar
  3. 3.
    Sejnowski, T.J., Rosenberg, C.R.: Parallel networks that learn to pronounce english text. Journal of Complex Systems 1.1, 145–168 (1987)Google Scholar
  4. 4.
    Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 3.2, 263–286 (1995)Google Scholar
  5. 5.
    Allwein, E., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: A unifying approach for margin classifier. Journal of Machine Learning Research 1, 113–141 (2000)CrossRefMathSciNetGoogle Scholar
  6. 6.
    Kong, E.B., Dietterich, T.G.: Error-Correcting Output Coding Corrects Bias and Variance. In: Proceedings of the twelfth International Conference on Machine Learning, California, USA, pp. 313–321 (1995)Google Scholar
  7. 7.
    Bay, S.D.: UCI KDD Archive (1999), http://kdd.ics.uci.edu

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Yan-huang Jiang
    • 1
  • Qiang-li Zhao
    • 1
  • Xue-jun Yang
    • 1
  1. 1.School of Computer ScienceNational University of Defense TechnologyChangshaP.R.China

Personalised recommendations