Analyzing Classifier Hierarchy Multiclassifier Learning

  • J. M. Martínez-Otzeta
  • B. Sierra
  • E. Lazkano
  • E. Jauregi
  • Y. Yurramendi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5197)


Classifier combination falls in the so called machine learning area. Its aim is to combine some classification paradigms in order to improve the individual accuracy of the component classifiers. Classifier hierarchies are an alternative among the several methods of classifier combination. In this paper we present new results about a recently proposed hierarchy construction method. Experiments have been carried out over 42 databases from the UCI repository, showing an improvement over the performance of the base classifiers.


Classifier combination hierarchy of classifiers data mining 


  1. 1.
    Aha, D., Kibler, D., Albert, M.K.: Instance-Based learning algorithms. Machine Learning 6, 37–66 (1991)Google Scholar
  2. 2.
    Kohavi, R., Sommerfield, D., Dougherty, J.: Data Mining Using MLC++: A Machine Learning Library in C++. International Journal on Artificial Intelligence Tools 6(4), 537–566 (1997)CrossRefGoogle Scholar
  3. 3.
    Ho, T.K., Hull, J.J., Srihari, S.N.: Decision Combination in Multiple Classifier Systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(1), 66–75 (1994)CrossRefGoogle Scholar
  4. 4.
    Wolpert, D.H.: Stacked Generalization. Neural Networks 5, 241–259 (1992)CrossRefGoogle Scholar
  5. 5.
    Breiman, L.: Bagging predictors. Machine Learning 24(2), 123–140 (1996)zbMATHGoogle Scholar
  6. 6.
    Freund, Y., Schapire, R.E.: A Short Introduction to Boosting. Journal of Japanese Society for Artificial Intelligence 14(5), 771–780 (1999)Google Scholar
  7. 7.
    Gama, J.M.: Combining Classification Algorithms. PhD Thesis, Universidade do Porto (2000)Google Scholar
  8. 8.
    Martínez-Otzeta, J.M., Sierra, B., Lazkano, E., Astigarraga, A.: Classifier Hierarchy Learning by means of Genetic Algorithms. Pattern Recognition Letters 27(16), 1998–2004 (2006)CrossRefGoogle Scholar
  9. 9.
    Martínez-Otzeta, J.M., Sierra, B., Lazkano, E., Jauregi, E., Yurramendi, Y.: Naive + Naive = Smart Bayes? In: ICARA 2006: 3rd International Conference on Autonomous Robots and Agents, vol. I, pp. 291–295. Massey University Press, New Zealand (2006)Google Scholar
  10. 10.
    Demšar, J.: Statistical Comparisons of Classifiers over Multiple Data Sets. Journal of Machine Learning Research 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar
  11. 11.
    Lu, Y.: Knowledge Integration in a Multiple Classifier System. Applied Intelligence 6(2), 75–86 (1996)CrossRefGoogle Scholar
  12. 12.
    Jordan, M.I., Jacobs, R.A.: Hierarchical Mixtures of Experts and the EM Algorithm. Neural Computation 6(2), 181–214 (1994)CrossRefGoogle Scholar
  13. 13.
    University of California, Irvine, School of Information and Computer Sciences,
  14. 14.
    Quinlan, J.R.: Induction of Decision Trees. Machine Learning 1, 81–106 (1986)Google Scholar
  15. 15.
    Minsky, M.: Steps toward Artificial Intelligence. Proceedings of the Institute of Radio Engineers 49, 8–30 (1961)MathSciNetGoogle Scholar
  16. 16.
    Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo (1993)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • J. M. Martínez-Otzeta
    • 1
  • B. Sierra
    • 2
  • E. Lazkano
    • 2
  • E. Jauregi
    • 2
  • Y. Yurramendi
    • 2
  1. 1.Fundación TeknikerEibarSpain
  2. 2.Department of Computer Science and Artificial IntelligenceUniversity of the Basque CountryDonostia-San SebastiánSpain

Personalised recommendations