Advertisement

Constructive induction: A preprocessor

  • Yuh-Jyh Hu
Learning I: Induction
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1081)

Abstract

Inductive algorithms rely strongly on their representational biases. Representational inadequacy can be mitigated by constructive induction. This paper introduces the notion of relative gain measure and describes a new constructive induction algorithm (GALA) which generates a small number of new attributes from existing nominal or real-valued attributes. Unlike most previous research on constructive induction, our techniques are designed for use in preprocessing data set for subsequent use by any standard selective learning algorithms. We present results which demonstrate the effectiveness of GALA on both artificial and real domains with respect to C4.5 and CN2.

Keywords

learning classification constructive induction 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Quinlan, J. R. C4-5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA, 1993.Google Scholar
  2. [2]
    Clark, P. & Niblett, T. “The CN2 Induction Algorithm”, Machine Learning 3, p261–283, 1989.Google Scholar
  3. [3]
    Pagallo, G & Haussler, D. “Boolean Feature Discovery in Empirical Learning”, Machine Learning 5, p71–99, 1990.Google Scholar
  4. [4]
    Yang, D-S., Rendell, L. A., Blix, G. “A Scheme for Feature Construction and a Comparison of Empirical Methods”, in Proceeding of the 12th International Joint Conference on Artificial Intelligence, p699–704, 1991.Google Scholar
  5. [5]
    Matheus, C. J. & Rendell, L. A. “Constructive Induction on Decision Trees”, in Proceeding of the llth International Joint Conference on Artificial Intelligence, p645–650, 1989.Google Scholar
  6. [6]
    Norton, S. W. “Generating better Decision Trees”, in Proceeding of the 11th International Joint Conference on Artificial Intelligence, p800–805, 1989.Google Scholar
  7. [7]
    Ragavan, H. & Rendell, L. “Lookahead Feature Construction for Learning Hard Concepts”, in Proceeding of the 10th Machine Learning Conference, p252–259, 1993.Google Scholar
  8. [8]
    Murphy, P. and Aha, D. “UCI Repository of Machine Learning Databases”, Tech. Report, University of California, Irvine, 1994.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1996

Authors and Affiliations

  • Yuh-Jyh Hu
    • 1
  1. 1.Information and Computer Science DepartmentUniversity of CaliforniaIrvine

Personalised recommendations