Constructive induction: A preprocessor
Inductive algorithms rely strongly on their representational biases. Representational inadequacy can be mitigated by constructive induction. This paper introduces the notion of relative gain measure and describes a new constructive induction algorithm (GALA) which generates a small number of new attributes from existing nominal or real-valued attributes. Unlike most previous research on constructive induction, our techniques are designed for use in preprocessing data set for subsequent use by any standard selective learning algorithms. We present results which demonstrate the effectiveness of GALA on both artificial and real domains with respect to C4.5 and CN2.
Keywordslearning classification constructive induction
Unable to display preview. Download preview PDF.
- Quinlan, J. R. C4-5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA, 1993.Google Scholar
- Clark, P. & Niblett, T. “The CN2 Induction Algorithm”, Machine Learning 3, p261–283, 1989.Google Scholar
- Pagallo, G & Haussler, D. “Boolean Feature Discovery in Empirical Learning”, Machine Learning 5, p71–99, 1990.Google Scholar
- Yang, D-S., Rendell, L. A., Blix, G. “A Scheme for Feature Construction and a Comparison of Empirical Methods”, in Proceeding of the 12th International Joint Conference on Artificial Intelligence, p699–704, 1991.Google Scholar
- Matheus, C. J. & Rendell, L. A. “Constructive Induction on Decision Trees”, in Proceeding of the llth International Joint Conference on Artificial Intelligence, p645–650, 1989.Google Scholar
- Norton, S. W. “Generating better Decision Trees”, in Proceeding of the 11th International Joint Conference on Artificial Intelligence, p800–805, 1989.Google Scholar
- Ragavan, H. & Rendell, L. “Lookahead Feature Construction for Learning Hard Concepts”, in Proceeding of the 10th Machine Learning Conference, p252–259, 1993.Google Scholar
- Murphy, P. and Aha, D. “UCI Repository of Machine Learning Databases”, Tech. Report, University of California, Irvine, 1994.Google Scholar