Genetic Programming and Evolvable Machines

, Volume 3, Issue 4, pp 329–343

Genetic Programming-based Construction of Features for Machine Learning and Knowledge Discovery Tasks

  • Krzysztof Krawiec

DOI: 10.1023/A:1020984725014

Cite this article as:
Krawiec, K. Genetic Programming and Evolvable Machines (2002) 3: 329. doi:10.1023/A:1020984725014


In this paper we use genetic programming for changing the representation of the input data for machine learners. In particular, the topic of interest here is feature construction in the learning-from-examples paradigm, where new features are built based on the original set of attributes. The paper first introduces the general framework for GP-based feature construction. Then, an extended approach is proposed where the useful components of representation (features) are preserved during an evolutionary run, as opposed to the standard approach where valuable features are often lost during search. Finally, we present and discuss the results of an extensive computational experiment carried out on several reference data sets. The outcomes show that classifiers induced using the representation enriched by the GP-constructed features provide better accuracy of classification on the test set. In particular, the extended approach proposed in the paper proved to be able to outperform the standard approach on some benchmark problems on a statistically significant level.

genetic programmingmachine learningchange of representationfeature constructionfeature selection

Copyright information

© Kluwer Academic Publishers 2002

Authors and Affiliations

  • Krzysztof Krawiec
    • 1
  1. 1.Institute of Computing SciencePoznań University of TechnologyPoznańPoland