Evolutionary response surfaces for classification: an interpretable model
- 170 Downloads
Response surfaces are powerful tools for both classification and regression because they are able to model many different phenomena and construct complex boundaries between classes. With very simple expressions, response surfaces are able to accurately solve difficult problems. Thus, the interpretability of the results is very interesting from the point of view of the expert, which is provided by a classification model from which useful information may be inferred.
However, response surfaces suffer from a major problem that limits their applicability. Even with a low degree and a moderate number of features, the number of terms in the surfaces is extremely large. Thus, standard learning algorithms find many problems to efficiently obtain the coefficients of the terms, and the risk of overfitting is high.
To overcome this problem we present evolutionary response surfaces for the classification of two-class problems. The use of a fitness function that combines accuracy and interpretability obtains accurate classifiers that are simple and interpretable by the expert. The results obtained for 20 problems from the UCI Machine Learning Repository are comparable with well-known classification algorithms with a more interpretable polynomial function.
KeywordsClassification Genetic algorithms Response surfaces
- 8.del Castillo-Gomariz R, García-Pedrajas N (2006) Classification by means of evolutionary response surfaces. In: Proceedings of the 14th European symposium on artificial neural networks, Bruges, Belgium, April Google Scholar
- 11.Eshelman LJ, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. In: Whitley LD (ed) Foundations of genetic algorithms, vol 2. Morgan Kaufmann, San Mateo, pp 187–202 Google Scholar
- 12.Ferreira SLC, Bruns RE, da Silva EGP, dos Santos WNL, Quintella CM, David JM, de Andrade JB, Breitkreitz MC, Jardim ICSF, Neto BB (2007) Statistical designs and response surface techniques for the optimization of chromatographic systems. J Chromatogr A 1158(1–2):2–14 Google Scholar
- 14.Frank A, Asuncion A (2010) UCI machine learning repository Google Scholar
- 24.Khuri AI, Mukhopadhyay S (2010) Response surface methodology. Comput Stat 2:128–149 Google Scholar
- 33.Myers RH, Montgomery DC, Vining G, Borror CM, Kowalski SM (2004) Response surface methodology: a retrospective and literature survey. J Qual Technol 36(1):53–78 Google Scholar
- 39.Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo Google Scholar
- 52.Vapnik V (1999) The nature of statistical learning theory. Springer, New York Google Scholar