Evolutionary Multi-Objective Approach for Prototype Generation and Feature Selection

  • Alejandro Rosales-Pérez
  • Jesus A. Gonzalez
  • Carlos A. Coello-Coello
  • Carlos A. Reyes-Garcia
  • Hugo Jair Escalante
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8827)


This paper introduces EMOPG+FS, a novel approach to prototype generation and feature selection that explicitly minimizes the classification error rate, the number of prototypes, and the number of features. Under EMOPG+FS, prototypes are initialized from a subset of training instances, whose positions are adjusted through a multi-objective evolutionary algorithm. The optimization process aims to find a set of suitable solutions that represent the best possible trade-offs among the considered criteria. Besides this, we also propose a strategy for selecting a single solution from the several that are generated during the multi-objective optimization process.We assess the performance of our proposed EMOPG+FS using a suite of benchmark data sets and we compare its results with respect to those obtained by other evolutionary and non-evolutionary techniques. Our experimental results indicate that our proposed approach is able to achieve highly competitive results.


  1. 1.
    Cervantes, A., Galvan, I., Isasi, P.: AMPSO: a new particle swarm method for nn classification. IEEE Trans. Sys. Man Cy. B 39(5), 1082–1091 (2009)CrossRefGoogle Scholar
  2. 2.
    Chen, J.-H., Chen, H.-M., Ho, S.-Y.: Design of nearest neighbor classifiers: multi-objective approach. Int. J. Approx. Reason. 40(1-2), 3–22 (2005)CrossRefzbMATHGoogle Scholar
  3. 3.
    Escalante, H.J., Marín-Castro, M., Morales-Reyes, A., Graff, M., Rosales-Pérez, A., Montes-y-Gómez, M., Reyes-Garcia, C.A., Gonzalez, J.A.: MOPG: A Multi-Objective Evolutionary Algorithm for Prototype Generation (Submitted 2014)Google Scholar
  4. 4.
    Escalante, H.J., Mendoza, K.M., Graff, M., Morales-Reyes, A.: Genetic programming of prototypes for pattern classification. In: Sanches, J.M., Micó, L., Cardoso, J.S. (eds.) IbPRIA 2013. LNCS, vol. 7887, pp. 100–107. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  5. 5.
    García, S., Derrac, J., Cano, J.R., Herrera, F.: Prototype selection for nearest neighbor classification: Taxonomy and empirical study. IEEE Trans. Pattern Anal. Mach. Intell. 34(3), 417–435 (2012)CrossRefGoogle Scholar
  6. 6.
    García-Limón, M., Escalante, H.J., Morales, E., Morales-Reyes, A.: Simultaneous Generation of Prototypes and Features through Genetic Programming. In: Proc. of GECCO, pp. 517–524 (2014)Google Scholar
  7. 7.
    Knowles, J.D., Corne, D.W.: Approximating the nondominated front using the pareto archived evolution strategy. Evol. Comput. 8(2), 149–172 (2000)CrossRefGoogle Scholar
  8. 8.
    Rosales-Pérez, A., Escalante, H.J., Coello Coello, C.A., Gonzalez, J.A., Reyes-Garcia, C.A.: An Evolutionary Multi-Objective Approach for Prototype Generation. In: Proc. of IEEE WCCI, pp. 1100–1007 (2014)Google Scholar
  9. 9.
    Triguero, I., Garcia, S., Herrera, F.: Differential evolution for optimizing the positioning of prototypes in nearest neighbor classification. Pattern Recogn. 44, 901–916 (2011)CrossRefGoogle Scholar
  10. 10.
    Triguero, I., Derrac, J., Garcia, S., Herrera, F.: A taxonomy and experimental study on prototype generation for nearest neighbor classification. IEEE Trans. Syst. Man Cy. C 42(1), 86–100 (2012)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Alejandro Rosales-Pérez
    • 1
  • Jesus A. Gonzalez
    • 1
  • Carlos A. Coello-Coello
    • 2
  • Carlos A. Reyes-Garcia
    • 1
  • Hugo Jair Escalante
    • 1
  1. 1.Computer Science Department, TonantzintlaInstituto Nacional de Astrofísica, Óptica y Electrónica (INAOE)PueblaMexico
  2. 2.Computer Science DepartmentCINVESTAV-IPNMexico CityMexico

Personalised recommendations