Abstract
In this paper, we provide a general introduction to the so-called multi-objective evolutionary algorithms, which are metaheuristic search techniques inspired on natural evolution that are able to deal with highly complex optimization problems having two or more objectives. In the first part of the paper, we provide some basic concepts necessary to make the paper self-contained, as well as a short review of the most representative multi-objective evolutionary algorithms currently available in the specialized literature. After that, a short review of applications of these algorithms in pattern recognition is provided. The final part of the paper presents some possible future research paths in this area as well as our conclusions.
Chapter PDF
Similar content being viewed by others
Keywords
- Pareto Front
- Evolutionary Computation
- Multiobjective Optimization
- Multiobjective Evolutionary Algorithm
- Strength Pareto Evolutionary Algorithm
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Miettinen, K.M.: Nonlinear Multiobjective Optimization. Kluwer Academic Publishers, Boston, Massachusetts (1999)
Blum, C., Roli, A.: Metaheuristics in combinatorial optimization: Overview and conceptual comparison. ACM Computing Surveys 35(3), 268–308 (2003)
Coello Coello, C.A., Lamont, G.B., Van Veldhuizen, D.A.: Evolutionary Algorithms for Solving Multi-Objective Problems, 2nd edn. Springer, New York (2007) ISBN 978-0-387-33254-3
Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Publishing Company, Reading (1989)
Schaffer, J.D.: Multiple Objective Optimization with Vector Evaluated Genetic Algorithms. In: Genetic Algorithms and their Applications: Proceedings of the First International Conference on Genetic Algorithms, Lawrence Erlbaum, pp. 93–100 (1985)
Holland, J.H.: Concerning efficient adaptive systems. In: Yovits, M.C., Jacobi, G.T., Goldstein, G.D. (eds.) Self-Organizing Systems—1962, pp. 215–230. Spartan Books, Washington, D.C (1962)
Schwefel, H.P.: Kybernetische evolution als strategie der experimentellen forschung in der strömungstechnik. Dipl.-Ing. thesis (1965) (in German)
Fogel, L.J.: Artificial Intelligence through Simulated Evolution. John Wiley, New York (1966)
Fonseca, C.M., Fleming, P.J.: Genetic Algorithms for Multiobjective Optimization: Formulation, Discussion and Generalization. In: Forrest, S. (ed.) Proceedings of the Fifth International Conference on Genetic Algorithms, San Mateo, California, University of Illinois at Urbana-Champaign, pp. 416–423. Morgan Kauffman Publishers (1993)
Srinivas, N., Deb, K.: Multiobjective optimization using nondominated sorting in genetic algorithms. Technical report, Department of Mechanical Engineering, Indian Institute of Technology, Kanpur, India (1993)
Beume, N., Naujoks, B., Emmerich, M.: SMS-EMOA: Multiobjective selection based on dominated hypervolume. European Journal of Operational Research 181(3), 1653–1669 (2007)
Goldberg, D.E., Richardson, J.: Genetic algorithm with sharing for multimodal function optimization. In: Grefenstette, J.J. (ed.) Genetic Algorithms and Their Applications: Proceedings of the Second International Conference on Genetic Algorithms, Hillsdale, New Jersey, pp. 41–49. Lawrence Erlbaum (1987)
Deb, K., Goldberg, D.E.: An Investigation of Niche and Species Formation in Genetic Function Optimization. In: Schaffer, J.D. (ed.) Proceedings of the Third International Conference on Genetic Algorithms, San Mateo, California, George Mason University, pp. 42–50. Morgan Kaufmann Publishers (June 1989)
Toscano Pulido, G., Coello Coello, C.A.: Using Clustering Techniques to Improve the Performance of a Multi-objective Particle Swarm Optimizer. In: Deb, K., Tari, Z. (eds.) GECCO 2004. LNCS, vol. 3102, pp. 225–237. Springer, Heidelberg (2004)
Zitzler, E., Deb, K., Thiele, L.: Comparison of Multiobjective Evolutionary Algorithms on Test Functions of Different Difficulty. In: Wu, A.S. (ed.) Proceedings of the 1999 Genetic and Evolutionary Computation Conference on Workshop Program, Orlando, Florida, pp. 121–122 (July 1999)
Knowles, J., Corne, D.: Properties of an Adaptive Archiving Algorithm for Storing Nondominated Vectors. IEEE Transactions on Evolutionary Computation 7(2), 100–116 (2003)
Kita, H., Yabumoto, Y., Mori, N., Nishikawa, Y.: Multi-Objective Optimization by Means of the Thermodynamical Genetic Algorithm. In: Ebeling, W., Rechenberg, I., Voigt, H.-M., Schwefel, H.-P. (eds.) PPSN 1996. LNCS, vol. 1141, pp. 504–512. Springer, Heidelberg (1996)
Cui, X., Li, M., Fang, T.: Study of Population Diversity of Multiobjective Evolutionary Algorithm Based on Immune and Entropy Principles. In: Proceedings of the Congress on Evolutionary Computation 2001 (CEC 2001), vol. 2, pp. 1316–1321. IEEE Service Center, Piscataway (2001)
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A Fast and Elitist Multiobjective Genetic Algorithm: NSGA–II. IEEE Transactions on Evolutionary Computation 6(2), 182–197 (2002)
Knowles, J.D., Corne, D.W.: Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy. Evolutionary Computation 8(2), 149–172 (2000)
Schuetze, O., Laumanns, M., Tantar, E., Coello Coello, C.A., Talbi, E.G.: Computing Gap Free Pareto Front Approximations with Stochastic Search Algorithms. Evolutionary Computation 18(1), 65–96 (2010)
Srinivas, N., Deb, K.: Multiobjective Optimization Using Nondominated Sorting in Genetic Algorithms. Evolutionary Computation 2(3), 221–248 (1994)
Zitzler, E., Laumanns, M., Thiele, L.: SPEA2: Improving the Strength Pareto Evolutionary Algorithm. In: Giannakoglou, K., Tsahalis, D., Periaux, J., Papailou, P., Fogarty, T. (eds.) Evolutionary Methods for Design, Optimization and Control with Applications to Industrial Problems, EUROGEN 2001, Athens, Greece, pp. 95–100 (2002)
Zhang, Q., Li, H.: MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition. IEEE Transactions on Evolutionary Computation 11(6), 712–731 (2007)
Chen, C.M., Ping Chen, Y., Zhang, Q.: Enhancing MOEA/D with Guided Mutation and Priority Update for Multi-Objective Optimization. In: 2009 IEEE Congress on Evolutionary Computation (CEC 2009), Trondheim, Norway, pp. 209–216. IEEE Press (May 2009)
Chiang, T.C., Lai, Y.P.: MOEA/D-AMS: Improving MOEA/D by an Adaptive Mating Selection Mechanism. In: 2011 IEEE Congress on Evolutionary Computation (CEC 2011), New Orleans, Lousiana, USA, June 5-8, pp. 1473–1480. IEEE Service Center (2011)
Qi, Y., Ma, X., Liu, F., Jiao, L., Sun, J., Wu, J.: MOEA/D with Adaptive Weight Adjustment. Evolutionary Computation 22(2), 231–264 (2014)
Zitzler, E., Künzli, S.: Indicator-based Selection in Multiobjective Search. In: Yao, X., et al. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 832–842. Springer, Heidelberg (2004)
Deb, K., Mohan, M., Mishra, S.: Evaluating the ε-Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions. Evolutionary Computation 13(4), 501–525 (2005)
Toscano Pulido, G., Coello Coello, C.A.: The Micro Genetic Algorithm 2: Towards Online Adaptation in Evolutionary Multiobjective Optimization. In: Fonseca, C.M., Fleming, P.J., Zitzler, E., Deb, K., Thiele, L. (eds.) EMO 2003. LNCS, vol. 2632, pp. 252–266. Springer, Heidelberg (2003)
Knowles, J.: ParEGO: A Hybrid Algorithm With On-Line Landscape Approximation for Expensive Multiobjective Optimization Problems. IEEE Transactions on Evolutionary Computation 10(1), 50–66 (2006)
Bader, J., Zitzler, E.: HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization. Evolutionary Computation 19(1), 45–76 (2011)
RodrÃguez Villalobos, C.A., Coello Coello, C.A.: A New Multi-Objective Evolutionary Algorithm Based on a Performance Assessment Indicator. In: 2012 Genetic and Evolutionary Computation Conference (GECCO 2012), Philadelphia, USA, pp. 505–512. ACM Press (July 2012) ISBN: 978-1-4503-1177-9
Hernández Gómez, R., Coello Coello, C.A.: MOMBI: A New Metaheuristic for Many-Objective Optimization Based on the R2 Indicator. In: 2013 IEEE Congress on Evolutionary Computation (CEC 2013), Cancún, México, June 20-23, pp. 2488–2495. IEEE Press (2013) ISBN 978-1-4799-0454-9
Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello, C.A.C.: A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I. IEEE Transactions on Evolutionary Computation 18(1), 4–19 (2014)
Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello, C.A.C.: A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part II. IEEE Transactions on Evolutionary Computation 18(1), 20–35 (2014)
Zheng, Y.J., Ling, H.F., Xue, J.Y., Chen, S.Y.: Population Classification in Fire Evacuation: A Multiobjective Particle Swarm Optimization Approach. IEEE Transactions on Evolutionary Computation 18(1), 70–81 (2014)
Suttorp, T., Igel, C.: Multi-Objective Optimization of Support Vector Machines. In: Jin, Y. (ed.) Multi-Objective Machine Learning. SCI, vol. 16, pp. 199–220. Springer, Heidelberg (2006)
Chin-Wei, B., Rajeswari, M.: Multiobjective Optimization Approaches in Image Segmentation–The Directions and Challenges. International on Advances in Soft Computing and its Applications 2(1), 40–65 (2010)
Mukhopadhyay, A., Maulik, U.: A multiobjective approach to MR brain image segmentation. Applied Soft Computing 11(1), 872–880 (2011)
Bhanu, B., Lee, S.: Genetic Learning for Adaptive Image Segmentation. Kluwer Academic Publishers, Boston (1994)
Mendes, F., Duarte, J., Vieira, A., Gaspar-Cunha, A.: Feature Selection for Bankruptcy Prediction: A Multi-Objective Optimization Approach. In: Gao, X.Z., Gaspar-Cunha, A., Köppen, M., Schaefer, G., Wang, J. (eds.) Soft Computing in Industrial Applications. AISC, vol. 75, pp. 109–115. Springer, Heidelberg (2010)
Morita, M., Sabourin, R., Bortolozzi, F., Suen, C.: Unsupervised Feature Selection Using Multi-Objective Genetic Algorithm for Handwritten Word Recognition. In: Proceedings of the 7th International Conference on Document Analysis and Recognition (ICDAR 2003), Edinburgh, Scotland, pp. 666–670 (August 2003)
Guo, P.F., Bhattacharya, P., Kharma, N.: An Efficient Image Pattern Recognition System Using an Evolutionary Search Strategy. In: Proceedings of the 2009 IEEE International Conference on Systems, Man, and Cybernetics, San Antonio, Texas, USA. IEEE Press (October 2009)
Jin, Y.: A comprehensive survey of fitness approximation in evolutionary computation. Soft Computing 9(1), 3–12 (2005)
Reyes Sierra, M., Coello Coello, C.A.: Fitness Inheritance in Multi-Objective Particle Swarm Optimization. In: 2005 IEEE Swarm Intelligence Symposium (SIS 2005), Pasadena, California, USA, pp. 116–123. IEEE Press (June 2005)
López Jaimes, A., Coello Coello, C.A.: MRMOGA: A New Parallel Multi-Objective Evolutionary Algorithm Based on the Use of Multiple Resolutions. Concurrency and Computation: Practice and Experience 19(4), 397–441 (2007)
Sharma, D., Collet, P.: GPGPU-Compatible Archive Based Stochastic Ranking Evolutionary Algorithm (G-ASREA) for Multi-Objective Optimization. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) PPSN XI. LNCS, vol. 6239, pp. 111–120. Springer, Heidelberg (2010)
Lim, D., Jin, Y., Ong, Y.S., Sendhoff, B.: Generalizing Surrogate-Assisted Evolutionary Computation. IEEE Transactions on Evolutionary Computation 14(3), 329–355 (2010)
Corne, D., Dorigo, M., Glover, F. (eds.): New Ideas in Optimization. McGraw-Hill, London (1999)
Dasgupta, D. (ed.): Artificial Immune Systems and Their Applications. Springer, Berlin (1999)
de Castro, L.N., Timmis, J.: An Introduction to Artificial Immune Systems: A New Computational Intelligence Paradigm. Springer, London (2002) ISBN 1-85233-594-7
Wang, W., Gao, S., Tang, Z.: Improved pattern recognition with complex artificial immune system. Soft Computing 13(12), 1209–1217 (2009)
Yang, D., Jiao, L., Gong, M., Liu, F.: Artificial immune multi-objective SAR image segmentation with fused complementary features. Information Sciences 181(13), 2797–2812 (2011)
Kennedy, J., Eberhart, R.C.: Swarm Intelligence. Morgan Kaufmann Publishers, San Francisco (2001)
Dehuri, S., Cho, S.B.: Multi-criterion Pareto based particle swarm optimized polynomial neural network for classification: A review and state-of-the-art. Computer Science Review 3(1), 19–40 (2009)
Dorigo, M., Stützle, T.: Ant Colony Optimization. The MIT Press (2004) ISBN 0-262-04219-3
He, Y., Chen, D., Zhao, W.: Integrated method of compromise-based ant colony algorithm and rough set theory and its application in toxicity mechanism classification. Chemometrics And Intelligent Laboratory Systems 92(1), 22–32 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Coello-Coello, C.A. (2014). An Introduction to Evolutionary Multi-objective Optimization with Some Applications in Pattern Recognition. In: Bayro-Corrochano, E., Hancock, E. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2014. Lecture Notes in Computer Science, vol 8827. Springer, Cham. https://doi.org/10.1007/978-3-319-12568-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-12568-8_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12567-1
Online ISBN: 978-3-319-12568-8
eBook Packages: Computer ScienceComputer Science (R0)