Parallel Evolutionary Computation Framework for Single- and Multiobjective Optimization

Abstract

Evolutionary computation is an area of computer science utilizing the mechanisms of biological evolution in computer problem solving. It is concerned with theoretical studies, design and application of stochastic optimization procedures, known as Evolutionary Algorithms (EAs). EAs have proven effective and robust in solving demanding optimization problems that are often difficult if not intractable to traditional numerical methods. They are nowadays widely applied in science, engineering, management, and other domains. However, a drawback of EAs is their computational complexity which originates from iterative population-based search of the solution space. On the other hand, processing a population of candidate solutions makes EAs amenable to parallel implementation that may result in significant calculation speedup.

This chapter presents a parallel evolutionary computation framework developed for solving numerical optimization problems with one or more objectives, and evaluates its performance on a high-dimensional optimization task from industrial practice. The chapter starts with an introduction to optimization problems. It distinguishes between single- and multiobjective optimization and reviews the concepts needed to deal with multiobjective optimization problems, such as the dominance relation and Pareto optimality. Next, EAs as a general-purpose optimization method are described, with a focus on Differential Evolution (DE) which is a particular kind of EA used in our framework. Then, parallelization of EAs is discussed in view of known parallelization types and speedup calculation. The chapter continues with an introduction to the optimization problem in industrial continuous casting, used as a test problem in this work. Afterwards, the proposed parallel evolutionary computation framework is presented. The framework is based on DE and implemented on a cluster of personal computers. It is evaluated on single- and multiobjective variants of the casting optimization problem and the results are analyzed from the perspective of the problem domain and, in particular, the achieved speedup.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    A. E. Eiben, J. E. Smith, Introduction to Evolutionary Computing, Springer-Verlag, Berlin, (2003).MATHGoogle Scholar
  2. 2.
    K. De Jong, Evolutionary Computation: A Unified Approach, The MIT Press, Cambridge, (2006).MATHGoogle Scholar
  3. 3.
    G. B. Fogel, D.W. Corne (Eds.), Evolutionary Computation in Bioinformatics, Morgan Kaufmann Publishers, Amsterdam, (2003).Google Scholar
  4. 4.
    D. Dasgupta, Z. Michalewicz (Eds.), Evolutionary Algorithms in Engineering Applications, Springer-Verlag, Berlin, (1997).MATHGoogle Scholar
  5. 5.
    J. Biethahn, V. Nissen (Eds.), Evolutionary Algorithms in Management Applications, Springer-Verlag, Berlin, (1995).MATHGoogle Scholar
  6. 6.
    B. Filipič, E. Laitinen, Model-based tuning of process parameters for steady-state steel casting, Informatica 29 (4) (2005) 491–496.Google Scholar
  7. 7.
    R. Buyya, High Performance Cluster Computing: Architectures and Systems, Vol. 1, Prentice Hall, Upper Saddle River, (1999).Google Scholar
  8. 8.
    K. V. Price, R. Storn, Differential evolution: A simple evolution strategy for fast optimization, Dr. Dobb’s Journal 22 (4) (1997) 18–24.MathSciNetGoogle Scholar
  9. 9.
    K. Price, R. M. Storn, J. A. Lampinen, Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series), Springer-Verlag, Berlin, (2005).MATHGoogle Scholar
  10. 10.
    K. Deb, Multi-Objective Optimization using Evolutionary Algorithms, John Wiley & Sons, Chichester, (2001).MATHGoogle Scholar
  11. 11.
    C. A. Coello Coello, D. A. Van Veldhuizen, G. B. Lamont, Evolutionary Algorithms for Solving Multi-Objective Problems, Kluwer Academic Publishers, New York, (2002).MATHGoogle Scholar
  12. 12.
    A. Abraham, L. Jain, R. Goldberg (Eds.), Evolutionary Multiobjective Optimization, Springer-Verlag, London, (2005).MATHGoogle Scholar
  13. 13.
    T. Robič, B. Filipič, Demo: Differential evolution for multiobjective optimization, in: C. A. Coello Coello, A. Hernández Aguirre, E. Zitzler (Eds.), Conference on Evolutionary Multi-Criterion Optimization, Vol. 3410 of Lecture Notes in Computer Science, Springer, Berlin, (2005), pp. 520–533.Google Scholar
  14. 14.
    K. Deb, A. Pratap, S. Agarwal, T. Meyarivan, A fast and elitist multiobjective genetic algorithm: NSGA-II, IEEE Transactions on Evolutionary Computation 6 (2) (2002) 182–197.CrossRefGoogle Scholar
  15. 15.
    S. G. Akl, Parallel Computation: Models and Methods, Prentice Hall, Upper Saddle River, (1997).Google Scholar
  16. 16.
    E. Cantú-Paz, A survey of parallel genetic algorithms, Tech. rep., University of Illinois at Urbana-Champaign (1997).Google Scholar
  17. 17.
    D. A. van Veldhuizen, J. B. Zydallis, G. B. Lamont, Considerations in engineering parallel multiobjective evolutionary algorithms, IEEE Transactions on Evolutionary Computation 7 (2) (2003) 144–173.CrossRefGoogle Scholar
  18. 18.
    M. Snir, S. Otto, S. Huss-Lederman, D. Walker, J. Dongarra, MPI – The Complete Reference, The MIT Press, Cambridge, (1996).Google Scholar
  19. 19.
    A. J. Nebro, F. Luna, E.-G. Talbi, E. Alba, Parallel multiobjective optimization, in: E. Alba (Ed.), Parallel Metaheuristics, John Wiley & Sons, New Jersey, (2005), pp. 371–394.CrossRefGoogle Scholar
  20. 20.
    B. Filipič, T. Tušar, E. Laitinen, Preliminary numerical experiments in multiobjective optimization of a metallurgical production process, Informatica 31 (2) (2007) 233–240.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.Department of Intelligent SystemsJožef Stefan InstituteSlovenia
  2. 2.Department of Intelligent SystemsJožef Stefan InstituteSlovenia

Personalised recommendations