Comparison of Frameworks for Parallel Multiobjective Evolutionary Optimization in Dynamic Problems

  • Mario Cámara
  • Julio Ortega
  • Francisco de Toro
Part of the Studies in Computational Intelligence book series (SCI, volume 415)


In this chapter some alternatives are discussed to take advantage of parallel computers in dynamic multi-objective optimization problems (DMO) using evolutionary algorithms. In DMO problems, the objective functions, the constraints, and hence, also the solutions, can change over time and usually demand to be solved online. Thus, high performance computing approaches, such as parallel processing, should be applied to these problems to meet the quality requirements within the given time constraints. Taking this into account, we describe two generic parallel frameworks for multi-objective evolutionary algorithms. These frameworks are used to compare the parallel processing performance of some multi-objective optimization evolutionary algorithms: our previously proposed algorithms, SFGA and SFGA2, in conjunction with SPEA2 and NSGA-II.We also propose a model to explain the benefits of parallel processing in multi-objective problems and the speedup results observed in our experiments.


dynamic multiobjective optimization (DMO) parallel processing parallel evolutionary algorithms 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gupta, A., Sivakumar, A.: Pareto control in multi-objective dynamic scheduling of a stepper machine in semiconductor wafer fabrication. In: Proc. of the 2006 Winter Simulation Conference, pp. 1749–1756. IEEE Computer Science, Los Alamitos (2006)CrossRefGoogle Scholar
  2. 2.
    Branke, J., Mattfeld, D.C.: Anticipation and flexibility in dynamic scheduling. Int. Journal of Production Research 43, 3103–3129 (2005)CrossRefGoogle Scholar
  3. 3.
    Pillai, P., Shin, K.G.: Real-time dynamic voltage scaling for low-power embedded operating systems. SIGOPS Oper. Syst. Rev. 35(5), 89–102 (2001)CrossRefGoogle Scholar
  4. 4.
    Lee, L.H., Teng, S.E., Chew, P., Karimi, I.A., Lye, K.W., Lendermann, P., Chen, Y., Koh, C.H.: Application of multi-objective simulation-optimization techniques to inventory management problems. In: Proc. of the 37th Conference on Winter Simulation, pp. 1684–1691 (2005)Google Scholar
  5. 5.
    Cheng, L., Subrahmanian, E., Westerberg, A.: Multi-objective decisions on capacity planning and production-inventory control under uncertainty. Industrial & Engineering Chemistry Research 43(9), 2192–2208 (2004)CrossRefGoogle Scholar
  6. 6.
    Coello, C.A.: An updated survey of GA-based multiobjective optimization techniques. ACM Comput. Surv. 32(2), 109–143 (2000)CrossRefGoogle Scholar
  7. 7.
    Farina, M., Deb, K., Amato, P.: Dynamic multiobjective optimization problems: Test cases, approximations, and applications. IEEE Trans. on Evol. Comp. 8, 425–442 (2004)CrossRefGoogle Scholar
  8. 8.
    Jin, Y., Branke, J.: Evolutionary optimization in uncertain environments-a survey. IEEE Trans. on Evol. Comp. 9(3), 303–317 (2005)CrossRefGoogle Scholar
  9. 9.
    Coello, C.A., Lamont, G.B., Van Veldhuizen, D.A.: Evolutionary Algorithms for Solving Multi-Objective Problems, 2nd edn. Genetic and Evolutionary Computation. Springer, Heidelberg (2007)MATHGoogle Scholar
  10. 10.
    Cobb, H.G., Grefenstette, J.J.: Genetic algorithms for tracking changing environments. In: Proc. of the 5th International Conference on Genetic Algorithms, pp. 523–530. Morgan Kaufmann Publishers Inc., San Francisco (1993)Google Scholar
  11. 11.
    Vavak, F., Jukes, K., Fogarty, T.C.: Adaptive combustion balancing in multiple burner boiler using a genetic algorithm with variable range of local search’. In: Bäck, T. (ed.) ICGA, pp. 719–726. Morgan Kaufmann (1997)Google Scholar
  12. 12.
    Mori, N., Kita, H., Nishikawa, Y.: Adaptation to a Changing Environment by Means of the Feedback Thermodynamical Genetic Algorithm. In: Eiben, A.E., Bäck, T., Schoenauer, M., Schwefel, H.-P. (eds.) PPSN 1998. LNCS, vol. 1498, pp. 149–158. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  13. 13.
    Cedeno, W., Vemuri, V.R.: On the use of niching for dynamic landscapes. In: Proc. of the IEEE Int. Conf. on Evolutionary Computation, pp. 361–366 (1997)Google Scholar
  14. 14.
    Yang, S.: Population-based incremental learning with memory scheme for changing environments. In: Proc. of the 2005 Conference on Genetic and Evolutionary Computation, NY, USA, pp. 711–718 (2005)Google Scholar
  15. 15.
    Branke, J.: Memory enhanced evolutionary algorithms for changing optimization problems. In: Proc. of the IEEE Congress on Evolutionary Computation, pp. 1875–1882 (1999)Google Scholar
  16. 16.
    Branke, J., Kauler, T., Schmidt, C., Schmeck, H.: A multi-population approach to dynamic optimization problems. In: Adaptive Computing in Design and Manufacturing, pp. 299–308. Springer, Heidelberg (2000)Google Scholar
  17. 17.
    Ursem, R.K.: Multinational GAs: Multimodal optimization techniques in dynamic environments. In: Whitley, D., Goldberg, D., Cantu-Paz, E., Spector, L., Parmee, I., Beyer, H.G. (eds.) Proc. of the Genetic and Evolutionary Computation Conference, pp. 19–26. Morgan Kaufmann, Las Vegas (2000)Google Scholar
  18. 18.
    Talbi, E.G., Mostaghim, S., Okabe, T., Ishibuchi, H., Rudolph, G., Coello, C.A.: Parallel Approaches for Multiobjective Optimization. In: Branke, J., Deb, K., Miettinen, K., Słowiński, R. (eds.) Multiobjective Optimization. LNCS, vol. 5252, pp. 349–372. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  19. 19.
    Van Veldhuizen, D.A., Zydallis, J.B., Lamont, G.B.: Considerations in engineering parallel multiobjective evolutionary algorithms. IEEE Trans. on Evol. Comp. 7, 144–173 (2003)CrossRefGoogle Scholar
  20. 20.
    Luna, F., Nebro, A.J., Alba, E.: Parallel evolutionary multiobjective optimization. In: Nedjah, N., De Mourelle, L., Alba, E. (eds.) Parallel Evolutionary Computations, pp. 33–56. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  21. 21.
    Knowles, J., Corne, D.: The pareto archived evolution strategy: a new baseline algorithm for pareto multiobjective optimization. In: Proc. of the Congress on Evolutionary Computation, pp. 98–105 (1999)Google Scholar
  22. 22.
    De Toro, F., Ortega, J., Ros, E., Mota, S., Paechter, B., Martín, J.M.: PSFGA: Parallel processing and evolutionary computation for multiobjective optimization. Parallel Computing 30, 721–739 (2004)CrossRefGoogle Scholar
  23. 23.
    Horn, J., Nafpliotis, N.: Multiobjective Optimization using the Niched Pareto Genetic Algorithm. Technical Report IlliGAl Report 93005, Urbana, Illinois, USA (1993)Google Scholar
  24. 24.
    Alba, E.: Parallel evolutionary algorithms can achieve super-linear performance. Inf. Process. Lett. 82(1), 7–13 (2002)MathSciNetMATHCrossRefGoogle Scholar
  25. 25.
    Deb, K., Zope, P., Jain, A.: Distributed Computing of Pareto-Optimal Solutions with Evolutionary Algorithms. In: Fonseca, C.M., Fleming, P.J., Zitzler, E., Deb, K., Thiele, L. (eds.) EMO 2003. LNCS, vol. 2632, pp. 534–549. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  26. 26.
    Branke, J., Schmeck, H., Deb, K., Maheshwar, R.S.: Parallelizing multiobjective evolutionary algorithms: cone separation. In: Proc. of the Congress on Evolutionary Computation, pp. 1952–1957 (2004)Google Scholar
  27. 27.
    Hiroyasu, T., Miki, M., Watanabe, S.: The new model of parallel genetic algorithm in multiobjective optimization problems – divided range multiobjective genetic algorithm. In: Proc. of the Congress on Evolutionary Computation, pp. 333–340 (2000)Google Scholar
  28. 28.
    Bui, L.T., Abbass, H.A., Essam, D.: Local models – an approach to distributed multi-objective optimization. Comput. Optim. Appl. 42, 105–139 (2009)MathSciNetMATHCrossRefGoogle Scholar
  29. 29.
    Streichert, F., Ulmer, H., Zell, A.: Parallelization of Multi-Objective Evolutionary Algorithms Using Clustering Algorithms. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) EMO 2005. LNCS, vol. 3410, pp. 92–107. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  30. 30.
    Navarro, A., Allen, C.: Adaptive classifier based on K-means clustering in dynamic programming. Document Recognition IV 36, 31–38 (1997)Google Scholar
  31. 31.
    Kövesi, B., Boucher, J.M., Saoudi, S.: Stochastic K-means algorithm for vector quantization. Pattern Recog. Lett. 22(6-7), 603–610 (2001)MATHCrossRefGoogle Scholar
  32. 32.
    Zitzler, E., Laummanns, M., Thielem, L.: SPEA2: improving the Strength Pareto Evolutionary Algorithm for multi-objective optimization. In: Giannakoglou, K., et al. (eds.) Evolutionary Methods for Design, Optimization and Control to Industrial Problems, pp. 95–100. Center for Numerical Methods in Engineering (2002)Google Scholar
  33. 33.
    Deb, K., Agrawal, S., Pratab, A., Meyarivan, T.: A fast elitist Non-dominated Sorting Genetic Algorithms for multi-objective optimisation: NSGA-II. In: Deb, K., Rudolph, G., Lutton, E., Merelo, J.J., Schoenauer, M., Schwefel, H.-P., Yao, X. (eds.) PPSN 2000. LNCS, vol. 1917, pp. 849–858. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  34. 34.
    Deb, K., Agrawal, R.B.: Simulated binary crossover for continuous search space. Complex Systems 9, 115–148 (1995)MathSciNetMATHGoogle Scholar
  35. 35.
    Deb, K.: Multi-Objective Optimization using Evolutionary Algorithms. John Wiley & Sons Inc., New York (2001)MATHGoogle Scholar
  36. 36.
    Cámara, M., Ortega, J., de Toro, F.: Approaching Dynamic Multi-Objective Optimization Problems by Using Parallel Evolutionary Algorithms. In: Coello Coello, C.A., Dhaenens, C., Jourdan, L. (eds.) Advances in Multi-Objective Nature Inspired Computing. Studies in Computational Intelligence, vol. 272, pp. 63–86. Springer, Heidelberg (2010)CrossRefGoogle Scholar

Copyright information

© Springer Berlin Heidelberg 2012

Authors and Affiliations

  • Mario Cámara
    • 1
  • Julio Ortega
    • 1
  • Francisco de Toro
    • 2
  1. 1.Department of Computer Architecture and TechnologyUniversity of GranadaGranadaSpain
  2. 2.Department of Signal Theory, Telematics and CommunicationsUniversity of GranadaGranadaSpain

Personalised recommendations