Parallel Extremal Optimization with Guided State Changes Applied to Load Balancing

  • Ivanoe De Falco
  • Eryk Laskowski
  • Richard Olejnik
  • Umberto Scafuri
  • Ernesto Tarantino
  • Marek Tudruj
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9028)


The paper concerns parallel methods for Extremal Optimization (EO) applied for processor load balancing for distributed programs. In these methods the EO approach is used which is parallelized and extended by a guided search of next solution state. EO detects the best strategy of tasks migration leading to a reduction in program execution time. We assume a parallel improvement of the EO algorithm with guided state changes which provides a parallel search for a solution based on two step stochastic selection during the solution improvement based on two fitness functions. The load balancing improvements based on EO aim at better convergence of the algorithm and better quality of program execution in terms of the execution time. The proposed load balancing algorithm is evaluated by experiments with simulated parallelized load balancing of distributed program graphs.


Distributed program design Extremal optimization Load balancing Parallel computing 


  1. 1.
    Khan, R.Z., Ali, J.: Classification of task partitioning and load balancing strategies in distributed parallel computing systems. Int. J. Comput. Appl. 60(17), 48–53 (2012)Google Scholar
  2. 2.
    Mishra, M., Agarwal, S., Mishra, P., Singh, S.: Comparative analysis of various evolutionary techniques of load balancing: a review. Int. J. Comput. Appl. 63(15), 8–13 (2013)Google Scholar
  3. 3.
    Boettcher, S., Percus, A.G.: Extremal optimization: methods derived from coevolution. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 1999), pp. 825–832. Morgan Kaufmann, San Francisco (1999)Google Scholar
  4. 4.
    Sneppen, K., et al.: Evolution as a self-organized critical phenomenon. Proc. Natl. Acad. Sci. 92, 5209–5213 (1995)CrossRefGoogle Scholar
  5. 5.
    De Falco, I., Laskowski, E., Olejnik, R., Scafuri, U., Tarantino, E., Tudruj, M.: Load balancing in distributed applications based on extremal optimization. In: Esparcia-Alcázar, A.I. (ed.) EvoApplications 2013. LNCS, vol. 7835, pp. 52–61. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  6. 6.
    De Falco, I., Laskowski, E., Olejnik, R., Scafuri, U., Tarantino, E., Tudruj, M.: Improving extremal optimization in load balancing by local search. In: Esparcia-Alcázar, A.I., Mora, A.M. (eds.) EvoApplications 2014. LNCS, vol. 8602, pp. 51–62. Springer, Heidelberg (2014) CrossRefGoogle Scholar
  7. 7.
    Zeigler, B.: Hierarchical, modular discrete-event modelling in an object-oriented environment. Simulation 49(5), 219–230 (1987)CrossRefGoogle Scholar
  8. 8.
    Randall, M., Lewis, A.: An extended extremal optimisation model for parallel architectures. In: 2nd IEEE International Conference on e-Science and Grid Computing, e-Science 2006, p. 114 (2006)Google Scholar
  9. 9.
    Tamura, K., Kitakami, H., Nakada, A.: Reducing crossovers in reconciliation graphs with extremal optimization (in japanese). Trans. Inf. Process. Soc. Japan 49(4(TOM 20)), 105–116 (2008)Google Scholar
  10. 10.
    Tamura, K., Kitakami, H., Nakada, A.: Distributed extremal optimization using island model for reducing crossovers in reconciliation graph. In: Proceedings of the International MultiConference of Engineers and Computer Scientists 2013, Hong-Kong, March 2013, pp. 1–6 (2013)Google Scholar
  11. 11.
    Tamura, K., Kitakami, H., Nakada, A.: Distributed modified extremal optimization using Island model for reducing crossovers in reconciliation graph. Eng. Lett. 21(2), EL_21_2_05 (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Ivanoe De Falco
    • 1
  • Eryk Laskowski
    • 2
  • Richard Olejnik
    • 3
  • Umberto Scafuri
    • 1
  • Ernesto Tarantino
    • 1
  • Marek Tudruj
    • 2
    • 4
  1. 1.Institute of High Performance Computing and Networking, CNRNaplesItaly
  2. 2.Institute of Computer Science, Polish Academy of SciencesWarsawPoland
  3. 3.Computer Science LaboratoryUniversity of Science and Technology of LilleVilleneuve-d’AscqFrance
  4. 4.Polish-Japanese Institute of Information TechnologyWarsawPoland

Personalised recommendations