Advertisement

Load Balancing in Distributed Applications Based on Extremal Optimization

  • Ivanoe De Falco
  • Eryk Laskowski
  • Richard Olejnik
  • Umberto Scafuri
  • Ernesto Tarantino
  • Marek Tudruj
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7835)

Abstract

The paper shows how to use Extremal Optimization in load balancing of distributed applications executed in clusters of multicore processors interconnected by a message passing network. Composed of iterative optimization phases which improve program task placement on processors, the proposed load balancing method discovers dynamically the candidates for migration with the use of an Extremal Optimization algorithm and a special quality model which takes into account the computation and communication parameters of the constituent parallel tasks. Assessed by experiments with simulated load balancing of distributed program graphs, a comparison of the proposed Extremal Optimization approach against a deterministic approach based on a similar load balancing theoretical model is provided.

Keywords

distributed program design extremal optimization load balancing 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Barker, K., Chrisochoides, N.: An Evaluation of a Framework for the Dynamic Load Balancing of Highly Adaptive and Irregular Parallel Applications. In: Supercomputing 2003. ACM, Phoenix (2003)Google Scholar
  2. 2.
    Boettcher, S., Percus, A.G.: Extremal optimization: methods derived from coevolution. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 1999), pp. 825–832. Morgan Kaufmann, San Francisco (1999)Google Scholar
  3. 3.
    Borkowski, J., Kopański, D., Laskowski, E., Olejnik, R., Tudruj, M.: A Distributed Program Global Execution Control Environment Applied to Load balancing. Scalable Computing: Practice and Experience 13(3) (2012)Google Scholar
  4. 4.
    De Falco, I., Laskowski, E., Olejnik, R., Scafuri, U., Tarantino, E., Tudruj, M.: Extremal Optimization Approach Applied to Initial Mapping of Distributed Java Programs. In: D’Ambra, P., Guarracino, M., Talia, D. (eds.) Euro-Par 2010, Part I. LNCS, vol. 6271, pp. 180–191. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  5. 5.
    Devine, K.D., Boman, E.G., Riesen, L.A., Catalyurek, U.V., Chevalier, C.: Getting Started with Zoltan: A Short Tutorial, Sandia National Labs Tech Report SAND2009-0578C (2009)Google Scholar
  6. 6.
    Hartigan, J.A., Wong, M.A.: A K-Means clustering algorithm. Applied Statistics 28, 100–108 (1979)MATHCrossRefGoogle Scholar
  7. 7.
    Kalé, L.V., Krishnan, S.: CHARM++: A Portable Concurrent Object Oriented System Based on C++. In: Proc. of OOPSLA 1993. ACM Press (September 1993)Google Scholar
  8. 8.
    Laskowski, E., Tudruj, M., De Falco, I., Scafuri, U., Tarantino, E., Olejnik, R.: Extremal Optimization Applied to Task Scheduling of Distributed Java Programs. In: Di Chio, C., Brabazon, A., Di Caro, G.A., Drechsler, R., Farooq, M., Grahl, J., Greenfield, G., Prins, C., Romero, J., Squillero, G., Tarantino, E., Tettamanzi, A.G.B., Urquhart, N., Uyar, A.Ş. (eds.) EvoApplications 2011, Part II. LNCS, vol. 6625, pp. 61–70. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  9. 9.
    Olejnik, R., Alshabani, I., Toursel, B., Laskowski, E., Tudruj, M.: Load Balancing Metrics for the SOAJA Framework. Scalable Computing: Practice and Experience 10(4) (2009)Google Scholar
  10. 10.
    Roig, C., Ripoll, A., Guirado, F.: A New Task Graph Model for Mapping Message Passing Applications. IEEE Trans. on Parallel and Distributed Systems 18(12), 1740–1753 (2007)CrossRefGoogle Scholar
  11. 11.
    Tudruj, M., Borkowski, J., Maśko, Ł., Smyk, A., Kopański, D., Laskowski, E.: Program Design Environment for Multicore Processor Systems with Program Execution Controlled by Global States Monitoring. In: ISPDC 2011, Cluj-Napoca, pp. 102–109. IEEE CS (July 2011)Google Scholar
  12. 12.
    Zeigler, B.: Hierarchical, modular discrete-event modelling in an object-oriented environment. Simulation 49(5), 219–230 (1987)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Ivanoe De Falco
    • 1
  • Eryk Laskowski
    • 2
  • Richard Olejnik
    • 3
  • Umberto Scafuri
    • 1
  • Ernesto Tarantino
    • 1
  • Marek Tudruj
    • 2
    • 4
  1. 1.Institute of High Performance Computing and Networking, CNRNaplesItaly
  2. 2.Institute of Computer SciencePolish Academy of SciencesWarsawPoland
  3. 3.Computer Science LaboratoryUniversity of Science and Technology of LilleFrance
  4. 4.Polish-Japanese Institute of Information TechnologyWarsawPoland

Personalised recommendations