Performance-Aware Load Balancing for Multiclusters

  • Ligang He
  • Stephen A. Jarvis
  • David Bacigalupo
  • Daniel P. Spooner
  • Graham R. Nudd
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3358)


In a multicluster architecture, where jobs can be submitted through each constituent cluster, the job arrival rates in individual clusters may be uneven and the load therefore needs to be balanced among clusters. In this paper we investigate load balancing for two types of jobs, namely non-QoS and QoS-demanding jobs and as a result, two performance-specific load balancing strategies (called ORT and OMR) are developed. The ORT strategy is used to obtain the optimised mean response time for non-QoS jobs and the OMR strategy is used to achieve the optimised mean miss rate for QoS-demanding jobs. The ORT and OMR strategies are mathematically modelled combining queuing network theory to establish sets of optimisation equations. Numerical solutions are developed to solve these optimisation equations, and a so called fair workload level is determined for each cluster. When the current workload in a cluster reaches this pre-calculated fair workload level, the jobs subsequently submitted to the cluster are transferred to other clusters for execution. The effectiveness of both strategies is demonstrated through theoretical analysis and experimental verification. The results show that the proposed load balancing mechanisms bring about considerable performance gains for both job types, while the job transfer frequency among clusters is considerably reduced. This has a number of advantages, in particular in the case where scheduling jobs to remote resources involves the transfer of large executable and data files.


Load Balance Optimisation Equation Speed Difference Load Balance Strategy Local Scheduler 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aumage, O.: Heterogeneous multi-cluster networking with the Madeleine III. In: International Parallel and Distributed Processing Symposium, IPDPS 2002 (2002)Google Scholar
  2. 2.
    Banen, S., Bucur, A.I.D., Epema, D.H.J.: A Measurement-Based Simulation Study of Processor Co-Allocation in Multicluster Systems. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) Ninth Workshop on Job Scheduling Strategies for Parallel Processing (2003)Google Scholar
  3. 3.
    Barreto, M., Avila, R., Navaux, P.: The MultiCluster model to the integrated use of multiple workstation clusters. In: Proc. of the 3rd Workshop on Personal Computer-based Networks of Workstations, pp. 71–80 (2000)Google Scholar
  4. 4.
    Bolch, G.: Performance Modeling of Computer Systems (2002)Google Scholar
  5. 5.
    Bucur, A.I.D., Epema, D.H.J.: The maximal utilization of processor co-allocation in multicluster Systems. In: Int’l Parallel and Distributed Processing Symp. (IPDPS 2003), pp. 60–69 (2003)Google Scholar
  6. 6.
    Buyya, R., Baker, M.: Emerging Technologies for Multicluster/Grid Computing. In: Proceedings of the 2001 IEEE International Conference on Cluster Computing (2001)Google Scholar
  7. 7.
    Cao, J., Kerbyson, D.J., Nudd, G.R.: Performance Evaluation of an Agent-Based Resource Management Infrastructure for Grid Computing. In: Proceedings of 1st IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2001 (2001)Google Scholar
  8. 8.
    Chanson, S.T., Deng, W., Hui, C., Tang, X., To, M.: Multidomain Load Balancing. In: International Conf. on Network Protocols, Japan (2000)Google Scholar
  9. 9.
    He, L., Jarvis, S.A., Spooner, D.P., Nudd, G.R.: Optimising static workload allocation in multiclusters. In: Proceedings of 18th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2004 (2004)Google Scholar
  10. 10.
    Kao, B., Garcia-Molina, H.: Scheduling soft real-time jobs over dual non-real-time servers. IEEE Trans. on Parallel and Distributed Systems 7(1), 56–68 (1996)CrossRefGoogle Scholar
  11. 11.
    Kleinrock, L.: Queueing system. John Wiley & Sons, Chichester (1975)Google Scholar
  12. 12.
    Tang, X.Y., Chanson, S.T.: Optimizing static job scheduling in a network of heterogeneous computers. In: The 29th International Conference on Parallel Processing (2000)Google Scholar
  13. 13.
    Wu, M.: On Runtime Parallel Scheduling for Processor Load Balancing. IEEE Transaction on Parallel and Distributed Systems 8(2), 173–186 (1997)CrossRefGoogle Scholar
  14. 14.
    Zhu, W.: Scheduling soft real-time tasks on cluster. In: Proc. of 1999 Annual Australian Parallel and Real-Time Conference (1999)Google Scholar
  15. 15.
    Zhu, W., Fleisch, B.: Performance evaluation of soft real-time scheduling on a multicomputer cluster. In: The 20th International Conference on Distributed Computing Systems, ICDCS 2000 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Ligang He
    • 1
  • Stephen A. Jarvis
    • 1
  • David Bacigalupo
    • 1
  • Daniel P. Spooner
    • 1
  • Graham R. Nudd
    • 1
  1. 1.Department of Computer ScienceUniversity of WarwickCoventryUnited Kingdom

Personalised recommendations