Advertisement

Dynamic Time Delay Models for Load Balancing. Part II: A Stochastic Analysis of the Effect of Delay Uncertainty

  • Majeed M. Hayat
  • Sagar Dhakal
  • Chaouki T. Abdallah
  • J. Douglas Birdwell
  • John Chiasson
Part of the Lecture Notes in Computational Science and Engineering book series (LNCSE, volume 38)

Abstract

In large-scale distributed computing systems, in which the computational elements are physically or virtually distant from each other, there are communication-related delays that can significantly alter the expected performance of load-balancing policies that do not account for such delays. This is a particularly significant problem in systems for which the individual units are connected by means of a shared broadband communication medium (e.g., the Internet, ATM, wireless LAN or wireless Internet). In such cases, the delays, in addition to being large, fluctuate randomly, making their one-time accurate prediction impossible. In this work, the stochastic dynamics of a load-balancing algorithm in a cluster of computer nodes are modeled and used to predict the effects of the random time delays on the algorithm's performance. A discrete-time stochastic dynamical-equation model is presented describing the evolution of the random queue size of each node. Monte Carlo simulation is also used to demonstrate the extent of the role played by the magnitude and uncenainty of the various time-delay elements in altering the performance of load balancing. This study reveals that the presence of delay (deterministic or random) can lead to a significant degradation in the performance of a load-balancing policy. One way to remedy such a problem is to weaken the load-balancing mechanism so that the load-transfer between nodes is down-scaled (or discouraged) appropriately.

Keywords

Load Balance Queue Length Queue Size Communication Delay Gain Coefficient 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    J. D. Birdwell, T. W. Wang, R. D. Hom, P. Yadav, and D. J. Icove, “Method of indexed storage and retrieval of multidimensional information,” U. S. Patent Application 09/671,304 (2000)Google Scholar
  2. 2.
    C. T. Abdallah, N. Alluri, J. D. Birdwell, J. Chiasson, Y. Chupryna, Z. Tang, and T. Wang “A linear time delay model for studying load balancing instabilities in parallel computations,” The International Journal of System Science, to appear (2003)Google Scholar
  3. 3.
    T.L. Casavant and J.G. Kuhl, “A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems,” IEEE Trans. Software Eng., vol. 14, pp. 141–154 (Feb. 1988)CrossRefGoogle Scholar
  4. 4.
    Zhiling Lan, Valerie E. Taylor, Greg Bryan. “Dynamic Load Balancing for Adaptive Mesh Refinement Application,” In Proc. Of ICPP' 2001, Valencia, Spain (2001)Google Scholar
  5. 5.
    G. Cybenko, “Dynamic load balancing for distributed memory multiprocessors,” IEEE Transactions on Parallel and Distributed computing, vol. 7, pp. 279–301 (1989)CrossRefGoogle Scholar
  6. 6.
    J. D. Birdwell, J. Chiasson, Z. Tang, T. Wang, C. T. Abdallah, and M. M. Hayat, “Dynamic time delay models for load balancing Part I: Deterministic models,” CNRS-NSF Workshop: Advances in Control of Time-Delay Systems, Paris, France (Jan. 2003)Google Scholar
  7. 7.
    C. T. Abdallah, J.D. Birdwell, J. Chiasson, V. Churpryna, Z. Tang, and T.W. Wang “Load balancing instabilities due to Time delays in farallel computation,” Proceedings of the 3rd IFAC Conference an Time Delay Systems. Santa Fe, NM (Dec. 2001)Google Scholar
  8. 8.
    M. M. Hayat, C. T. Abdallah, J. D. Birdwell and J. Chiasson, “Dynamic time delay models for load balancing, Part II: A stochastic analysis of the effect of delay uncertainty,” CNRS-NSF Workshop: Advances in Control of Time-Delay Systems. Paris, France (Jan. 2003)Google Scholar
  9. 9.
    D. J. Daley and D. Vere-Jones, An Introduction to Ihe Theory of Point Processes (Springe-rVerlag New York, NY 1988)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Majeed M. Hayat
    • 1
  • Sagar Dhakal
    • 1
  • Chaouki T. Abdallah
    • 1
  • J. Douglas Birdwell
    • 2
  • John Chiasson
    • 2
  1. 1.ECE DeptUniversity of New MexicoAlbuquerque NMUSA
  2. 2.ECE DeptUniversity of TennesseeKnoxvilleUSA

Personalised recommendations