Dynamic Time Delay Models for Load Balancing. Part I: Deterministic Models

  • J. Douglas Birdwell
  • John Chiasson
  • Zhong Tang
  • Chaouki Abdallah
  • Majeed M. Hayat
  • Tsewei Wang
Part of the Lecture Notes in Computational Science and Engineering book series (LNCSE, volume 38)


Parallel computer architectures utilize a set of computational elements (CE) to achieve performance that is not attainable on a single processor, or CE, computer. A common architecture is the cluster of otherwise independent computers communicating through a shared network. To make use of parallel computing resources, problems must be broken down in to smaller units that can be solved individually by each CE while exchanging information with CEs solving other problems.

Effective utilization of a parallel computer architecture requires the computational load to be distributed more or less evenly over the available CEs. The qualifier “more or less” is used because the communications required to distribute the load consume both computational resources and network bandwidth. A point of diminishing returns exists.

In this work, a nonlinear deterministic dynamic time-delay systems is developed to model load balancing in a cluster of computer nodes used for parallel computations. This model is then compared with an experimental implementation of the load balancing algorithm on a parallel computer network.


Load Balance Local Average Computational Element Load Balance Algorithm Expected Waiting Time 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abdallah, C.T., Hayat, M., Birdwell, J.D. and Chiasson, J.: “Dynamic Time Delay Models for Load Balancing,” Part II: A Stochastic Analysis of the Effect of Delay Uncertainty, in Advances in time-delay systems (S.-I. NICULESCU, K. Gu, EDS.) (this volume) (2003).Google Scholar
  2. 2.
    Abdallah, C.T., Alluri, N., Birdwell, J.D., Chiasson, J., Chupryna, Y., Tang, Z. and Wang, T.: “A Linear Time Delay Model for Studying Load Balancing Instabilities in Parallel Computations,” International Journal of System Science (2003) (to appear).Google Scholar
  3. 3.
    Abdallah, C.T., Dorato, P., Benitez-Read, J. and Byrne, R.: “Delayed positive feedback can stabilize oscillatory systems,” Proceedings of the American Control Conference, San Francisco CA (1993) 3106–3107Google Scholar
  4. 4.
    Abdallah, C.T., Birdwell, J.D., Chiasson, J., Chupryna, V., Tang, Z. and Wang, T: “Load Balancing Instabilities due to Time Delays in Parallel Computation,” Proceedings of the 3rd IFAC Conference on Time Delay, Systems, Santa Fe, NM (2001).Google Scholar
  5. 5.
    Altman, E. and Kameda, H.: “Equilibria for Multiclass Routing in Mull-Agent Networks,” Proceedings of the 2001 IEEE Conference on Decision and Control, Orlando. FL. USA, December 2001.Google Scholar
  6. 6.
    Bellman, R. and Cooke, K.L.: Differential-Difference Equations, (Academic Press New York, 1963).zbMATHGoogle Scholar
  7. 7.
    Birdwell, J.D., Horn, R.D., Icove, D.J., Wang, T.W., Yadav, P. and Niezgoda, S.: “A hierarchical database design and search method for CODIS,” in Proc. Tenth International Symposium on Human Identification, Orlando, FL, September, 1999.Google Scholar
  8. 8.
    Birdwell, J.D., Wang, T.-W. and Rader, M.: “The University of Tennessee’s new search engine for CODIS,” in Proc. 6th CODIS Users Conference, Arlington, VA, February, 2001Google Scholar
  9. 9.
    Birdwell, J.D., Wang, T.W., Hom, R.D., Yadav, P. and Icove, D.J.: “Method of Indexed Storage and Retrieval of Multidimensional Information,” in Proc. Tenth SIAM Conference on Parallel Processing for Scientific Computation, U. S. Patent Application 09/671,304, September, 2000.Google Scholar
  10. 10.
    Birdwell, J.D., Chiasson, J., Abdallah, C.T., Tang, Z., Alluri, N., Churpryna, V. and Wang T.W.: “Load Balancing Instabilities due to Time Delays in Parallel Computation,” Automatica (Submitted for Publication, 2002).Google Scholar
  11. 11.
    Birdwell, J.D., Chiasson, J., Tang, Z., Abdallah, C.T., Hayat, M., and Wang, T.W.: “Dynamic Time Delay Models for Load Balancing Part I: Deterministic Models,” in Proc. CNRS-NSF IVorkshop: Advances in Control of Time-Delay Systems, Paris France, 2003.Google Scholar
  12. 12.
    Birdwell, J.D., Chiasson, J., Abdallah, C.T., Tang, Z., Alluri, N., and Wang, T.W.: “Load Balancing Instabilities due to Time Delays in Parallel Computation,” submitted to the 42nd Conference on Decision and Control (2003).Google Scholar
  13. 13.
    Cavendish, D., Mascolo, S. and Ceria, M.: “SP-EPRCA: an ATM rate based congestion control scheme based on a Smith predictor,” Preprint (1996).Google Scholar
  14. 14.
    Chiasson, J.N., Brierley, S.D. and Lee, E.B.: “A simplified derivation of the Zeheb-Walach 2-D stability test with applications to time-delay systems,” IEEE Transactions on Auomatic Control, (1985).Google Scholar
  15. 15.
    Chiasson, J.: “A method for computing the interval of delay values for which a differential-delay system,” IEEE Transactions on Automatic Control, 33 (1988) 1176–1178.MathSciNetzbMATHCrossRefGoogle Scholar
  16. 16.
    Chiasson, J. and Abdallah, C.T.: “A Test for Robust Stability of Time Delay Systems,” in Proceedings of the 3rd IFAC Conference on Time Delay Systems, Sante Fe, NM, 2001.Google Scholar
  17. 17.
    Cooke, K.L. and Ferreira, J.M.: “Stability conditions for linear retarded functional differential equations,” Journal of Mathematical Analysis and Applications 96 (1983).Google Scholar
  18. 18.
    Corradi, A., Leonardi, L. and Zambonelli, F.: “Diffusive load-balancing polices for dynamic applications,” IEEE Concurrency 22 (no. 31) (1999) 979-993Google Scholar
  19. 19.
    Cybenko, G.: “Journal of Parallel and Distributed Computing,” IEEE Transactions on Automatic Control, 7 (1989) 279-301Google Scholar
  20. 20.
    Dasgupt P., Performance Evaluation of Fast Ethernet, ATM and Myrinet under PVM, MS Thesis, 2001, University of Tennesse.Google Scholar
  21. 21.
    Dasgupta, P., Birdwell, J.D. and Wang, T.W.: “Timing and congestion studies under PVM,” in Proc. Tenth SIAM Conference on Parallel Processing for Scientific Computation, Portsmouth, VA, March 2001.Google Scholar
  22. 22.
    Datko, R.: “A procedure for determination of the exponenti al stabil ity of certain differential-difference equations,” in Quarterly Applied Mathematics, 36 (1978) 279–292.MathSciNetzbMATHGoogle Scholar
  23. 23.
    Dickmann, O., van Gils, S.A., Verduyn Lunel, S.M. and Walther, H.-O.: Delay Equations (Springer-Verlag New York, 1995Google Scholar
  24. 24.
    Hale, J.K. and Verduyn Lunel, S.M.: Introduction to Functional Differential Equations. Springer-Verlag: 1993Google Scholar
  25. 25.
    Hertz, D., Jury, E.I. and Zeheb, E.: “Simplified analytic stability test for systems with commensurate time delays,” in IEE Proceedings, pari D, 131 (1984).Google Scholar
  26. 26.
    Hertz, D., Jury, E.I. and Zeheb, E.: “Stability independent and dependent of delay for delay differential systems,” J. Franklin Institute (1984).Google Scholar
  27. 27.
    Kameda, H., Li, J., Kim, C. and Zhang, Y.: Optimal Lead Balancing in Distributed Camputer Systems (Springer London, 1997).CrossRefGoogle Scholar
  28. 28.
    Kameda, H., El-Zoghdy Said Fathy, Ryu, I. and Li, J.: “A Performance Comparison of Dynanmic versus Static Load Balancing Policies in a Mainframe,” in Proceedings of the 2000 IEEE Conference on Decision and Control, Sydney, Australia, pp. 1415–1420, December, 2000.Google Scholar
  29. 29.
    Kamen, E.W.: “Linear systems with commensurate time delays: Stability and stabilization independent of delay,” IEEE Transactions on Automatic Control, 27 (1982) 367–375.MathSciNetzbMATHCrossRefGoogle Scholar
  30. 30.
    Kleinrock, L.: Queuing Systems Vol I: Theory (John Wiley & Sons New York, 1975).Google Scholar
  31. 31.
    Mascolo, S.: “Smit“s Principle for Congestion Control in High-Speed Data Network.” IEEE Transactions on Automatic Control, 45 (2000) 358–364.MathSciNetzbMATHCrossRefGoogle Scholar
  32. 32.
    Niculescu, S.-I.: Delay Effects on Stability. A robust control approach (Springer-Verlag Heidelberg, 2001).zbMATHGoogle Scholar
  33. 33.
    Niculescu, S.-I. and C. T. Abdallah, “Delay effccts on static ouput feedback stabilization,” Proceedings of the IEEE Conf. Dec. Contr., Sydney, Australia (2000).Google Scholar
  34. 34.
    Ataşlar, B., Quet, P.F., Üftar, A., Özbay, H., Kang, T. and Kalyanaraman, S.: “Robust Rate-based now controllers for high-speed networks: the care of uncertain time-varying multiple time-delays.” Preprint, 2001.Google Scholar
  35. 35.
    Petterson, B.J., Robinett, R.D. and Werner, J.C.: “Lag-stabilized force feedback damping,” Intenal Report SAMD91-0194, UC-406, 1991.Google Scholar
  36. 36.
    Power, H.M. and Simpson, R.J.: Introduction to Dynamics and Control (McGraw-Hill: 1978).Google Scholar
  37. 37.
    Smith, O.J.M.: “Closed Control of Loops with Dead Time,” Chemical Engineering Progress, 57 (1957) 217–219.Google Scholar
  38. 38.
    Spies, F.: “Modeling of optimal load balancing strategy using queuing theory,” Microprocessors and Microprogramming, 41 (1996) 555–570.CrossRefGoogle Scholar
  39. 39.
    Wang, T.W., Birdwell, J.D., Yadav, P., Icove, D.J., Niezgoda, S. and Jones, S.: “Natural clustering of DNA/STR profiles,“ in Proc. Tenth International Symposium on Human Identification, Orlando, FL, September, 1999.Google Scholar
  40. 40.
    Willebcek-LeMair, M.H. and Reeves, A.P.: “Strategies for dynamic load balancing on highly parallel computers,” IEEE Transactions on Parallel and Distributed Systems, (1993) 979–993.Google Scholar
  41. 41.
    Xu, C. and Lau, F.C.M.: Load Balancing in Parallel Computers: Theory and Practice (Kluwer BostOn, 1997).Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • J. Douglas Birdwell
    • 1
  • John Chiasson
    • 1
  • Zhong Tang
    • 1
  • Chaouki Abdallah
    • 2
  • Majeed M. Hayat
    • 2
  • Tsewei Wang
    • 3
  1. 1.ECE DeptUniversity of TennesseeKnoxvilleUSA
  2. 2.ECE DeptUniversity of New MexicoAlbuquerqueUSA
  3. 3.ChE DeptUniversity of TennesseeKnoxvilleUSA

Personalised recommendations