Balancing HTTP Traffic Using Dynamically Updated Weights, an Implementation Approach

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3746)


In this paper we present a load balancing application for HTTP traffic that uses dynamic weights. We introduce a load balancing policy based on two criteria: “process time” and “network delay”. The former describes Web servers ability to process a forthcoming request, while the latter tries to estimate network conditions. Calculation of the two criteria is periodically updated. A Weighted Round Robin algorithm was implemented using the two aforementioned metrics in order to dynamically estimate the balancing weights.

We confirm that the combination of the two criteria increases sensitivity and responsiveness of the application towards network conditions and therefore the performance of the whole load balancing system. Balancing decisions should not be only “load” or “connection” dependent, but also contention dependent.


Load Balance Network Delay Weight Round Robin Short Remain Processing Time Load Balance System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bestavros, A., Crovella, M., Liu, J., Martin, D.: Distributed Packet Rewriting and its Application to Scalable Web Server Architectures. In: Proc. of the 6th International Conference on Network Protocols, ICNP (October 1998)Google Scholar
  2. 2.
    Cisco Company. Cisco - An introduction to IGRP (2004)Google Scholar
  3. 3.
    Cisco Inc. Cisco Distributed Director (2004),
  4. 4.
    Maltz, D., Bhagwat, P.: Application layer proxy performance using TCP splice. Technical report, IBM T.J. Watson Research Center (1998)Google Scholar
  5. 5.
    Song, J., Levy-Abegnoli, E., Dias, D.: Design alternatives for scalable Web server accelerators. In: Proc. of the 2000 IEEE International Symposium on Performance Analysis of Systems and Software (April 2000)Google Scholar
  6. 6.
    Mamatas, L., Tsaoussidis, V.: A new approach to Service Differentiation: Non-Congestive Queueing. Technical report, Democritus University of Thrace (2004)Google Scholar
  7. 7.
    Linux VS Team. Linux Virtual Server Implementation (2002)Google Scholar
  8. 8.
    Colajanni, M., Yu, P., Dias, M.D.: Analysis of task assignment policies in scalable distributed Web-server systems. IEEE Trans. on Parallel Distributed Systems (June 1998)Google Scholar
  9. 9.
    Bansal, N., Harchol Balter, M.: Analysis of SRPT scheduling: Investigating unfairness. In: Proc. of the 2001 ACM/IFIP Joint International Conference on Measurement and Modeling of Computer Systems (March 2001)Google Scholar
  10. 10.
    Srisuresh, P., Gan, D.: Load sharing using IP Network Address Translation, RFC 2391 (1999)Google Scholar
  11. 11.
    Srisuresh, P., Egevang, K.: Traditional IP Network Address Translation, RFC 3022 (2001)Google Scholar
  12. 12.
    Schemers, R.J.: ldnamed: A load Balancing Name Server in Perl. In: Proc. of the 9th Systems Administration Conference (1995)Google Scholar
  13. 13.
    RESONATE Team, TCP Connection Hop. White paper (April 2001)Google Scholar
  14. 14.
    Blake, S., Black, D., Carlson, M., Davies, E., et al.: An Architecture for Differentiated Service, RFC 2475 (December 1998)Google Scholar
  15. 15.
    Cardellini, V., Casalicchio, E., Colajanni, M., Yu, P.: The State of the Art in Locally Distributed Web-Server Systems. ACM Computing Surveys 34(2), 263–311 (2002)CrossRefGoogle Scholar
  16. 16.
    Cardellini, V., Colajanni, M., Yu, P.S.: Geographic load balancing for scalable distributed Web systems. In: Proc. of the 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (2000)Google Scholar
  17. 17.
    Jacobson, V.: Congestion Avoidance and Control. In: Proc. of the ACM SIGCOMM 1988 (August 1988)Google Scholar
  18. 18.
    Pai, V., Aron, M., Banga, G., Svendsen, M., Druschel, P., Zwaenepoel, W., Nahum, E.: Locality-aware request distribution in cluster-based network servers. In: Proc. of the 8th ACM Conference on Architectural Support fro Programming Languages and Operating Systems (October 1998)Google Scholar
  19. 19.
    Zhang, W.: Linux Server Clusters for Scalable Network Services. In: Free Software Symposim, China (2002)Google Scholar
  20. 20.
    Zhang, W., Zhang, W.: Linux Virtual Server Clusters. Linux Magazine (November 2003)Google Scholar
  21. 21.
    Hu, Y., Nanda, A., Yang, Q.: Measurement, analysis and performance improvement of Apache Web server. In: Proc. of the 18th IEEE International Performance, Computing and Communications Conference (February 1999)Google Scholar
  22. 22.
    Zeus Development Team, Zeus Web Server. Technical report, Zeus Technology (2002),

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  1. 1.Dept. of Electrical & Computer EngineeringDemocritus University of ThraceXanthiGreece

Personalised recommendations