Tuning of QoS Aware Load Balancing Algorithm (QoS–LB) for Highly Loaded Server Clusters

  • Kimmo Kaario
  • Timo Hämäläinen
  • Jian Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2094)


This paper introduces a novel algorithm for content based switching. A content based scheduling algorithm (QoS Aware Load Balancing Algorithm, QoS-LB) which can be used at the front-end of the server cluster is presented. The front-end switch uses the content information of the requests and the load on the back servers to choose the server to handle each request. At the same time, different Quality of Service (QoS) classes of the customers can be considered as one parameter in the load balancing algorithm. This novel feature becomes more important when service providers begin to offer the same services for customers with different priorities.


Server Cluster Active Queue Management Prefer Server Edge Router Smart Client 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    D. Andresen et al. SWEB: Towards a Scalable WWW Server on MultiComputers. In Proceedings of the 10th International Parallel Processing Symposium, Apr. 1996Google Scholar
  2. 2.
    E. Amir, S. McCanne, R. H. Katz: An Active Service Framework and Its Application to Real Time Multimedia Transcoding. Proceedings ACM SIGCOMM, 1998.Google Scholar
  3. 3.
    G. Apostopoulos, D. Aubespin, V. Peris, P. Pradhan, D. Saha: Design, Implementation and Performance of a Content-Based Switch. Proceedings of IEEE INFOCOM 2000.Google Scholar
  4. 4.
    T. Brisco. DNS Support for Load Balancing. RFC 1794, Apr. 1995.Google Scholar
  5. 5.
    Cisco Systems Inc. LocalDirector.
  6. 6.
    O. P. Damani, P. Y. E. Chung, Y. Huang, C. Kintala, and Y. M. Wang: ONE-IP: Techniques for hosting a service on a cluster of machines. Computer Networks and ISDN SystemGoogle Scholar
  7. 7.
    A. Fox, S. D. Gribble, Y. Chawathe, E. A. Brewer, and P. Gauthier: Cluster-based scalable network services. In Proceedings of the Sixteenth ACM Symposium on Operating System Principles, San Malo, France, Oct. 1997. s, 29:1019–1027, 1997.Google Scholar
  8. 8.
    G. Hunt, E. Nahum, and J. Tracey: Enabling content-based load distribution for scalable services. Technical report, IBM T.J. Watson Research Center, May 1997.Google Scholar
  9. 9.
    IBM Corporation. IBM interactive network dispatcher.
  10. 10.
    W. Leland, M. Taqqu, W. Willinger and D. Wilson: On the self-similar nature of Ethernet traffic (extended version). IEEE/ACM Tran. Networking, Vol. 2, 1994, pp. 1–15.CrossRefGoogle Scholar
  11. 11.
    J. Liedtke, V. Panteleenko, T. Jaeger, and N. Islam: High-performance caching with the Lava hit-server. In Proceedings of the USENIX 1998 Annual Technical Conference, New Orleans, LA, June 1998.Google Scholar
  12. 12.
    V. S. Pai, M Aron, G. Banga, M. Svendsen, P. Druschel, W. Zwaenepoel, E. Nahum: Locality-Aware Request Distribution in Cluster-Based Network Servers. In Architectural Support for Programming Languages and Operating Systems, 1998.Google Scholar
  13. 13.
    V. Paxson and S. Floyd: Wide Area Traffic: The Failure of Poisson Modeling. IEEE/ACM Transactions on Networking, Vol. 3, No. 3, June 1995, pp. 226–244.CrossRefGoogle Scholar
  14. 14.
    P. Pradhan, T. Chiueh, A. Neogi: Aggregate TCP Congestion Control Using Multiple Network Probing. Proceedings of ICDCS 2000.Google Scholar
  15. 15.
    Resonate Inc. Resonate dispatch.
  16. 16.
    B. Suter, T.V. Lakshman, D. Stiliadis, A.K Choudhury: Buffer Management Schemes for Supporting TCP in Gigabit Routers with Per-Flow Queueing. IEEE Journal in Selected Areas in Communications, August 1999.Google Scholar
  17. 17.
    B. Tsybakov, N. D. Georganas: On Self-Similar Traffic in ATM Queues: Definitions, Overflow Probability Bound, and Cell Delay Distribution. IEEE/ACM Transactions on Networking, Vol. 5, No. 3, June 1997, pp. 397–409.CrossRefGoogle Scholar
  18. 18.
    B. Yoshikawa et al.: Using Smart Clients to Build Scalable Services. In Proceedings of the 1997 Usenix Technical Conference, Jan. 1997.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Kimmo Kaario
    • 1
  • Timo Hämäläinen
    • 2
  • Jian Zhang
    • 2
  1. 1.Honeywell Industrial Automation & ControlOhjelmakaari 1Finland
  2. 2.Faculty of Information Technology Department of Mathematical Information Technology TelecommunicationUniversity of JyväskyläFinland

Personalised recommendations