A Proactive Distributed QoS Control Framework for Cluster Web Site

  • Wang Xiaochuan
  • Jin Shiyao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4208)


In this paper, we present a distributed QoS control framework for cluster web applications. We describe the system structure and inner operations from the perspective of control theory. Controllers spread across all back-end servers, proactively controlling the actuators on the cluster entry. This can accommodate advanced but resource consuming control models and algorithms without central performance bottleneck problem in contrast to previous proposals. Our proposal also takes friendliness, flexibility and effectiveness of the control scheme into consideration for practical employment. We give an example implementation based on this framework. Experiments prove its feasibility and effectiveness.


Admission Control Request Type Overload Control Initial Response Time Request Category 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Crovella, M.E., Bestavros, A.: Self-Similarity in World Wide Web Traffic: Evidence and Possible Causes. IEEE/ACM Transactions on Networking 5(6), 835–846 (1997)CrossRefGoogle Scholar
  2. 2.
    Li, K., Jamin, S.: A measurement-based admission-controlled Web server. In: Proceedings of IEEE Infocom 2000, Tel-Aviv, Israel (March 2000)Google Scholar
  3. 3.
    Banga, G., Druschel, P., Mogul, J.: Resource containers: A new facility for resource management in server systems. In: Proceedings of the Third USENIX Symposium on Operating Systems Design and Implementation (OSDI 1999) (February 1999)Google Scholar
  4. 4.
    Harchol-Balter, M., Crovella, M., Park, S.: The case for SRPT scheduling in Web servers. Technical Report MIT-LCR-TR-767, MIT (October 1998)Google Scholar
  5. 5.
    Schroeder, B., Harchol-Balter, M.: Web servers under overload: How scheduling can help. Technical Report CMU-CS-02-143, Carnegie-Mellon University (June 2002)Google Scholar
  6. 6.
    Guitart, J., Carrera, D.: Session-Based Adaptive Overload Control for Secure Dynamic Web Applications. In: Proceedings of 34th International Conference on Parallel Processing (ICPP 2005), Oslo, Norway, June 14-17 (2005)Google Scholar
  7. 7.
    Breslau, L., Knightly, E.W., Shenker, S., Stoica, I., Zhang, H.: Endpoint admission control: Architectural issues and performance. In: Proceedings of ACM SIGCOMM 2000, Stockholm, Sweeden (October 2000)Google Scholar
  8. 8.
    Iyer, R., Tewari, V., Kant, K.: Overload control mechanisms for Web servers. In: Workshop on Performance and QoS of Next Generation Networks, Nagoya, Japan (November 2000)Google Scholar
  9. 9.
    Kanodia, V., Knightly, E.: Multi-class latency-bounded Web services. In: Proceedings of IEEE/IFIP IWQoS 2000, Pittsburgh, PA (June 2000)Google Scholar
  10. 10.
    Chandra, S., Ellis, C.S., Vahdat, A.: Differentiated multimedia Web services using quality aware transcoding. In: Proceedings of IEEE INFOCOM 2000 (March 2000)Google Scholar
  11. 11.
    Chen, X., Chen, H., Mohapatra, P.: An admission control scheme for predictable server response time for Web accesses. In: Proceedings of the 10th World Wide Web Conference, Hong Kong (May 2001)Google Scholar
  12. 12.
    Menasce, D.A., Barbara, D., Dodge, R.: Preserving QoS of E-commerce Sites Through Self-Tuning: A Performance Model Approach. In: The Proceedings of the 3rd ACM Conference on Electronic Commerce, Tampa, Florida, USA (October 2001)Google Scholar
  13. 13.
    Chen, H., Mohapatra, P.: Session-based overload control in QoS-aware Web servers. In: Proceedings of IEEE INFOCOM 2002, New York (June 2002)Google Scholar
  14. 14.
    Tan, Z., Lin, C., Yin, H., Hong, Y.: Approximate Performance Analysis of Web Services Flow Using Stochastic Petri Net. In: Jin, H., Pan, Y., Xiao, N., Sun, J. (eds.) GCC 2004. LNCS, vol. 3251, pp. 193–200. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  15. 15.
    Lu, C., Abdelzaher, T., Stankovic, J., Son, S.: A feedback control approach for guaranteeing relative delays in Web servers. In: IEEE Real-Time Technology and Applications Symposium, Taipei, Taiwan (June 2001)Google Scholar
  16. 16.
    Diao, Y., Gandhi, N., Hellerstein, J., Parekh, S., Tilbury, D.: Using MIMO feedback control to enforce policies for interrelated metrics with application to the Apache Web server. In: Proceedings of the Network Operations and Management Symposium 2002, Florence, Italy (April 2002)Google Scholar
  17. 17.
    Welsh, M.D.: An Architecture for Highly Concurrent, Well-Conditioned Internet Services. Ph.D. thesis, U.C. Berkeley (September 2002)Google Scholar
  18. 18.
    Zhang, R., Lu, C., Abdelzaher, T.F., Stankovic, J.A.: ControlWare: A Middleware Architecture for Feedback Control of Software Performance. In: International Conference on Distributed Computing Systems, Vienna, Austria (July 2002)Google Scholar
  19. 19.
    Zhang, R., Abdelzaher, T.F., Stankovic, J.A.: Kernel Support for Open QoS-Aware Computing. In: Real-Time and Embedded Technology and Applications Symposium, Toronto, Canada (May 2003)Google Scholar
  20. 20.
    Lu, Y., Abdelzaher, T.F., Saxena, A.: Design, Implementation, and Evaluation of Differentiated Caching Services. IEEE Transactions on Parallel and Distributed Systems 15(5), 440–452 (2004)CrossRefGoogle Scholar
  21. 21.
    Lu, C., Lu, Y., Abdelzaher, T.F., Stankovic, J.A., Son, S.H.: Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web Servers. IEEE Transactions on Parallel and Distributed Systems (2005)Google Scholar
  22. 22.
    Huang, C., Abdelzaher, T.: Bounded-Latency Content Distribution: Feasibility and Evaluation. IEEE Transactions on Computers (2005)Google Scholar
  23. 23.
    Vivek, S., Mohit, A.: Locality-Aware Request Distribution in Cluster-based Network Servers. In: Proc. of ASPLOS-VIII, ACM SIGPLAN 1998, pp. 205–216 (1998)Google Scholar
  24. 24.
    Aron, M., Druschel, P., Zwaenepoel, W.: Cluster reserves: A mechanism for resource management in cluster-based network servers. In: Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, Santa Clara, CA (June 2000)Google Scholar
  25. 25.
    Ranjan, S., Rolia, J., Knightly, E.: IWQoS 2002. QoS-Driven Server Migration for Internet Data Centers. In: Proceedings of IEEE IWQoS (2002)Google Scholar
  26. 26.
    Urgaonkar, B., Shenoy, P.: Dynamic Provisioning of Multi-tier Internet Applications. In: Proceedings of the 2nd IEEE International Conference on Autonomic Computing (ICAC 2005), Seattle (June 2005)Google Scholar
  27. 27.
    Tang, X., Chanson, S.T., Chi, H., Lin, C.: Session-Affinity Aware Request Allocation for Web Clusters. In: Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS 2004), Tokyo, Japan, March 24-26, pp. 142–149. IEEE Computer Society, Los Alamitos (2004)CrossRefGoogle Scholar
  28. 28.
    Verma, A., Ghosal, S.: On Admission Control for Profit Maximization of Networked Service Providers. In: Proc. of 12th Int’l. World Wide Web Conf. (WWW 2003), Budapest, Hungary (May 2003)Google Scholar
  29. 29.
    Elnikety, S., Nahum, E.: A Method for Transparent Admission Control and Request Scheduling in E-Commerce Web Sites. In: Proceedings of WWW 2004, New York, USA, May 17–22 (2004)Google Scholar
  30. 30.
    Urgaonkar, B., Cataclysm, P.S.: Handling Extreme Overloads in Internet Applications. In: Proceedings of the Fourteenth International World Wide Web Conference (WWW 2005), Chiba, Japan (May 2005)Google Scholar
  31. 31.
    Shan, Z., Lin, C., Marinescu, D.C., Yang, Y.: QoS-aware load balancing in Web-server clusters: performance modeling and approximate analysis. Computer Networks Journal 40(2), 235–256 (2002)CrossRefGoogle Scholar
  32. 32.
    Lin, C., Marinescu, D.C.: Stochastic high-level Petri nets and applications. IEEE Trans. on Computers 37(7), 815–825 (1988)CrossRefGoogle Scholar
  33. 33.
    Wang, L.-X.: A Course in Fuzzy Systems and Control. Prentice-Hall, Englewood Cliffs (1997)MATHGoogle Scholar
  34. 34.
    Banga, G., Druschel, P.: Measuring the capacity of a web server. In: Usenix Symposium on Internet Technologies and Systems (1997)Google Scholar
  35. 35.
    Barford, P., Crovella, M.E.: Generating Representative Web Workloads for Network and Server Performance Evaluation. In: ACM SIGMETRICS 1998, Madison WI (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Wang Xiaochuan
    • 1
  • Jin Shiyao
    • 1
  1. 1.School of Computer ScienceNational University of Defense TechnologyChangshaChina

Personalised recommendations