Request Scheduling for Differentiated QoS at Website Gateway

  • Ching-Ming Tien
  • Shuo-Yen Wen
  • Ying-Dar Lin
  • Yuan-Cheng Lai
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3961)


With the explosive growth of Web traffic, the load on a Web server becomes heavier, leading to the longer user-perceived latency. Website operators would like to employ service differentiation to offer better throughput and shorter user-perceived latency to some specific users. This paper presents an HTTP request scheduling algorithm deployed at the website gateway to enable the Web quality of service without any modification to client or server software. A variation of the deficit round robin scheduling algorithm and a window control mechanism are presented to decide the order and the releasing time of requests, respectively. The order is decided by the response size of the requests and the pre-defined service weights. The ratio of the bandwidth throughput of the service classes is determined by the weights, whereas the releasing time is decided by the service rate of the Web server. The evaluation reveals the scheduling algorithm can provide service differentiation and improve server throughput and user-perceived latency.


Schedule Algorithm Page Size Response Size Server Prober Request Schedule 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Mills, P., Loosley, C.: A performance Analysis of 40 e-Business Web Sites. CMG Journal of Computer Resource Management (102) (2001)Google Scholar
  2. 2.
    Braden, R., Clark, D., Shenker, S.: Integrated Services in the Internet Architecture: an Overview, IETF RFC 1633 (1994),
  3. 3.
    Blake, S., Black, D., et al.: An Architecture for Differentiated Services, IETF RFC 2475 (1998),
  4. 4.
    Braden, R., Zhang, L., et al (eds.): Resource ReSerVation Protocol (RSVP) – Version 1 Functional Specification, IETF RFC 2205 (1997),
  5. 5.
    Almeida, J., Dabu, M., Manikutty, A., Cao, P.: Providing Differentiated Levels of Service in Web Content Hosting. In: Proccedings of the 1998 Workshop on Internet Server Performance (1998)Google Scholar
  6. 6.
    Pandey, R., Barnes, J.F., Olsson, R.: Supporting Quality of Service in HTTP Servers. In: Proceedings of the Seventeenth Annual ACM Symposium on Principles of Distributed Computing, pp. 247–256 (1998)Google Scholar
  7. 7.
    Eggert, L., Heidemann, J.: Application-Level Differentiated Services for Web Servers. World Wide Web Journal 2(3), 133–142 (1999)CrossRefGoogle Scholar
  8. 8.
    Bhatti, N., Friedrich, R.: Web Server Support for Tiered Services. IEEE Network 13(5), 64–71 (1999)CrossRefGoogle Scholar
  9. 9.
    Vasiliou, N., Lutfiyya, H.: Providing a Differentiated Quality of Service in a World Wide Web Server. ACM SIGMETRICS Performance Evaluation Review 28(2), 22–28 (2000)CrossRefGoogle Scholar
  10. 10.
    Chen, X., Mohapatra, P.: Performance Evaluation of Service Differentiating Internet Servers. IEEE Transaction on Computers 51(11), 1368–1375 (2002)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Shreedhar, M., Varghese, G.: Efficient Fair Queuing Using Deficit Round-Robin. IEEE/ACM Transaction on Networking 4(3), 375–385 (1996)CrossRefGoogle Scholar
  12. 12.
    The Apache HTTP Server Project,
  13. 13.
  14. 14.
    Barford, P., Crovella, M.: Generating Representative Web Workloads for Network and Server Performance Evaluation. ACM SIGMETRICS Performance Evaluation Review 26(1), 151–160 (1998)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ching-Ming Tien
    • 1
  • Shuo-Yen Wen
    • 1
  • Ying-Dar Lin
    • 1
  • Yuan-Cheng Lai
    • 2
  1. 1.Department of Computer and Information ScienceNational Chiao Tung UniversityHsinchuTaiwan
  2. 2.Department of Information ManagementNational Taiwan University of Science and TechnologyTaipeiTaiwan

Personalised recommendations