Engineering Highly Accessed Web Sites for Performance

  • Jim Challenger
  • Arun Iyengar
  • Paul Dantzig
  • Daniel Dias
  • Nathaniel Mills
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2016)


This paper describes techniques for improving performance at Web sites which receive significant traffic. Poor performance can be caused by dynamic data, insufficient network bandwidth, and poor Web page design. Dynamic data overheads can often be reduced by caching dynamic pages and using fast interfaces to invoke server programs. Web server acceleration can significantly improve performance and reduce the hardware needed at a Web site. We discuss techniques for balancing load among multiple servers at a Web site. We also show how Web pages can be designed to minimize traffic to the site.


Server Node Load Imbalance Expiration Time Proxy Cache Open Short Path First 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    T. Brisco. DNS Support for Load Balancing. Technical Report RFC 1974, Rutgers University, April 1995.Google Scholar
  2. 2.
    V. Cardellini, M. Colajanni, and P. Yu. Dynamic Load Balancing on Web-Server Systems. IEEE Internet Computing, pages 28–39, May/June 1999.Google Scholar
  3. 3.
    J. Challenger, P. Dantzig, and A. Iyengar. A Scalable and Highly Available System for Serving Dynamic Data at Frequently Accessed Web Sites. In Proceedings of ACM/IEEE SC98, November 1998.Google Scholar
  4. 4.
    J. Challenger, A. Iyengar, and P. Dantzig. A Scalable System for Consistently Caching Dynamic Web Data. In Proceedings of IEEE INFOCOM’99, March 1999.Google Scholar
  5. 5.
    J. Challenger, A. Iyengar, K. Witting, C. Ferstat, and P. Reed. A Publishing System for Efficiently Creating Dynamic Web Content. In Proceedings of IEEE INFOCOM 2000, March2000.Google Scholar
  6. 6.
    A. Chankhunthod et al. A Hierarchical Internet Object Cache. In Proceedings of the 1996 USENIX Technical Conference, pages 153–163, January 1996.Google Scholar
  7. 7.
  8. 8.
    D. Dias, W. Kish, R. Mukherjee, and R. Tewari. A Scalable and Highly Available Web Server. In Proceedings of the 1996 IEEE Computer Conference (COMPCON), February 1996.Google Scholar
  9. 9.
    G. Goldszmidt and A. Stanford-Clark. Load Distribution for Scalable Web Servers: Summer Olympics 1996-A Case Study. In Proceedings of the 8th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management, October 1997.Google Scholar
  10. 10.
    G. Hunt, G. Goldszmidt, R. King, and R. Mukherjee. Network Dispatcher: A Connection Router for Scalable Internet Services. In Proceedings of the 7th International World Wide Web Conference, April 1998.Google Scholar
  11. 11.
    A. Iyengar and J. Challenger. Improving Web Server Performance by Caching Dynamic Data. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, December 1997.Google Scholar
  12. 12.
    R. Lee. A Quick Guide to Web Server Acceleration. /bordermanager/accel.html.
  13. 13.
    E. Levy, A. Iyengar, J. Song, and D. Dias. Design and Performance of a Web Server Accelerator. In Proceedings of IEEE INFOCOM’99, March 1999.Google Scholar
  14. 14.
    Y. H. Liu, P. Dantzig, C. E. Wu, and L. M. Ni. A Distributed Connection Manager Interface for Web Services on SP Systems. In Proceedings of the International Conference for Parallel and Distributed Systems, June 1996.Google Scholar
  15. 15.
    Microsoft Corporation. Installation and Performance Tuning of Microsoft Scalable Web Cache (SWC 2.0).
  16. 16.
    P. Mockapetris. Domain Names-Implementation and Specification. Technical Report RFC 1035, USC Information Sciences Institute, November 1987.Google Scholar
  17. 17.
    Radware Ltd. Complete IP Load balancing Solutions from RADWARE.
  18. 18.
    Resonate Inc. Central Dispatch-Data Sheets. /products/central_dispatch/data_sheets.html.

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Jim Challenger
    • 1
  • Arun Iyengar
    • 1
  • Paul Dantzig
    • 1
  • Daniel Dias
    • 1
  • Nathaniel Mills
    • 1
  1. 1.IBM ResearchT. J. Watson Research CenterUSA

Personalised recommendations