Abstract
Proxy servers are common solutions to relieve organizational networks from heavy traffic by storing the most frequently referenced web objects in their local cache. These proxies are commonly known as cooperative proxy systems and are usually organized in such a way as to optimize the utilization of their storage capacity. However, the design of the organizational structure of such proxy system depends heavily on the designer's knowledge of the network's performance. This article describes three methods to tackle this load balancing problem. They allow the self-organization of proxy servers by modeling each server as an autonomous entity that can make local decisions based on the traffic pattern it has served.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abdulla, G. (1998). Analysis and Modeling of World Wide Web Traffic. Ph.D. Thesis, Virginia Polytechnic Institute and State University.
Barish, G. and Obraczka, K. (2000). World Wide Web Caching: Trends and Techniques. IEEE Communications Magazine, 38(5), 178–184.
Breslau, L., Cao, P., Fan, L., Phillips, G., and Shenker, S. (1998).Web Caching and Zipf-Lie Distributions: Evidence and Implications. Technical Report 1371, Computer Science Department, University of Wisconsin-Madison.
Bryhni, H., Klovning, E., and Kure, O. (2000). A Comparison of Load Balancing Techniques for Scalable Web Servers. IEEE Network, 14(4), 58–64.
Bunt, R.B., Eager, D.L., Oster, G.M., and Williamson, C.L. (1999). Achieving Load Balance and Effective Caching in Clustered Web Servers. In Proceedings of the Fourth International WWW Caching Workshop.
Caceres, R., Douglis, F., Feldmann, A., Glass, G., and Rabinovich, M. (1998). Web Proxy Caching: The Devil is in the Details. Performance Evaluation Review, 26(3), 11–15.
Cardellini, V., Colajanni, M., and Yu, P.S. (1999). Load Balancing on Web-Server Systems. IEEE Internet Computing, 3(3), 28–39.
Cohen, J., Phadnis, N., Valloppillil, V., and Ross, K.W. (1997). Cache Array Routing Protocol V.1.1.
Duska, B.M., Marwood, D., and Feeley, M.J. (1997). The Measured Access Characteristics of World-Wide-Web Client Proxy Caches. In Proceedings of USENIX Symposium on Internet Technology and Systems.
Dykes, S.G., Jeffery, C.L., and Das, S. (1999). Taxonomy and Design for DistributedWeb Caching. In Proceedings of the Hawaii International Conference on System Science.
Jacobson, Q. and Cao, P. (1998). Potential and Limits of Web Prefetching Between Low-Bandwidth Clients and Proxies. In Proceedings of Third International WWW Caching Workshop.
Kaelbling, L.P., Littman, M.L., and Moore, A.P. (1996). Reinforcement Learning: A Survey. Journal of Artificial Intelligence Research, 4, 237–285.
Kaiser, M.J., Tsui, K.C., and Liu, J. (2000a). Adaptive Distributed Caching. In Proceedings of the 2002 Congress on Evolutionary Computation, pp. 1810–1815.
Kaiser, M.J., Tsui, K.C., and Liu, J. (2000b). Self-Organized Autonomous Web Proxies. In Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1397–1401.
Karger, D., Leighton, T., Lewin, D., and Sherman, A. (1999).Web Caching with Consistent Hashing. In Proceedings of the WWW8 Conference.
Kohonen, T. (2001). Self-Organizing Maps, (3rd ed.), Berlin: Springer-Verlag.
Kohonen, T., Kaski, S., Lagus, K., Salojärvi, J., Paatero, V., and Saarela, A. (2000). Self Organization of a Massive Document Collection. IEEE Transactions on Neural Networks, 11(3), 574–585. Special Issue on Neural Networks for Data Mining and Knowledge Discovery.
Liu, J. and Tsui, K.C. (2001). Introduction to Autonomy Oriented Computation. In Proceedings of 1st International Workshop on Autonomy Oriented Computation, pp. 1–11.
Raunak, M.S. (1999). A Survey of Cooperative Caching. Technical Report.
Rodriguez, P., Spanner, C., and Biersack, E.W. (1999). Web Caching Architectures: Hierarchical and Distributed Caching. In Proceedings of the Fourth International WWW Caching Workshop.
Sutton, R.S. and Barto, A.G. (1998). Reinforcement Learning: An Introduction. MIT Press.
Tsui, K.C., Liu, J., and Liu, H.L. (2001). Autonomy Oriented Load Balancing in Proxy Cache Servers. In Web Intelligence: Research and Development. Proceedings of First Asia-Pacific Conference on Web Intelligence, Springer-Verlag, pp. 115–124.
Wang, J. (1999). A Survey of Web Caching Schemes for the Internet. ACM Computer Communication Review, 29(5), 36–46.
Wang, Z. and Crowcroft, J. (1997). CacheMesh: A Distributed Cache System for World Wide Web. In Proceedings of NLANR Web Cache Workshop.
Wu, K. and Yu, P. (1999). Load Balancing and Hot Spot Relief for Hash Routing Among a Collection of Proxy Caches. In Proceedings of the 19th International Conference on Distributed Computing Systems.
Zegura, E., Calvert, K., and Bhattacharjee, S. (1996). How to Model an Internetwork. In Proceedings of INFOCOM 96.
Zhang, L., Michel, S., Nguyen, K., and Rosenstein, A. (1998). Adaptive Web Caching: Towards a New Global Caching Architecture. In Proceedings of the Third International WWW Caching Workshop.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tsui, K.C., Liu, J. & Kaiser, M.J. Self-Organized Load Balancing in Proxy Servers: Algorithms and Performance. Journal of Intelligent Information Systems 20, 31–50 (2003). https://doi.org/10.1023/A:1020943021842
Issue Date:
DOI: https://doi.org/10.1023/A:1020943021842