Abstract
Caching web pages is an important part of web infrastructure. The effects of caching services are even more pronounced for wireless infrastructures due to their limited bandwidth. Medium to large-scale infrastructures deploy a cluster of servers to solve the scalability problem and hot spot problem inherent in caching. In this report, we present Dynamic Information-based Scalable Hashing (DISH) that evenly hashes client requests to a cluster of cache servers. Three types of runtime information are used to determine when and how to cache pages, including cache utilization, CPU usage, and number of connections. Pages cached are stored and retrieved mutually exclusively to/from all the servers. We have implemented our approach and performed various experiments using publicly available traces. Experimental results on a cluster of 16 cache servers demonstrate that the proposed hashing method gives 45% to 114% performance improvement over other widely used methods, while addressing the hot spot problem.
Hukeun Kwak and Kyusik Chung are supported in part by the Basic Research Program of the Korea Science & Engineering Foundation grant No.R01-2006-000-11167-0.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zeng, D., Wang, F., Liu, M.: Efficient web content delivery using proxy caching techniques. IEEE Transactions on Systems, Man and Cybernetics 34(3), 270–280 (2004)
Challenger, J., Dantzig, P., Ivengar, A., Squillante, M., Zhang, L.: Efficient serving dynamic data at highly accessed web sites. IEEE/ACM Transactions on Networking 12(2), 233–246 (2004)
Trianfillou, P., Aekaterinidis, I.: ProxyTeller: a proxy placement tool for content delivery under performance constraints. In: Proceedings of the 4th International Web Information Systems Engineering, pp. 62–71 (2003)
Yin, L., Cao, G.: Supporting cooperative caching in ad hoc networks. IEEE Transactions on Mobile Computing 5(1), 77–89 (2006)
Ni, J., Tsang, D.: Large-scale cooperative caching and application-level multicast in multimedia content delivery networks. IEEE Communications Magazine 43(5), 98–105 (2005)
Fu, X., Yang, L.: Improvement to HOME based Internet caching protocol. In: IEEE 18th Annual Workshop on Computer Communications, pp. 159–165. IEEE Computer Society Press, Los Alamitos (2003)
Mei, H., Lu, C., Lai, C.: An automatic cache cooperative environment using ICP. In: International Conference on Information Technology: Coding and Computing, pp. 144–149 (2002)
Rivest, D.: The MD5 Message Digest Algorithm, RFC 1321 (1992)
Karger, D.: Web Caching with consistent hashing. In: WWW8 conference (1999)
Micorsoft Corp.: Cache Array routing protocol and microsoft proxy server 2.0, White Paper (1999)
Baboescu, F.: Proxy Caching with Hash Functions, Technical Report CS2001-0674 (2001)
Toyofumi, T., Satosi, K., Hidetosi, O.: Adaptive load balancing content address hashing routing for reverse proxy servers. In: IEEE International Conference on Communications, vol. 27(1), pp. 1522–1526. IEEE Computer Society Press, Los Alamitos (2004)
Lei, S., Grama, A.: Extended consistent hashing: an efficient framework for object location. In: Proceeding of 24th International Conference on Distributed Computing Systems, pp. 254–262 (2004)
Ramaswamy, L., Liu, L., Iyengar, A.: Cache Clouds: Cooperative Caching of Dynamic Documents in Edge Networks. In: Proceedings of 25th IEEE International Conference on Distributed Computing Systems, pp. 229–238. IEEE Computer Society Press, Los Alamitos (2005)
Mindcraft, Inc.: WebStone: The Benchmark for Web Server, http://www.mindcraft.com/web-stone
Barford, P., Crovella, M.: Generating Representative Web Workloads for Network and Server Performance Evaluation. In: Proc. ACM SIGMETRICS Conf., Madison, WI, ACM Press, New York (1998)
Squid Web Proxy Cache, http://www.squid-cache.org
LVS (Linux Virtual Server), http://www.linuxvirtualserver.org
KTCPVS (Kernel TCP Virtual Server), http://www.linuxvirtualserver.org/software/ktcpvs/ktcpvs.html
Felix, H., Jeffay, K., Smith, F.: Tracking the Evolution of Web Traffic. In: MASCOTS. Proceedings of the 11th IEEE/ACM International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, pp. 16–25 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sohn, A., Kwak, H., Chung, K. (2007). DISH - Dynamic Information-Based Scalable Hashing on a Cluster of Web Cache Servers. In: Perrott, R., Chapman, B.M., Subhlok, J., de Mello, R.F., Yang, L.T. (eds) High Performance Computing and Communications. HPCC 2007. Lecture Notes in Computer Science, vol 4782. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75444-2_73
Download citation
DOI: https://doi.org/10.1007/978-3-540-75444-2_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75443-5
Online ISBN: 978-3-540-75444-2
eBook Packages: Computer ScienceComputer Science (R0)