Advertisement

DOH: A Content Delivery Peer-to-Peer Network

  • Jimmy Jernberg
  • Vladimir Vlassov
  • Ali Ghodsi
  • Seif Haridi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4128)

Abstract

Many SMEs and non-profit organizations suffer when their Web servers become unavailable due to flash crowd effects when their web site becomes popular. One of the solutions to the flash-crowd problem is to place the web site on a scalable CDN (Content Delivery Network) that replicates the content and distributes the load in order to improve its response time.

In this paper, we present our approach to building a scalable Web Hosting environment as a CDN on top of a structured peer-to-peer system of collaborative web-servers integrated to share the load and to improve the overall system performance, scalability, availability and robustness. Unlike cluster-based solutions, it can run on heterogeneous hardware, over geographically dispersed areas. To validate and evaluate our approach, we have developed a system prototype called DOH (DKS Organized Hosting) that is a CDN implemented on top of the DKS (Distributed K-nary Search) structured P2P system with DHT (Distributed Hash table) functionality [9]. The prototype is implemented in Java, using the DKS middleware, the Jetty web-server, and a modified JavaFTP server. The proposed design of CDN has been evaluated by simulation and by evaluation experiments on the prototype.

Keywords

Service Time Overlay Network Distribute Hash Table Content Delivery Request Rate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Adler, S.: The Slashdot Effect: An Analysis of Three Internet Publications (2005), [Online]http://ssadler.phy.bnl.gov/adler/SDE/SlashDotEffect.html
  2. 2.
    Akamai Technologies, Inc. [Online], http://www.akamai.com/
  3. 3.
    Alima, L.O., El-Ansary, S., Brand, P., Haridi, S.: DKS(N, k, f ): A Family of Low Communication, Scalable and Fault-Tolerant Infrastructures for P2P Applications. In: The 3rd Int workshop CCGRID2003, Tokyo, Japan (2003)Google Scholar
  4. 4.
    Apache License, Version 2.0 [Online], http://www.apache.org/licenses/LICENSE-2.0
  5. 5.
    Arlitt, M.F., Williamson, C.L.: Internet web servers: Workload characterization and performance implications. IEEE/ACM Trans on Networking 5(5), 631–645 (1997)CrossRefGoogle Scholar
  6. 6.
    Bhattacharyya, R.: (2005), [Online] http://www.mycgiserver.com/~ranab/ftp/
  7. 7.
    Chen, Y., Katz, R., Kubiatowicz, J.: SCAN: A dynamic, scalable, and efficient content distribution network. In: Proc of Int Conf on Pervasive Computing, Zurich (2002)Google Scholar
  8. 8.
    Crovella, M.E., Taqqu, M.S., Bestavros, A.: Heavy-tailed probability distributions in the World Wide Web. In: A Pract. Guide To Heavy Tails, pp. 3–26. Chapman and Hall, Boca Raton (1998)Google Scholar
  9. 9.
    Distributed K-ary System (DKS), [Online], http://dks.sics.se/
  10. 10.
    Freedman, M.J., Freudenthal, E., Mazi‘eres, D.: Democratizing Content Publication with Coral. In: Proc of the 1st Symp on Networked Systems Design and Implementation (NSDI 2004), San Francisco, USA (2004)Google Scholar
  11. 11.
    Freedman, M., Mazi‘eres, D.: Sloppy hashing and self-organizing clusters. In: 2nd Int Peer To Peer Systems Workshop, Berkeley, USA (2003)Google Scholar
  12. 12.
    Jetty Java HTTP Servlet Server [Online], http://jetty.mortbay.org/jetty/index.html
  13. 13.
    Ghodsi, A., Alima, L.O., Haridi, S.: Symmetric Replication for Structured Peer-to-Peer Systems. In: The 3rd Int Workshop on Databases, Information Systems and Peer-to-Peer Computing, Trondheim, Norway (2005)Google Scholar
  14. 14.
    Iyer, S., Rowstron, A., Druschel, P.: Squirrel: A decentralized, peer-to-peer web cache. In: Proc of the 21st Ann ACM Symp on Principles of Distributed Computing, ACM Press, New York (2002)Google Scholar
  15. 15.
    Maymounkov, P., Mazi‘eres, D.: Kademlia: A peer-to-peer information system based on the xor metric. In: Druschel, P., Kaashoek, M.F., Rowstron, A. (eds.) IPTPS 2002. LNCS, vol. 2429, Springer, Heidelberg (2002)CrossRefGoogle Scholar
  16. 16.
    Pierre, G., van Steen, M.: Design and implementation of a user-centered content delivery network. In: Proc. 3rd Workshop on Internet Applications, San Jose, USA (2003)Google Scholar
  17. 17.
    Pierre, G., van Steen, M., Tanenbaum, A.S.: Dynamically selecting optimal distribution strategies for Web documents. IEEE Trans on Computers 51(6), 637–651 (2002)CrossRefGoogle Scholar
  18. 18.
    Ratnasamy, S., Francis, P., Handley, M., Karp, R., Schenker, S.: A scalable content-addressable network. In: Proc of the 2001 Conf on Applications, Technologies, Architectures, and Protocols for Computer Communications, San Diego, USA, pp. 161–172 (2001)Google Scholar
  19. 19.
    Rowstron, A., Druschel, P.: Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  20. 20.
    Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications. In: Conf. on Applications, Technologies, Architectures, and Protocols for Comp. Communications, pp. 149–160 (2001)Google Scholar
  21. 21.
    Zhao, B. Y., Kubiatowicz, J. D., Joseph, A. D.: Tapestry: An infrastructure for fault-tolerant wide-area location and routing. TR UCB/CSD-01-1141, UC Berkeley (2001)Google Scholar
  22. 22.
    Zhao, W., Schulzrinne, H.: DotSlash: A selfconfiguring and scalable rescue system for handling web hotspots effectively. In: Int Workshop on Web Caching and Content Distribution (WCW), Beijing, China (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jimmy Jernberg
    • 1
  • Vladimir Vlassov
    • 1
  • Ali Ghodsi
    • 1
    • 2
  • Seif Haridi
    • 1
    • 2
  1. 1.School for Information and Communication Technology (ICT)Royal Institute of Technology (KTH)StockholmSweden
  2. 2.Swedish Institute of Computer Science (SICS)KistaSweden

Personalised recommendations