Advertisement

A File Transfer Service with Client/Server, P2P and Wide Area Storage Protocols

  • Gilles Fedak
  • Haiwu He
  • Franck Cappello
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5187)

Abstract

The last years have seen the emergence of new P2P file distribution protocols such as BitTorrent as well as new Wide Area Storage based on Web Service technology. In this paper, we propose a multi-protocol file transfer service which supports client/server and P2P protocols, as well as Wide Area Storage such as Amazon S3. We describe the mechanisms used to ensure file transfer monitoring and reliability. We explain how to plug-in new or existing protocols and we give evidence of the versatility of the framework by implementing the HTTP, FTP and BitTorrent protocols and access to the Amazon S3 and IBP Wide Area Storage. Finally, we report on basic performance evaluation of our framework, both in a Grid context and on the Internet.

Keywords

 P2P CDN Wide Area Storage File transfer 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [ama]
    Amazon s3: Developer guide (March 2006)Google Scholar
  2. [And96]
    Anderson, R.: The eternity service. In: Proceedings of Pragocrypt 1996 (1996)Google Scholar
  3. [aws]
    Amazon web servicesGoogle Scholar
  4. [Ba06]
    Bolze, R., et al.: Grid5000: A large scale highly reconfigurable experimental grid testbed. International Journal on High Performance Computing and Applications (2006)Google Scholar
  5. [BBF+02]
    Bassi, A., Beck, M., Fagg, G., Moore, T., Plank, J.S., Swany, M., Wolski, R.: The Internet BackPlane Protocol: A Study in Resource Sharing. In: Second IEEE/ACM International Symposium on Cluster Computing and the Grid, Berlin, Germany (2002)Google Scholar
  6. [Coh03]
    Cohen, B.: Incentives Build Robustness in BitTorrent. In: Workshop on Economics of Peer-to-Peer Systems, Berkeley (2003)Google Scholar
  7. [FHC08]
    Fedak, G., He, H., Cappello, F.: BitDew: A Programmable Environment for Large-Scale Data Management and Distribution. Technical Report 6427, INRIA (January 2008)Google Scholar
  8. [FM06]
    Fernandess, Y., Malkhi, D.: On Collaborative Content Distribution using Multi-Message Gossip. In: Proceeding of IEEE IPDPS, Rhodes Island (2006)Google Scholar
  9. [Gar07]
    Garfinkel, S.L.: An Evaluation of Amazon’s Grid Computing Services: EC2, S3 and SQS. Technical Report TR-08-07. Harvard University Cambridge, MA (2007)Google Scholar
  10. [GR05]
    Gkantsidis, C., Rodriguez, P.: Network Coding for Large Scale Content Distribution. In: Proceedings of IEEE/INFOCOM 2005, Miami, USA (March 2005)Google Scholar
  11. [IUKB+04]
    Izal, M., Urvoy-Keller, G., Biersack, E.W., Felber, P.A., Hamra, A.A., Garces-Erice, L.: Dissecting BitTorrent: Five Months in a Torrent’s Lifetime. In: Proceedings of Passive and Active Measurements (PAM) (2004)Google Scholar
  12. [Ka00]
    Kubiatowicz, J., et al.: OceanStore: An Architecture for Global-scale Persistent Storage. In: Proceedings of ACM ASPLOS. ACM, New York (2000)Google Scholar
  13. [MM02]
    Maymounkov, P., Maziéres, D.: Kademlia: A Peer-to-peer Information System Based on the XOR Metric. In: Proceedings of the 1st International Workshop on Peer-to-Peer Systems (IPTPS 2002). MIT, Cambridge (2002)Google Scholar
  14. [POIR07]
    Palankar, M., Onibokun, A., Iamnitchi, A., Ripeanu, M.: Amazon S3 for Science Grids: a Viable Solution?. In: 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI 2007) (2007)Google Scholar
  15. [QS04]
    Qiu, D., Srikant, R.: Modeling and Performance analysis of BitTorrent-like Peer-to-Peer Networks. SIGCOMM Comput. Commun. Rev. 34(4), 367–378 (2004)CrossRefGoogle Scholar
  16. [RD01]
    Rowstron, A., Druschel, P.: Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In: IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), Heidelberg, Germany (2001)Google Scholar
  17. [SMK+01]
    Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. In: Proceedings of the ACM SIGCOMM 2001 Conference, San Diego, California (August 2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Gilles Fedak
    • 1
  • Haiwu He
    • 1
  • Franck Cappello
    • 1
  1. 1.INRIA Saclay, Grand-Large, Orsay, F-91893, LRI, Univ Paris-Sud, CNRS, Orsay, F-91405 

Personalised recommendations