Advertisement

Design and Evaluation of Network-Bandwidth-Based Parallel Replication Algorithm

Conference paper
  • 547 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3758)

Abstract

Data replication can be used to reduce bandwidth consumption and access latency in the distributed system where users require remote access to large data objects. In this paper, according to the intrinsic characteristic of distributed storage system, the parallel replication algorithm NBPRA (Network-Bandwidth-based Parallel Replication Algorithm) is proposed. In the NBPRA, according to the network state, several replicas of a data object are selected, which are of the least access cost; then the different parts of the data object are transferred from these replicas, and they are used to make a new replica. The results of performance evaluation show that the NBPRA can utilize the network bandwidth efficiently, provide high data replication efficiency and substantially better access efficiency, and the improvement of system performance is related to the number of different data objects accessed by jobs.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Adya, A., Bolosky, W., Castro, M., Cermak, G., Chaiken, R., Douceur, J., Howell, J., Lorch, J., Theimer, M., Wattenhofer, R.: FARSITE: Federated available and reliable storage for incompletely trusted environments. In: 5th Symp on Operating Systems Design and Impl. (December 2002)Google Scholar
  2. 2.
    Chen, Y., Edler, J., Goldberg, A., Gottlieb, A., Sobti, S., Yianilos, P.: A prototype implementation of archival intermemory. In: Proceedings of the 4th ACM Conference on Digital libraries, Berkeley, CA, August 1999, pp. 28–37 (1999)Google Scholar
  3. 3.
    Clark, I., Sandberg, O., Wiley, B., Hong, T.: Freenet: A distributed anonymous information storage and retrieval system. In: Proc. of the Workshop on Design Issues in Anonymity and Unobservability, Berkeley, CA, July 2000, pp. 311–320 (2000)Google Scholar
  4. 4.
    Dabek, F., Kaashoek, M.F., Karger, D., Morris, R., Stoica, I.: Wide-area cooperative storage with CFS. In: Proc. of ACM SOSP (October 2001)Google Scholar
  5. 5.
    Druschel, P., Rowstron, A.: Storage management and caching in PAST, a largescale, persistent peer-to-peer storage utility. In: Proc. of ACM SOSP (2001)Google Scholar
  6. 6.
    Kubiatowicz, J., et al.: Oceanstore: An architecture for global-scale persistent storage. In: Proc. of ASPLOS, November 2000. ACM, New York (2000)Google Scholar
  7. 7.
    Lamehamedi, H., Szymanski, B., Shentu, Z., Deelman, E.: Data Replication Strategies in Grid Environments. In: Proc. Of the Fifth International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002 (2002)Google Scholar
  8. 8.
    Stockinger, H., Hanushevsky, A.: HTTP Redirection for Replica Catalogue Lookups in Data Grids. In: ACM Symposium on Applied Computing, SAC 2002 (2002)Google Scholar
  9. 9.
    Carman, M., Zini, F., Serafini, L., Stockinger, K.: Towards an Economy-Based Optimisation of File Access and Replication on a Data Grid. In: Workshop on Agent based Cluster and Grid Computing at Int. Symposium on Cluster Computing and the Grid (CCGrid 2002), Berlin, Germany, May 2002. IEEE-CS Press, Los Alamitos (2002)Google Scholar
  10. 10.
    WP2 Optimisation Team. OptorSim - A Replica Optimiser Simulation, http://cern.ch/edg-wp2/optimization/optorsim.html/
  11. 11.
    Bell, W.H., Cameron, D.G., Capozza, L., Millar, P., Stockinger, K., Zini, F.: Optorsim - a grid simulator for studying dynamic data replication strategies. International Journal of High Performance Computing Applications 17(4) (2003)Google Scholar
  12. 12.
    Bell, W.H., Cameron, D.G., Capozza, L., Millar, P., Stockinger, K., Zini, F.: Design of a Replica Optimisation Framework. TechnicalReport DataGrid-02-TED- 021215, CERN, Geneva, Switzerland (December 2002)Google Scholar
  13. 13.
    Bell, W.H., Cameron, D.G., Carvajal-Schiaffino, R., Millar, A.P., Stockinger, K., Zini, F.: Evaluation of an Economy-Based File Replication Strategy for a Data Grid. In: Proceedings of 3nd IEEE Int. Symposium on Cluster Computing and the Grid, CCGrid 2003 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  1. 1.National Laboratory for Parallel and Distributed Processing, Institute of ComputerNational University of Defense TechnologyChangshaChina

Personalised recommendations