Abstract
Due to high latency of the Internet, it becomes a challenge to access large and widely distributed data quickly and efficiently on data grids. Replication is a process to address this issue, by storing data in different locations to reduce access latency and improve data locality. However, because of the limited storage capacity, a good replica replacement algorithm is needed to improve the efficiency of the access to the replicas. In this paper, a VO-based two-stage replica replacement algorithm is proposed, which provides a good solution to deal with the relations between value and cost. In a VO, replica value is determined according to popularity to make sure which replica will be replaced, and the bandwidth is predicted to make replacement cost as low as possible. Experiments show that compared with traditional replacement algorithms our new replica replacement algorithm shows better performance and efficiency of the data access on Data Grids.
Chapter PDF
Similar content being viewed by others
Keywords
References
Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications 23, 187–200 (2001)
Guy, L., Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: Replica Management in Data Grids. Technical report, GGF5 Working Draft (July 1, 2002)
Cameron, D., Casey, J., Guy, L., Kunszt, P., Lemaitre, S., McCance, G., Stockinger, H., Stockinger, K.: Replica Management in the European DataGrid Project. Journal of Grid Computing 2, 341–351 (2005)
Bell, W.H., Cameron, D.G., Capozza, L., Millar, A.P., Stockinger, K., Zini, F.: OptorSim - A Grid Simulator for Studying Dynamic Data Replication Strategies. International Journal of High Performance Computing Applications 17(4), 403–416 (2003)
Ranganathan, K., Foster, I.: Identifying Dynamic Replication Strategies for a High Performance Data Grid. In: Lee, C.A. (ed.) GRID 2001. LNCS, vol. 2242, Springer, Heidelberg (2001)
Carman, M., Zini, F., Serafini, L., Stockinger, K.: Towards an Economy-Based Optimization of File Access and Replication on a Data Grid. In: CCGRID 2002. Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, May 2002, ACM Press, New York (2002)
Teng, M., Junzhou, L.: A Prediction-based and Cost-based Replica Replacement Algorithm Research and Simulation. In: Proceedings of the 19th International Conference on Advanced Information Networking and Applications, vol. 1, pp. 935–940 (2005)
Lamehamedi, H., Zujun Shentu Szymanski, B., Deelman, E.: Simulation of Dynamic Data Replication Strategies in Data Grids. In: Parallel and Distributed Processing Symposium, 2003. Proceedings. International, p. 100.2 (2003)
Shen, X., Choudhary, A.: A Multi-Storage Resource Architecture and I/O, Performance Prediction for Scientific Computing. In: Proceedings of 9th IEEE Symposium on HPDC, IEEE Computer Society Press, Los Alamitos (2000)
Wolski, R., Spring, N.T., Hayes, J.: The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing. The Journal of Future Generaton Computer Systems, 757–768 (1999)
Capozza, L., Stockinger, K., Zini, F.: Preliminary evaluation of revenue prediction functions for economically effective file replication. In: DataGrid-02-TED-020724 (July 24, 2002)
Ludeman, L.C.: Random Processes: Filtering, Estimation, and Detection, p. 608. John Wiley & Sons, New Jersey (2003)
Junzhou, L., Aibo, S., Ye, Z., Xiaopeng, W., Teng, M., Zhiang, W., Yaobin, X., Liang, G.: Grid Supporting Platform for AMS Data Processing. In: Pan, Y., Chen, D.-x., Guo, M., Cao, J., Dongarra, J.J. (eds.) ISPA 2005. LNCS, vol. 3758, pp. 276–285. Springer, Heidelberg (2005)
Fisher, P., Klimentov, A., Mujunen, A., Ritakari, J.: AMS Ground Support Computers for ISS mission. AMS Note 2002- 03-01 (March 12, 2002)
Stockinger, H., Hanushevsky, A.: Http Redirection for Replica Catalogue Lookups in Data Grids. In: Proceedings of the 2002 ACM symposium on Applied computing, pp. 882–889 (2002)
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of High Performance Computing Applications 15(3), 200–222 (2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 IFIP International Federation for Information Processing
About this paper
Cite this paper
Tian, T., Luo, J. (2007). A VO-Based Two-Stage Replica Replacement Algorithm. In: Li, K., Jesshope, C., Jin, H., Gaudiot, JL. (eds) Network and Parallel Computing. NPC 2007. Lecture Notes in Computer Science, vol 4672. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74784-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-74784-0_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74783-3
Online ISBN: 978-3-540-74784-0
eBook Packages: Computer ScienceComputer Science (R0)