Abstract
Over the last few years various scientific experiments and Grid projects have developed different catalogs for keeping track of their data files. Some projects use specialized file catalogs, others use distributed replica catalogs to reference files at different locations. Due to this diversity of catalogs, it is very hard to manage files across Grid projects, or to replace one catalog with another.
In this paper we introduce a new Grid service called the Replica Registration Service (RRS). It can be thought of as an abstraction of the concepts for registering files and their replicas. In addition to traditional single file registration operations, the RRS supports collective file registration requests and keeps persistent registration queues. This approach is of particular importance for large-scale usage where thousands of files are copied and registered. Moreover, the RRS supports a set of error directives that are triggered in case of registration failures. Our goal is to provide a single uniform interface for various file catalogs to support the registration of files across multiple Grid projects, and to make Grid clients oblivious to the specific catalog used.
Keywords
- Data Grid
- Grid Service
- Error Directive
- Lawrence Berkeley National Laboratory
- Registration Request
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Baru, C., Moore, R., Rajasekar, A., Wan, M.: The SDSC Storage Research Broker. In: CASCON 1998, Toronto, Canada, November 30 - December 3 (1998)
Baud, J.-P., Casey, J.: Evolution of LCG-2 Data Management. In: Computing in High Energy Physics, Interlaken, Switzerland (September 2004)
Chervenak, A., Deelman, E., Foster, I., Guy, L., Iamnitchi, A., Kesselman, C., Hoschek, W., Ripeanu, M., Schwartzkopf, B., Stockinger, H., Stockinger, K., Tierney, B.: Giggle: A Framework for Constructing Scalable Replica Location Services. In: Super Computing 2002, Baltimore, USA (November 2002)
Chervenak, A., Foster, I., Kesselman, C., Salisburyand, C., Tuecke, S.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications 23 (2001)
PPDG Collaboration. Physics results from the STAR experiment at RHIC benefit from production Grid data services, http://www.ppdg.net/docs/oct04/ppdg-star-oct04.pdf
Kunszt, P., et al.: EGEE gLite User’s Guide - Overview of gLite Data Management. Technical Report EGEE-TECH-570643-v1.0, CERN, Geneva, Switzerland (March 2005)
Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: File-based Replica Management. Future Generation Computer Systems 22(1) (2005)
Madduri, R., Hood, C., Allcock, W.: Reliable File Transfers in Grid Environments. In: 27th IEEE Conference on Local Computer Networks, Tampa, Florida, November 6-8 (2002)
Shoshani, A., Sim, A., Gu, J.: Storage Resource Managers: Essential Components for the Grid. In: Nabrzyski, J., Schopf, J.M., Weglarz, J. (eds.) Grid Resource Management: State of the Art and Future Trends. Kluwer Academic Publishers, Dordrecht (2003)
Shoshani, A., Sim, A., Stockinger, K.: Replica Registration Service - Functional Interface Specification 1.0. Berkeley Lab, Berkeley, California (April 2005)
Sim, A., Gu, J., Shoshani, A., Natarajan, V.: DataMover: Robust Terabyte-Scale Multi-file Replication over Wide-Area Networks. In: Scientific and Statistical Database Management, Santorini Island, Greece (June 2004)
The STAR Experiment, http://www.star.bnl.gov/
Stockinger, H., Samar, A., Allcock, B., Foster, I., Holtman, K., Tierney, B.: File and Object Replication in Data Grids. Journal of Cluster Computing 5(3) (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shoshani, A., Sim, A., Stockinger, K. (2006). RRS: Replica Registration Service for Data Grids. In: Pierson, JM. (eds) Data Management in Grids. DMG 2005. Lecture Notes in Computer Science, vol 3836. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11611950_9
Download citation
DOI: https://doi.org/10.1007/11611950_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31212-3
Online ISBN: 978-3-540-32452-2
eBook Packages: Computer ScienceComputer Science (R0)