Advertisement

GDS: An Architecture Proposal for a Grid Data-Sharing Service

  • Gabriel Antoniu
  • Marin Bertier
  • Luc Bougé
  • Eddy Caron
  • Frédéric Desprez
  • Mathieu Jan
  • Sébastien Monnet
  • Pierre Sens
Chapter

Abstract

Grid computing has recently emerged as a response to the growing demand for resources (processing power, storage, etc.) exhibited by scientific applications. We address the challenge of sharing large amounts of data on such infrastructures, typically consisting of a federation of node clusters. We claim that storing, accessing, updating and sharing such data should be considered by applications as an external service. We propose an architecture for such a service, whose goal is to provide transparent access to mutable data, while enhancing data persistence and consistency despite node disconnections or failures. Our approach leverages on weaving together previous results in the areas of distributed shared memory systems, peer-to-peer systems, and fault-tolerant systems.

Keywords

data sharing transparent access mutable data peer-to-peer systems fault tolerance consistency protocols JXTA DIET 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    William Allcock, Joseph Bester, John Bresnahan, Ann Chervenak, Ian Foster, Carl Kesselman, Sam Meder, Veronika Nefedova, Darcy Quesnel, and Steven Tuecke. Data management and transfer in high-performance computational grid environments. Parallel Computing, 28(5):749–771, 2002.CrossRefGoogle Scholar
  2. [2]
    Gabriel Antoniu, Luc Bougé, and Mathieu Jan. JuxMem: Weaving together the P2P and DSM paradigms to enable a Grid Data-sharing Service. Kluwer Journal of Super-computing, 2005. To appear. Preliminary electronic version available at URL http://www.inria.fr/rrrt/rr-5082.html.Google Scholar
  3. [3]
    Gabriel Antoniu, Jean-François Deverge, and Sébastien Monnet. Building fault-tolerant consistency protocols for an adaptive grid data-sharing service. In Proceedings of the ACM Workshop on Adaptive Grid Middleware (AGridM’ 04), Antibes Juan-les-Pins, France, September 2004. Held in conjunction with PACT 2004. To appear in Concurrency and Computation: Practice and Experience, special issue on Adaptive Grid Middleware.Google Scholar
  4. [4]
    Dorian Arnold, Sudesh Agrawal, Susan Blackford, Jack Dongarra, Micelle Miller, Kiran Sagi, Zhiao Shi, and Sthish Vadhiyar. Users’ guide to NetSolve V1.4. Technical Report CS-01-467, Computer Science Dept., Univ. Tennessee, Knoxville, TN, July 2001.Google Scholar
  5. [5]
    Alessandro Bassi, Micah Beck, Graham Fagg, Terry Moore, James Plank, Martin Swany, and Rich Wolski. The Internet Backplane Protocol: A study in resource sharing. In Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid’ 02), pages 194–201, Berlin, Germany, May 2002. IEEE.Google Scholar
  6. [6]
    Brian N. Bershad, Mattew J. Zekauskas, and Wayne A. Sawdon. The Midway distributed shared memory system. In Proceedings of the 38th IEEE International Computer Conference (COMPCON Spring’ 93), pages 528–537, Los Alamitos, CA, February 1993.Google Scholar
  7. [7]
    Marin Bertier, Olivier Marin, and Pierre Sens. Performance analysis of hierarchical failure detector. In Proceedings of the International Conference on Dependable Systems and Networks (DSN’ 03), pages 635–644. IEEE Society Press, June 2003.Google Scholar
  8. [8]
    Eddy Caron, Frédéric Desprez, Frédéric Lombard, Jean-Marc Nicod, Martin Quinson, and Frédéric Suter. A scalable approach to network enabled servers. In B. Monien and R. Feldmann, editors, 8th International Euro-Par Conference, volume 2400 of Lecture Notes in Computer Science, pages 907–910. Springer, August 2002.Google Scholar
  9. [9]
    Tushar Deepak Chandra and Sam Toueg. Unreliable failure detectors for reliable distributed systems. Journal of the ACM, 43(2):225–267, March 1996.zbMATHMathSciNetCrossRefGoogle Scholar
  10. [10]
    Gregory V. Chockler, Idit Keidar, and Roman Vitenberg. Group communication specifications: a comprehensive study. ACM Computing Surveys, 33(4):427–469, December 2001.CrossRefGoogle Scholar
  11. [11]
    Olivier Coulaud, Michael Dussère, and Aurélien Esnard. Toward a computational steering environment based on CORBA. In G.R. Joubert, W.E. Nagel, F.J. Peters, and W.V. Walter, editors, Parallel Computing: Software Technology, Algorithms, Architectures and Applications, volume 13 of Advances in Parallel Computing, pages 151–158. Elsevier, 2004.Google Scholar
  12. [12]
    Michel Daydé, Luc Giraud, Montse Hernandez, Jean-Yves L’Excellent, Chiara Puglisi, and Marc Pantel. An overview of the GRID-TLSE project. In Poster Session of the 6th international meeting on high performance computing for computational science (VEC-PAR’ 04), pages 851–856, Valencia, Espagne, June 2004.Google Scholar
  13. [13]
    Alexandre Denis, Christian Pérez, and Thierry Priol. PadicoTM: An open integration framework for communication middleware and runtimes. Future Generation Computer Systems, 19(4):575–585, May 2003.CrossRefGoogle Scholar
  14. [14]
    Frédéric Desprez, Martin Quinson, and Frédéric Suter. Dynamic performance forecasting for network enabled servers in a metacomputing environment. In Int. Conf. on Parallel and Distributed Processing Techniques and Applications (PDPTA’ 2001). CSREA Press, June 2001.Google Scholar
  15. [15]
    Bruno Del Fabbro, David Laiymani, Jean-Marc Nicod, and Laurent Philippe. Data management in grid applications providers. In Proceedings of the 1st IEEE Int. Conf. on Distributed Frameworks for Multimedia Applications (DFMA’ 05), February 2005. To appear.Google Scholar
  16. [16]
    Gilles Fedak, Cécile Germain, Vincent Neri, and Franck Cappello. XtremWeb: A generic global computing system. In Proceedings of the IEEE Workshop on Global Computing on Personal Devices (GCPD’ 01), pages 582–587, Brisbane, Australia, May 2001.Google Scholar
  17. [17]
    Ian Foster and Carl Kesselman. Globus: A metacomputing infrastructure toolkit. The Int. Journal of Supercomputing Applications and High-Performance Computing, 11(2): 115–128, 1997.Google Scholar
  18. [18]
    Liviu Iftode, Jaswinder Pal Singh, and Kai Li. Scope consistency: A bridge between release consistency and entry consistency. In Proceedings of the 8th ACM Annual Symposium on Parallel Algorithms and Architectures (SPAA’ 96), pages 277–287, Padova, Italy, June 1996.Google Scholar
  19. [19]
    Tevfik Kosar and Miron Livny. Stork: Making data placement a first-class citizen in the grid. In Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS’ 04), pages 342–349, Tokyo, Japan, March 2004.Google Scholar
  20. [20]
    Kai Li and Paul Hudak. Memory coherence in shared virtual memory systems. ACM Transactions on Computer Systems, 7(4):321–359, November 1989.CrossRefGoogle Scholar
  21. [21]
    R.W. Moore, A. Rajasekar, and M. Wan. Data grids, digital libraries, and persistent archives: an integrated approach to sharing, publishing, and archiving data. Proceedings of the IEEE, 93(3):578–588, March 2005.CrossRefGoogle Scholar
  22. [22]
    Hidemoto Nakada, Mitsuhisa Sato, and Satoshi Sekiguchi. Design and implementations of Ninf: towards a global computing infrastructure. Future Generation Computing Systems, Metacomputing Issue, 15(5–6):649–658, 1999.CrossRefGoogle Scholar
  23. [23]
    Jelica Protić, Milo Tomasević, and Veljko Milutinović. Distributed Shared Memory: Concepts and Systems. IEEE, August 1997.Google Scholar
  24. [24]
    Keith Seymour, Craig Lee, Frédéric Desprez, Hidemoto Nakada, and Yoshio Tanaka. The end-user and middleware APIs for GridRPC. In Proc. of the Work. on Grid App. Progr. Interfaces (GAPI’ 04), September 2004. Held in conjunction with GGF 12.Google Scholar
  25. [25]
    Keith Seymour, Hidemoto Nakada, Satoshi Matsuoka, Jack Dongarra, Craig Lee, and Henri Casanova. Overview of GridRPC: A remote procedure call API for grid computing. In Manish Parashar, editor, Proceedings of the 3rd International Workshop on Grid Computing (GRID’ 02), volume 2536 of Lecture Notes in Computer Science, pages 274–278, Baltimore, MD, USA, November 2002. Springer.Google Scholar
  26. [26]
    Yuanyuan Zhou, Liviu Iftode, and Kai Li. Performance evaluation of two home-based lazy release consistency protocols for shared memory virtual memory systems. In Proceedings of the 2nd Symposium on Operating Systems Design and Implementation (OSDI’ 96), pages 75–88, Seattle, WA, October 1996.Google Scholar
  27. [27]
    The JXTA project. http://www.jxta.org/, 2001.Google Scholar
  28. [28]
    The GDS project: a grid data service. http://www.irisa.fr/GDS/.Google Scholar

Copyright information

© Springer Science+Business Media, Inc. 2006

Authors and Affiliations

  • Gabriel Antoniu
    • 1
  • Marin Bertier
    • 2
  • Luc Bougé
    • 1
  • Eddy Caron
    • 3
  • Frédéric Desprez
    • 3
  • Mathieu Jan
    • 1
  • Sébastien Monnet
    • 1
  • Pierre Sens
    • 4
  1. 1.IRISA/INRIAUniversity of Rennes 1 — ENS Cachan-BretagneRennesFrance
  2. 2.LRI/INRIA Grand LargeUniversity Paris Sud, Université de Paris SudOrsayFrance
  3. 3.LIP/INRIAENS LyonLyonFrance
  4. 4.INRIA/LIP6-MSIParisFrance

Personalised recommendations