A General Data Grid: Framework and Implementation

  • Wu Zhang
  • Jian Mei
  • Jiang Xie
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3994)


Today, data grids have become an important emerging platform for managing and processing a very large amount of data distributed across multiple grid nodes and stored in relational databases. However, there are still obstacles for potential grid users to be involved into the trend and the data grid application development is far from the data grids. While the traditional established data grid architectures are not particularly suitable for the some grid service, such as data replica services, user authentication services, and the Optimal Path selection services. Our project aims to exploit a novel architecture named General Data Grid, which integrates the metadata services, data replica services, java message services, and the Optimal Path selection on Data Grid environment. At the end of this paper, we describe the key implement on the GDGrid and present a simple example application concerning finding the optimal route. Our experiment of GDGrid shows the algorithm of the route selection (Heart-Beat algorithm) is effectively, improve the performance greatly, and afford fault-tolerance management to the great extent.


Optimal Path Data Grid Data Resource Metadata Service Open Grid Service Architecture 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Foster, I., Kesselman, C. (eds.): The Grid: Blueprint for a New Computing Infrastructure. Morgan Kanfmann, Los Altos (1988), http://www.mkp.com/books_catalog/1-55860-475-8.asp Google Scholar
  2. 2.
    Moore, R., Rajasekar, A., Wan, M.: MEMBER, IEEE: Data Grids, Digital Libraries, and Persistent Archives: An Integrated Approach to Sharing, Publishing, and Archiving Data. Proceedings of the IEEE 93(3), 578–588 (2005)CrossRefGoogle Scholar
  3. 3.
    Segal, B., Robertson, L., Gagliardi, F., Carminati, F.: Grid computing: the European Data Grid Project. In: IEEE Nuclear Science Symposium Conference Record, October 15-20, vol. 1, p. 2 (2000)Google Scholar
  4. 4.
    Deelman, E., Kesselman, C., Mehta, G., Meshkat, L.: GriPhyN and LIGO, building a virtual data Grid for gravitational wave scientists. In: Proceedings. 11th IEEE International Symposium on High Performance Distributed Computing, HPDC-11 2002, pp. 225–234 (2002)Google Scholar
  5. 5.
    Bell, W.H., Cameron, D.G., Capozza, L., Paul Millar, A., Stockinger, K., Zini, F.: Simulation of Dynamic Grid Replication Strategies in OptorSim. In: Proc. of the 3rd Int’l. IEEE workshop on Grid Computing (Grid 2002), Baltimore, USA (2002)Google Scholar
  6. 6.
    Open Grid Services Architecture – Data Access and Integration Project, http://www.ogsadai.org.uk
  7. 7.
    Xiao, N., Li, D., Fu, W., Huang, B., Lu, X.: GridDaen: A Data Grid Engine. In: Li, M., Sun, X.-H., Deng, Q.-n., Ni, J. (eds.) GCC 2003. LNCS, vol. 3032, pp. 519–528. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Map Center Home Page, http://mapcenter.in2p3.fr
  9. 9.
    Aloisio, G., Cafaro, M., Epicoco, I.: Early experiences with the GridFTP protocol using the GRB-GSIFTP library. Future Generation Computer Systems 18(18), 1053–1059 (2002), Special Issue on Grid Computing: Towards a New Computing Infrastructure, North-HollandMATHCrossRefGoogle Scholar
  10. 10.
    Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an Architecture for the distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications 23, 187–200 (2001)CrossRefGoogle Scholar
  11. 11.
    Park, S.-M., Kim, J.-H.: Chameleon: A Resource Scheduler in A Data Grid Environment*. In: Proceedings 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2003, May 12-15, pp. 258–265 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Wu Zhang
    • 1
  • Jian Mei
    • 1
  • Jiang Xie
    • 1
  1. 1.Department of Computer Science and TechnologyShanghai UniversityShanghaiChina

Personalised recommendations