Advertisement

Clusterix Data Management System (CDMS) — Architecture and use Cases

  • Konrad Karczewski
  • Lukasz Kuczynski
Conference paper

Abstract

Nowadays grid applications process large volumes of data. This creates the need for an effective data-management solutions. For the ClusteriX project the CDMS (ClusteriX Data Management System) is being developed. Analysis of user requirements and existing implementations of a Data Management System have been the foundations for its creation. Special attention has been paid to make the system user-friendly and efficient.

Taking into account grid specific networking conditions, for example different bandwidth, current load and network technologies, between geographically distant sites, CDMS tries to optimize data throughput via replication and replica selection techniques. Another key feature to be considered during grid service implementation is fault-tolerance. In the CDMS modular design and distributed operation model assures single point of failure elimination. In particular multiple instances of Data Broker are running simultaneously and their coherence is assured by a synchronization subsystem.

Keywords

data management data safety replication fault-tolerance GRMS 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Allcock, B., et al.: Data Management and Transfer in High Performance Computational Grid Environments. Parallel Computing Journal 28,5 (2002) 749–771CrossRefGoogle Scholar
  2. [2]
    Bruin, R.P., Dove, M.T., Calleja, M., Tucker. M.G.: Building and Managing the eMinerals Clusters: A Case Study in Grid-Enabled Cluster Operation. Computing in Science & Engineering 7,6 (2005) 30–37CrossRefGoogle Scholar
  3. [3]
    ClusteriX Project Home Page, http://clusterix.pcz.plGoogle Scholar
  4. [4]
    gSOAP Project Home Page, http://www.cs.fsu.edu/engelen/soap.htmlGoogle Scholar
  5. [5]
    GLOBUS Toolkit Homepage, http://www.globus.org/toolkitGoogle Scholar
  6. [6]
    GridSphere Project Home Page, http://gridsphere.orgGoogle Scholar
  7. [7]
    http://www.man.poznan.pl/coe/documents/Data_Management_WP.pdfGoogle Scholar
  8. [8]
    Karczewski, K., Kuczynski, L., Wyrzykowski, R.: Secure Data Transfer and Replication Mechanisms in Grid Environments. Proc. Cracow Grid Workshop-CGW’03, Cracow, 2003, 190–196Google Scholar
  9. [9]
    Karczewski, K., Kuczynski, L., Wyrzykowski, R.: CDMS-ClusteriX Data Management System. Proc. Cracow Grid Workshop-CGW’04, Cracow, 2004, 241–247Google Scholar
  10. [10]
    Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: Advanced Replica Management with Reptor. Lect. Notes in Comp. Sci. 3019 (2004) 848–855Google Scholar
  11. [11]
    SDSC Storage Resource Broker, http://www.sdsc.edu/srb/Google Scholar
  12. [12]
    Slota, R., Skital, L, Nikolow, D., Kitowski, J.: Algorithms for Automatic Data Replication in Grid Environment (this volume)Google Scholar
  13. [13]
    Valentin, O., Lombard, P., Lebre, A., Guinet, Ch., Denneulin, Y.: Distributed File System for Clusters and Grids. Lect. Notes in Comp. Sci. 3019 (2004) 1099–1104Google Scholar
  14. [14]
    Wyrzykowski, R., Meyer, N., Stroinski, M.: Concept and Implementation of ClusteriX: National Cluster of Linux Systems. Proc. LCI Int.Conf. on Linux Clusters: The HPC Revolution 2005, Chapel-Hill, NC, April 2005Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • Konrad Karczewski
    • 1
  • Lukasz Kuczynski
    • 1
  1. 1.Institute of Computer and Information SciencesCzestochowa University of TechnologyCzestochowa

Personalised recommendations