Advertisement

A Data Management System for UNICORE 6

  • Tobias Schlauch
  • Anastasia Eifer
  • Thomas Soddemann
  • Andreas Schreiber
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6043)

Abstract

Data produced in scientific and industrial applications is growing exponentially but most resource middleware systems lack of appropriate support for data and metadata management. In particular easy and intuitive retrieval of data for later use is a serious problem.

In this context the paper proposes a pragmatic approach for data management of distributed data with focus on appropriate means for data organization improving data retrieval.

The paper presents the key concepts and architecture of a dedicated data management system for sharing data located on heterogeneous storage resources. The different specifics of storage systems such as data object names, data locations, and data access methods are abstracted to allow transparent data access. Moreover, the system provides means for data structuring and organization by supporting custom data models and annotation of individual metadata on data objects.

Current development status of the system is illustrated by presenting an integration with the UNICORE Rich Client which has been validated in the context of the AeroGrid project.

Keywords

UNICORE DataFinder Distributed Data Management 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Schlauch, T., Schreiber, A.: Datafinder – a scientific data management solution. In: Ensuring the Long-Term Preservation and Value Adding to Scientific and Technical Data, PV 2007, Oberpfaffenhofen, Germany (2007)Google Scholar
  2. 2.
    German Aerospace Center (DLR): AeroGrid website, http://www.aero-grid.de
  3. 3.
    Erwin, D., Rambadt, M., Streit, A., Wieder, P.: Production-quality grid environments with unicore. In: Wallom, D., Kielmann, T. (eds.) Proceedings of the Workshop on Grid Applications: From Early Adopters to Mainstream Users, Global Grid Forum, pp. 10–17 (2006)Google Scholar
  4. 4.
    Jülich Supercomputing Centre: Unicore, http://www.unicore.eu/unicore
  5. 5.
    Jülich Supercomputing Centre: Unicore wiki - extending sms, http://unicore.wiki.sourceforge.net/ExtendingSMS
  6. 6.
    globus.org: Data management: Key concepts, http://www.globus.org/toolkit/docs/4.0/data/key/
  7. 7.
    Enabling Grids for E-Science (EGEE): EGEE gLite User‘s Guide - Overview of Glite Data Management (March 2005)Google Scholar
  8. 8.
    Fuhrmann, P., Gülzow, V.: dcache, storage system for the future. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds.) Euro-Par 2006. LNCS, vol. 4128, pp. 1106–1113. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Baru, C., Moore, R., Rajasekar, A., Wan, M.: The sdsc storage resource broker. In: Proceedings of CASCON (1998)Google Scholar
  10. 10.
    Rajasekar, A., Wan, M., Moore, R., Schroeder, W.: A prototype rule-based distributed data management system. In: HPDC workshop on Next Generation Distributed Data Management (2006)Google Scholar
  11. 11.
    Schuller, B., Demuth, B., Mix, H., Rasch, K., Romberg, M., Sild, S., Maran, U., Bata, P., del Grosso, E., Casalegno, M., Piclin, N., Pintore, M., Sudholt, W., Baldridge, K.K.: Chemomentum - unicore 6 based infrastructure for complex applications in science and technology. In: Bougé, L., Forsell, M., Träff, J.L., Streit, A., Ziegler, W., Alexander, M., Childs, S. (eds.) Euro-Par Workshops 2007. LNCS, vol. 4854, pp. 82–93. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  12. 12.
    Goland, Y., Whitehead, E., Faizi, A., Carter, S.R., Jensen, D.: Http extensions for distributed authoring - webdav (February 1999), http://www.ietf.org/rfc/rfc2518.txt
  13. 13.
    German Aerospace Center (DLR): DataFinder, http://datafinder.sourceforge.net
  14. 14.
    Fraunhofer Institute for Algorithms and Scientific Computing (SCAI): Unicore-datafinder project, http://tor-2.scai.fraunhofer.de/gf/project/unicoredata/
  15. 15.
    The Apache Software Foundation: Apache axis2/java - next generation web services, http://ws.apache.org/axis2/
  16. 16.
    Christensen, E., Curbera, F., Meredith, G., Weerawarana, S.: Web services description language (WSDL) 1.1, http://www.w3.org/TR/wsdl
  17. 17.
    Clemm, G., Reschke, J., Sedlar, E., Whitehead, J.: Web distributed authoring and versioning (webdav) - access control protocol (May 2004), http://www.ietf.org/rfc/rfc3744.txt
  18. 18.
    Berners-Lee, T., Fielding, R., Masinter, L.: Uniform resource identifier (uri): Generic syntax (January 2005), http://www.ietf.org/rfc/rfc3986.txt

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Tobias Schlauch
    • 1
  • Anastasia Eifer
    • 1
  • Thomas Soddemann
    • 2
  • Andreas Schreiber
    • 1
  1. 1.Simulation and Software Technology, German Aerospace CenterCologneGermany
  2. 2.Fraunhofer Institute for Algorithms and Scientific Computing (SCAI)Sankt AugustinGermany

Personalised recommendations