Advertisement

dCache, Storage System for the Future

  • Patrick Fuhrmann
  • Volker Gülzow
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4128)

Abstract

In 2007, the most challenging high energy physics experiment ever, the Large Hardon Collider(LHC), at CERN, will produce a sustained stream of data in the order of 300MB/sec, equivalent to a stack of CDs as high as the Eiffel Tower once per week. This data is, while produced, distributed and persistently stored at several dozens of sites around the world, building the LHC data grid. The destination sites are expected to provide the necessary middle-ware, so called Storage Elements, offering standard protocols to receive the data and to store it at the site specific Storage Systems. A major player in the set of Storage Elements is the dCache/SRM system. dCache/SRM has proven to be capable of managing the storage and exchange of several hundreds of terabytes of data, transparently distributed among dozens of disk storage nodes. One of the key design features of the dCache is that although the location and multiplicity of the data is autonomously determined by the system, based on configuration, cpu load and disk space, the name space is uniquely represented within a single file system tree. The system has shown to significantly improve the efficiency of connected tape storage systems, by caching, ’gather & flush’ and scheduled staging techniques. Furthermore, it optimizes the throughput to and from data clients as well as smoothing the load of the connected disk storage nodes by dynamically replicating datasets on the detection of load hot spots. The system is tolerant against failures of its data servers which enables administrators to go for commodity disk storage components. Access to the data is provided by various standard protocols. Furthermore the software is coming with an implementation of the Storage Resource Manager protocol (SRM), which is evolving to an open standard for grid middleware to communicate with site specific storage fabrics.

Keywords

Storage System Storage Manager Storage Element Rutherford Appleton Laboratory Replica Manager 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
    Rutherford Appleton Laboratory: http://www.cclrc.ac.uk/
  5. 5.
    Large Hadron Collider: http://lhc.web.cern.ch/lhc/
  6. 6.
    LHC Computing Grid : http://lcg.web.cern.ch/LCG/
  7. 7.
  8. 8.
    High Performance Storage System: http://www.hpss-collaboration.org/hpss/
  9. 9.
  10. 10.
  11. 11.
    CASTOR Storage Manager: http://castor.web.cern.ch/castor/
  12. 12.
    dCache Documentation: http://www.dcache.org
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
    Fermi CDF Experiment : http://www-cdf.fnal.gov
  18. 18.
  19. 19.
    Cern CMS Experiment : http://cmsinfo.cern.ch
  20. 20.
  21. 21.
    D-Grid, The German e-science program : http://www.d-grid.de
  22. 22.
    Fuhrmann, P., et al.: dCache, the Upgrade. In: CHEP 2006, Mumbai, India (Spring 2006)Google Scholar
  23. 23.
    Field, L., et al.: Grid Deployment Experiences: The path to a production quality LDAP based grid information system. In: CHEP 2006, Mumbai, India (Spring 2006)Google Scholar
  24. 24.
    Mkrtchyan, T., et al.: Chimera. In: CHEP 2006, Mumbai, India (Spring 2006)Google Scholar
  25. 25.
    Schley, L., Radicke, M., et al.: A Computational and Data Scheduling Architecture for HEP Application. In: CHEP 2006, Mumbai, India (Spring 2006)Google Scholar
  26. 26.
    Kulyavtsev, A., et al.: Resilient dCache: Replicating Files for Integrity and Availability. In: CHEP 2006, Mumbai, India (Spring 2006)Google Scholar
  27. 27.
    Perelmutov, T., et al.: Enabling Grid features in dCache. In: CHEP 2006, Mumbai, India (Spring 2006)Google Scholar
  28. 28.
    Rana, A.S., et al.: gPLAZMA: Introducing RBAC Security in dCache . In: CHEP 2006, Mumbai, India (Spring 2006)Google Scholar
  29. 29.
    Fuhrmann, P., et al.: The TSM in the LHC Grid World. In: TSM Symposium, Oxford, UK (September 2005)Google Scholar
  30. 30.
    Fuhrmann, P.: dCache, the commodity cache. Spring 2004. In: Twelfth NASA Goddard and Twenty First IEEE Conference on Mass Storage Systems and Technologies, Washington DC, USA (2004)Google Scholar
  31. 31.
    Perelmutov, T.: Storage Resource Managers by CMS,LCG. Spring 2004. In: Twelfth NASA Goddard and Twenty First IEEE Conference on Mass Storage Systems and Technologies. Washington DC (2004)Google Scholar
  32. 32.
    Ernst, M., et al.: Managed Data Storage and Data Access Services for Data Grids. In: CHEP 2004, Interlaken, Switzerland (September 2004)Google Scholar
  33. 33.
    Mkrtchyan, T., et al.: Chimera, the commodity namespace service. In: CHEP 2004, Interlaken, Switzerland (September 2004)Google Scholar
  34. 34.
    Fuhrmann, P., et al.: dCache, LCG SE and enhanced use cases. In: CHEP 2004, Interlaken, Switzerland (September 2004)Google Scholar
  35. 35.
    Ernst, M., Fuhrmann, P., et al.: dCache. In: CHEP03, San Diego, USA (March 2003)Google Scholar
  36. 36.
    Fuhrmann, P., et al.: dCache. In: CHEP 2001, Bejing, China (September 2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Patrick Fuhrmann
    • 1
  • Volker Gülzow
    • 1
  1. 1.Deutsches Elektronen SynchrotronHamburg

Personalised recommendations