Advertisement

A Transparent Grid Filesystem

  • Brian Coghlan
  • Geoff Quigley
  • Soha Maad
  • Gabriele Pierantoni
  • John Ryan
  • Eamonn Kenny
  • David O’Callaghan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4699)

Abstract

Existing data management solutions fail to adequately support data management needs at the inter-grid (interoperability) level. We describe a possible solution, a transparent grid filesystem, and consider in detail a challenging use case.

Keywords

Large Hadron Collider Local Copy Atomic Operation Grid Middlewares Virtual Database 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Chervenak, A.L., Palavalli, N., Bharathi, S., Kesselman, C., Schwartzkopf, R.: Performance and scalability of a replica location service. In: Proceedings of the International IEEE Symposium on High Performance Distributed Computing (HPDC-13), IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
  2. 2.
    Baud, J.P., Casey, J., Lemaitre, S., Nicholson, C.: Performance analysis of a file catalog for the LHC Computing Grid. In: Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, pp. 91–99. IEEE Computer Society Press, Los Alamitos (2005)CrossRefGoogle Scholar
  3. 3.
    Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an architecture for the distributed management and analysis of large scientific datasets (based on conference publication from proceedings of netstore conference 1999). Journal of Network and Computer Applications 23, 187–200 (2001)CrossRefGoogle Scholar
  4. 4.
    Globus Alliance: GT 4.0 Reliable File Transfer (RFT) service (2006), http://www.globus.org/toolkit/docs/4.0/data/rft/
  5. 5.
    EGRID: ELFI file system (2006), http://www.egrid.it/sw/elfi/index_html
  6. 6.
    Tatebe, O., Soda, N., Morita, Y., Matsuoka, S., Sekiguchi, S.: Gfarm v2: A grid file system that supports high-performance distributed and parallel data computing. In: Proceedings of the 2004 Computing in High Energy and Nuclear Physics (CHEP 2004), Interlaken, Switzerland (2004)Google Scholar
  7. 7.
    McNab, A.: SlashGrid – a framework for grid-aware filesystems. In: Storage Element Workshop, CERN (2002)Google Scholar
  8. 8.
    Pereira, M., Tatebe, O., Luan, L., Anderson, T., Xu, J.: Resource namespace service specification (2005)Google Scholar
  9. 9.
    Global Grid Forum: The GGF Grid File System architecture workbook, version 0.54 (2005)Google Scholar
  10. 10.
    Reed, D.: Grids, the TeraGrid and beyond. Computer 36(1), 62–68 (2003)CrossRefGoogle Scholar
  11. 11.
    DEISA: Distributed European Infrastructure for Supercomputing Applications (2004), http://www.deisa.org
  12. 12.
    Morrison, J.P., Kennedy, J.J., Power, D.A.: WebCom: A web based volunteer computer. The Journal of Supercomputing 18, 47–61 (2001)zbMATHCrossRefGoogle Scholar
  13. 13.
    Morrison, J.P., Power, D.A., Kennedy, J.J.: An evolution of the WebCom metacomputer. J. Math. Model. Algorithms 2, 263–276 (2003)zbMATHCrossRefGoogle Scholar
  14. 14.
    CERN: The Large Hadron Collider (LHC) Computing Grid Project for high energy physics data analysis (2003), http://lcg.web.cern.ch/LCG/
  15. 15.
    Maad, S., Coghlan, B., Quigley, G., Ryan, J., Kenny, E., Callaghan, D.O.: Towards a complete grid filesystem functionality. Future Generation Computer Systems, Special Issue on Data Analysis, Access and Management on Grids (2006)Google Scholar
  16. 16.
    Gooch, R.: Overview of the virtual file system. Linux Documentation project (1999), http://www.atnf.csiro.au/~rgooch/linux/docs/vfs.txt
  17. 17.
    McNab, A.: The GridSite web/grid security system. Software: Practice and Experience 35(9), 827–834 (2005)CrossRefGoogle Scholar
  18. 18.
    Fielding, R.T., Kaiser, G.: The Apache HTTP server project. IEEE Internet Computing 1(4), 88–90 (1997)CrossRefGoogle Scholar
  19. 19.
    McNab, A.: Grid-based access control and user management for Unix environments, filesystems, web sites and virtual organisations. In: Proceedings of Computing in High Energy Physics, La Jolla, CA (2003)Google Scholar
  20. 20.
    Fisher, S.: Relational model for information and monitoring (2001)Google Scholar
  21. 21.
    Coghlan, B., Djaoui, A., Fisher, S., Magowan, J., Oevers, M.: Time, information services and the grid. In: Read, B. (ed.) Advances in Databases. LNCS, vol. 2097, Springer, Heidelberg (2001)Google Scholar
  22. 22.
    Morrison, J.P., Coghlan, B., Shearer, A., Foley, S., Power, D., Perrot, R.: WebCom-G: A candidate middleware for Grid-Ireland. High Performance Computing Applications and Parallel Processing  (2005)Google Scholar
  23. 23.
    Foster, I., Kesselman, C.: Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications 11(2), 115–128 (1997)CrossRefGoogle Scholar
  24. 24.
    Foster, I.: Globus toolkit version 4: Software for service-oriented systems. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 2–13. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  25. 25.
    Morrison, J., Power, D., Kennedy, J.: Load balancing and fault tolerance in a condensed graphs based metacomputer. The Journal of Internet Technologies, Special Issue on Web based Programming 3(4), 221–234 (2002)Google Scholar
  26. 26.
    Thain, D., Tannenbaum, T., Livny, M.: Condor and the grid. In: Grid Computing: Making The Global Infrastructure a Reality (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Brian Coghlan
    • 1
  • Geoff Quigley
    • 1
  • Soha Maad
    • 1
  • Gabriele Pierantoni
    • 1
  • John Ryan
    • 1
  • Eamonn Kenny
    • 1
  • David O’Callaghan
    • 1
  1. 1.Trinity College Dublin, Computer Science Department, Rm-005, CALab1, INS building, TCD, Dublin 2Ireland

Personalised recommendations