Abstract
Existing data management solutions fail to adequately support data management needs at the inter-grid (interoperability) level. We describe a possible solution, a transparent grid filesystem, and consider in detail a challenging use case.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chervenak, A.L., Palavalli, N., Bharathi, S., Kesselman, C., Schwartzkopf, R.: Performance and scalability of a replica location service. In: Proceedings of the International IEEE Symposium on High Performance Distributed Computing (HPDC-13), IEEE Computer Society Press, Los Alamitos (2004)
Baud, J.P., Casey, J., Lemaitre, S., Nicholson, C.: Performance analysis of a file catalog for the LHC Computing Grid. In: Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, pp. 91–99. IEEE Computer Society Press, Los Alamitos (2005)
Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an architecture for the distributed management and analysis of large scientific datasets (based on conference publication from proceedings of netstore conference 1999). Journal of Network and Computer Applications 23, 187–200 (2001)
Globus Alliance: GT 4.0 Reliable File Transfer (RFT) service (2006), http://www.globus.org/toolkit/docs/4.0/data/rft/
EGRID: ELFI file system (2006), http://www.egrid.it/sw/elfi/index_html
Tatebe, O., Soda, N., Morita, Y., Matsuoka, S., Sekiguchi, S.: Gfarm v2: A grid file system that supports high-performance distributed and parallel data computing. In: Proceedings of the 2004 Computing in High Energy and Nuclear Physics (CHEP 2004), Interlaken, Switzerland (2004)
McNab, A.: SlashGrid – a framework for grid-aware filesystems. In: Storage Element Workshop, CERN (2002)
Pereira, M., Tatebe, O., Luan, L., Anderson, T., Xu, J.: Resource namespace service specification (2005)
Global Grid Forum: The GGF Grid File System architecture workbook, version 0.54 (2005)
Reed, D.: Grids, the TeraGrid and beyond. Computer 36(1), 62–68 (2003)
DEISA: Distributed European Infrastructure for Supercomputing Applications (2004), http://www.deisa.org
Morrison, J.P., Kennedy, J.J., Power, D.A.: WebCom: A web based volunteer computer. The Journal of Supercomputing 18, 47–61 (2001)
Morrison, J.P., Power, D.A., Kennedy, J.J.: An evolution of the WebCom metacomputer. J. Math. Model. Algorithms 2, 263–276 (2003)
CERN: The Large Hadron Collider (LHC) Computing Grid Project for high energy physics data analysis (2003), http://lcg.web.cern.ch/LCG/
Maad, S., Coghlan, B., Quigley, G., Ryan, J., Kenny, E., Callaghan, D.O.: Towards a complete grid filesystem functionality. Future Generation Computer Systems, Special Issue on Data Analysis, Access and Management on Grids (2006)
Gooch, R.: Overview of the virtual file system. Linux Documentation project (1999), http://www.atnf.csiro.au/~rgooch/linux/docs/vfs.txt
McNab, A.: The GridSite web/grid security system. Software: Practice and Experience 35(9), 827–834 (2005)
Fielding, R.T., Kaiser, G.: The Apache HTTP server project. IEEE Internet Computing 1(4), 88–90 (1997)
McNab, A.: Grid-based access control and user management for Unix environments, filesystems, web sites and virtual organisations. In: Proceedings of Computing in High Energy Physics, La Jolla, CA (2003)
Fisher, S.: Relational model for information and monitoring (2001)
Coghlan, B., Djaoui, A., Fisher, S., Magowan, J., Oevers, M.: Time, information services and the grid. In: Read, B. (ed.) Advances in Databases. LNCS, vol. 2097, Springer, Heidelberg (2001)
Morrison, J.P., Coghlan, B., Shearer, A., Foley, S., Power, D., Perrot, R.: WebCom-G: A candidate middleware for Grid-Ireland. High Performance Computing Applications and Parallel Processing (2005)
Foster, I., Kesselman, C.: Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications 11(2), 115–128 (1997)
Foster, I.: Globus toolkit version 4: Software for service-oriented systems. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 2–13. Springer, Heidelberg (2005)
Morrison, J., Power, D., Kennedy, J.: Load balancing and fault tolerance in a condensed graphs based metacomputer. The Journal of Internet Technologies, Special Issue on Web based Programming 3(4), 221–234 (2002)
Thain, D., Tannenbaum, T., Livny, M.: Condor and the grid. In: Grid Computing: Making The Global Infrastructure a Reality (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Coghlan, B. et al. (2007). A Transparent Grid Filesystem. In: Kågström, B., Elmroth, E., Dongarra, J., Waśniewski, J. (eds) Applied Parallel Computing. State of the Art in Scientific Computing. PARA 2006. Lecture Notes in Computer Science, vol 4699. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75755-9_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-75755-9_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75754-2
Online ISBN: 978-3-540-75755-9
eBook Packages: Computer ScienceComputer Science (R0)