Abstract
In this chapter we address various solutions to initiate a smooth transition from a high performance storage model composed by several nodes in different distant sites to a model where the nodes cooperate to give a unique file system-like coherent view of their content. This task, historically considered very problematic, has to be considered from several points of view, functional and not, in order to be able to deploy a production-quality system, where the functionalities are effectively usable, and the data access performance is as close as possible to the one reachable by the used hardware. This can be considered as the major challenge in such systems, even because the general expectations about performance and robustness are very high, and very often they are compared to distributed file systems, whose evolution over time has been quite promising, but not to the point of being able to fully satisfy the requirements of large scale computing. To reach this objective, among other items, a design must face the difficulties dealing with the network latency, which varies of more than two orders of magnitude between local network access and Wide Area Network access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
ALICE: Technical Design Report of the Computing. June 2005. ISBN 92-9083-247-9. http://aliceinfo.cern.ch/Collaboration/Documents/TDR/Computing.html
Anderson, T.E., Dahlin, M., Neefe, J.M., Patterson, D.A., Rosselli, D.S., Wang, R.Y.: Serverless Network File Systems. ACM Trans. Comput. Syst. 1, (1996)
Ballintijn, M., Brun, R., Rademakers, F., Roland, G.: Distributed Parallel Analysis Framework with PROOF. http://root.cern.ch/twiki/bin/view/ROOT/PROOF
Bar-Noy, A., Ho, C.-T.: Broadcasting Multiple Messages in the Multiport Model. IEEE Trans. Parallel Distr. Syst., Sept, 1988
Bar-Noy, A., Freund, A., (Seffi) Naor, J.: On-line Load Balancing in a Hierarchical Server Topology. In: Proceedings of the 7th Annual European Symposium on Algorithms, 1999
Betev, L., Carminati, F., Furano, F., Grigoras, C., Saiz, P.: The ALICE computing model: an overview. Third International Conference ”Distributed Computing and Grid-technologies in Science and Education”, GRID2008, http://grid2008.jinr.ru/
Dorigo, A., Elmer, P., Furano, F., Hanushevsky, A.: Xrootd - A highly scalable architecture for data access. WSEAS Trans. Comput., Apr. (2005)
Dorigo, A., Elmer, P., Furano, F., Hanushevsky, A.: XROOTD/TXNetFile: a highly scalable architecture for data access in the ROOT environment. Proceedings of the 4th WSEAS international Conference on Telecommunications and informatics (Prague, Czech Republic, March 13 - 15, 2005). Husak, M., Mastorakis, N. (eds.) World Scientific and Engineering Academy and Society (WSEAS), Stevens Point, Wisconsin, 1-6
Feichtinger, D., Peters, A.J.: Authorization of Data Access in Distributed Storage Systems. The 6th IEEE/ACM International Workshop on Grid Computing, 2005. http://ieeexplore.ieee.org/iel5/10354/32950/01542739.pdf?arnumber=1542739
Furano, F., Hanushevsky, A.: Data access performance through parallelization and vectored access. Some results. CHEP07: Computing for High Energy Physics. J. Phys. Conf. 119 119 (2008) 072016 (9pp)
Furano, F., Hanushevsky, A.: Managing commitments in a Multi Agent System using Passive Bids. iat, 2005 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT’05), pp. 698-701, 2005
Garcia, F., Calderon, A., Carretero, J., Perez, J.M., Fernandez, J.: A Parallel and Fault Tolerant File System based on NFS Servers” Euro-PDP’03, IEEE Computer Society, 2003
Ghemawat, S., Gobioff, H., Leung, S.-T.: The Google file system. In: Proceedings of the nineteenth ACM symposium on Operating systems principles, Oct, ACM press, 2003
Hanushevsky, A., Weeks, B.: Designing high performance data access systems: invited talk abstract. In: Proceedings of the 5th international Workshop on Software and Performance (Palma, Illes Balears, Spain, July 12 - 14, 2005). WOSP ’05. ACM, New York, NY, 267-267. DOI= http://doi.acm.org/10.1145/1071021.1071053
Hanushevsky, A.: Are SE architectures ready for LHC? In: Proceedings of ACAT 2008: XII International Workshop on Advanced Computing and Analysis Techniques in Physics Research. http://acat2008.cern.ch/
Howard, J.H. et al.: Scale and performance in a distributed file system. ACM Trans. Comput. Syst. 6 (1988)
Lustre: a scalable, secure, robust, highly-available cluster file system. It is designed, developed and maintained by Sun Microsystems, Inc. http://www.lustre.org/
Patterson, R.H., Gibson, G.A., Ginting, E., Stodolsky, D., Zelenka, J.: Informed prefetching and caching. In: Proceedings of the 15th ACM Symposium on Operating Systems Principles, 1995
Ripeanu, M., Foster, I., Iamnitchi, A.: Mapping the Gnutella Network: Properties of Large-Scale Peer-to-Peer Systems and Implications for System Design. IEEE Internet Comput. J. 1(Jan-Feb), Springer-Verlag (2002)
ROOT: An Object-Oriented Data Analysis Framework http://root.cern.ch
The babar collaboration home page. http://www.slac.stanford.edu/BFROOT
The IEEE Computer Society’s Storage System Standards Working Group. http://ssswg.org/
The Scalla/xrootd Software Suite. http://savannah.cern.ch/projects/xrootd and http://xrootd.slac.stanford.edu/
Waterhouse, S.R., Doolin, D.M., Kan, G., Faybishenko, Y.: Distributed Search in P2P Networks. IEEE Internet Comput. J. 6 (2002)
Whitney, V.: Comparing Different File Systems’ NFS Performance. A cluster File System and a couple of NAS Servers thrown in. The sixth SCICOMP Meeting, SCICOMP 6 (Univ. of Berkeley), IBM System Scientific Computing User Group, http://pdsf.nersc.gov/talks/talks.html, 2002
XRootd explained. Computing seminar at CERN, http://indico.cern.ch/conferenceDisplay.py?confId=38458
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Furano, F., Hanushevsky, A. (2011). Towards a Globalised Data Access. In: Brun, R., Carminati, F., Galli Carminati, G. (eds) From the Web to the Grid and Beyond. The Frontiers Collection. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23157-5_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-23157-5_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23156-8
Online ISBN: 978-3-642-23157-5
eBook Packages: Physics and AstronomyPhysics and Astronomy (R0)