Abstract
The storing of data and configuration files related to scientific experiments is vital if those experiments are to remain reproducible, or if the data is to be shared easily. The prescence of historical (observed) data is also important in order to assist in model evaluation and development. This paper describes the design and implementation process for a data archive, which was required for a coastal modelling project.
The construction of the archive is described in detail, from its design through to deployment and testing. As we will show, the archive has been designed to tolerate failures in its communications with external services, and also to ensure that no information is lost if the archive itself fails, i.e. upon restarting, the archive will still be in exactly the same state.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abdelnur, A., Hepper, S.: JavaTMPortlet Specification Version 1.0, Java Specification Request 168 (JSR 168), Commuinity Development of Java Technology Specifications (October 2003), Online at, http://jcp.org/en/jsr/detail?id=168
Allcock, W. (ed.): GridFTP: Protocol Extensions to FTP for the Grid, Global Grid Forum Recommendation Document GFD.20. Online at, http://www.ggf.org/documents
Allen, G., et al.: Enabling Applications on the Grid: A GridLab Overview. International Journal of High Performance Computing Applications 17(4), 449–466 (2003)
Allen, G., et al.: The Grid Application Toolkit: Toward Generic and Easy Application Programming Interfaces for the Grid. Proceedings of the IEEE 93(3), 534–550 (2005)
Ballinger, K., Ehnebuske, D., et al. (eds.): Basic Profile Version 1.1 (Final), The Web Services-Interoperability Organization, WS-I (August 2004), Online at http://www.ws-i.org/Profiles/BasicProfile-1.1-2004-08-24.html
van Engelen, R., Gallivan, K.: The gSOAP Toolkit for Web Services and Peer-to-Peer Computing Networks. In: 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2002), pp. 128–135. IEEE Press, Los Alamitos (2002)
van Engelen, R., Gupta, G., Pant, S.: Developing Web Services for C and C++. IEEE Internet Computing 7(2), 53–61 (2003)
Mandrichenko, I., Allcock, W., Perelmutov, T. (eds.): GridFTP v2 Protocol Description, Global Grid Forum Recommendation Document GFD.47. Online at, http://www.ggf.org/documents
Novotny, J., Russell, M., Wehrens, O.: GridSphere: a portal framework for building collaborations. Concurrency and Computation: Practice and Experience 16(5), 503–513 (2004)
Rajasekar, A., Wan, M., Moore, R.: MySRB and SRB - Components of a Data Grid. In: Proceedings of the 11th International Symposium on High Performance Distributed Computing (HPDC-11), Edinburgh, Scotland, pp. 301–310 (July 2002)
Ris, R.C., Holthuijsen, L.H., Booij, N.: A Spectral Model for Waves in the Near Shore Zone. In: Proceedings of the 24th International Conference on Coastal Engineering, Kobe, Japan, pp. 68–78 (October 1994)
Waldo, J., Wyant, G., Wollrath, A., Kendall, S.: A Note on Distributed Computing. Technical Report TR-94-29, Sun Microsystems Laboratories, Inc. (November 1994), Online at, http://research.sun.com/techrep/1994/abstract-29.html
Westerink, J., Luettich, R., Baptista, A., Scheffner, N., Farrar, P.: Tide and Storm Surge Predictions Using Finite Element Model. ASCE Journal of Hydraulic Engineering, 1373–1390 (1992)
Unidata’s Network Common Data Form (NetCDF), http://my.unidata.ucar.edu/content/software/netcdf/index.html
The SCOOP Program’s Coastal Model Project Website, http://www1.sura.org/3000/3310_Scoop.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
MacLaren, J., Allen, G., Dekate, C., Huang, D., Hutanu, A., Zhang, C. (2005). Shelter from the Storm: Building a Safe Archive in a Hostile World. In: Meersman, R., Tari, Z., Herrero, P. (eds) On the Move to Meaningful Internet Systems 2005: OTM 2005 Workshops. OTM 2005. Lecture Notes in Computer Science, vol 3762. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11575863_49
Download citation
DOI: https://doi.org/10.1007/11575863_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29739-0
Online ISBN: 978-3-540-32132-3
eBook Packages: Computer ScienceComputer Science (R0)