Abstract
Large-scale scientific experiments or simulation programs often generate large amounts of multidimensional data. Data volume may reach hundreds of terabytes (up to petabytes). In the present and the near future, the only practicable way for storing such large volumes of multidimensional data are tertiary storage systems. But commercial (multidimensional) database systems are optimized for performance with primary and secondary memory access. So tertiary storage memory is only in an insufficient way supported for storing or retrieval of multidimensional array data. To combine the advantages of both techniques, storing large amounts of data on tertiary storage media and optimizing data access for retrieval with multidimensional database management systems is the intention of this paper. We introduce concepts for efficient hierarchical storage support and management for large-scale multidimensional array database management systems and their integration into the commercial array database management system RasDaMan.
This work was supported by the ESTEDI project (http://www.estedi.org). ESTEDI (European Spatio-Temporal Data Infrastructure for High-Performance Computing) is funded by the European Commission under FP5 grant no. IST-1999-11009.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Active Knowledge GmbH: RasDaMan Query Language Guide version 5.0, Active Knowledge GmbH, Munich 2001
Baumann P.: A Database Array Algebra for Spatio-Temporal Data and Beyond, Proc. of the 4th Int. Workshop on Next Generation Information Technologies and Systems (NGITS), p. 76–93, 1999
Baumann P.: Array Databases Meet Supercomputing Data-the ESTEDI Project, Internal ESTEDI Report, 2000
Bernardo L. M., Nordberg H., Rotem D., Shoshani A.: Determining the Optimal File Size on Tertiary Storage Systems Based on the Distribution of Query Sizes, Proc. of the 10th Int. Conf. on Scientific and Statistical Database Management, p. 22–31, 1998
Chen L. T., Drach R., Keating M., Louis S., Rotem D., Shoshani A.: Efficient organization and access of multi-dimensional datasets on tertiary storage, Information Systems, vol. 20, no. 2, p. 155–183, 1995
Chen L. T., Rotem D., Shoshani A., Drach R.: Optimizing Tertiary Storage Organization and Access for Spatio-Temporal Datasets, NASA Goddard Conf. on Mass Storage Systems, 1995
Furtado P. A., Baumann P.: Storage of Multidimensional Arrays Based on Arbitrary Tiling, Proc. Of the ICDE’99, p. 480–489, 1999
Furtado P. A.: Storage Management of Multidimensional Arrays in Database Management Systems, PhD Thesis of Technical University Munich, 1999
Gaede V., Günther O.: Multidimensional Access Methods, ACM Computing Surveys, vol. 30, no. 2, 1998
Johnson T., Miller E. L.: Performance Measurements of Tertiary Storage Devices, Proc. of the 24th VLDB Conf., New York, USA, 1998
Reiner B.: Tertiary Storage Support for Multidimensional Data, VLDB Supercomputing Databases Workshop, Rome, September 2001
Rigaux P., Scholl M., Voisard A.: Spatial Databases-with application to GIS, Academic Press, 2002
Sarawagi S., Stonebraker M.: Efficient Organization of Large Multidimensional Arrays, Proc. of Int. Conf. On Data Engineering, volume 10, p. 328–336, 1994
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Reiner, B., Hahn, K., Höfling, G., Baumann, P. (2002). Hierarchical Storage Support and Management for Large-Scale Multidimensional Array Database Management Systems. In: Hameurlain, A., Cicchetti, R., Traunmüller, R. (eds) Database and Expert Systems Applications. DEXA 2002. Lecture Notes in Computer Science, vol 2453. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46146-9_68
Download citation
DOI: https://doi.org/10.1007/3-540-46146-9_68
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44126-7
Online ISBN: 978-3-540-46146-3
eBook Packages: Springer Book Archive