Another Example of a Data Warehouse System Based on Transposed Files
The major commercial data warehouse systems available today are based on record-oriented relational technology optimized for OLTP applications. Several authors have shown that substantial improvements in query performance for OLAP applications can be achieved by systems based on transposed files (column-oriented) technology, since the dominant queries only require grouping and aggregation on a few columns of large amounts of data. This new assumption underlying data warehouse systems means that several aspects of data management and query processing need to be reconsidered. We present some preliminary results of an industrial research project which is being sponsored by the Italian Ministry of Education, University and Research (MIUR) to support the cooperation of universities and industries in prototyping innovative systems. The aim of the project is to implement an SQL-compliant prototype data warehouse system based on a transposed file storage system. The paper will focus on the optimization of star queries with group-by.
KeywordsQuery Processing Query Performance Fact Table Storage Structure Query Plan
Unable to display preview. Download preview PDF.
- 2.Chaudhuri, S., Shim, K.: Including Group-By in Query Optimization. In: Proc.Intl. Conf. on VLDB, Santiago, Chile, pp. 354–366 (1994)Google Scholar
- 3.Datta, A., Ramamritham, K., Thomas, H.M.: Curio: A N ovel Solution for Efficient Storage and Indexing in Data Warehouses. In: Proc. Intl. Conf. on VLDB, Edinburgh, Scotland, pp. 730–733 (1999)Google Scholar
- 4.French, C.D.: One size fits all Database Architectures do not Work for DDS. In: Proc. of the ACM SIGMOD Intl. Conf. on Management of Data, San Jose, California, USA, pp. 449–450 (1995)Google Scholar
- 5.Galindo-Legaria, C.A., Joshi, M.M.: Orthogonal Optimization of Subqueries and Aggregation. In: Proc. of the ACM SIGMOD Intl. Conf. on Management of Data, Santa Barbara, California, USA, pp. 571–581 (2001)Google Scholar
- 6.Stonebraker, M., et al.: C-Store: A Column-Oriented DBMS. In: Proc. Intl. Conf. on VLDB, Trondheim, Norway, pp. 553–564 (2005)Google Scholar
- 7.Turner, M.J., Hammond, R., Cotton, P.: A DBMS for Large Statistical Databases. In: Proc. Intl. Conf. on VLDB, Rio de Janeiro, Brazil, pp. 319–327 (1979)Google Scholar