Join decomposition based on fragmented column indices
- 24 Downloads
The paper is devoted to the issue of decomposition of the join relational operator with the aid of distributed column indices. Such decomposition allows one to utilize the modern manycore accelerators (GPU or Intel Xeon Phi) to speed up the query execution for very large databases. Column indices are the new kind of index structures, which exploits “key-value” technics. The paper describes themethods of column index fragmentation based on domain intervals. This technic allows organizing the parallel query processing without exchanges. All column index fragments are stored in main memory in compressed form to conserve space. This approach can be implemented as a coprocessor for relational database systems. The database coprocessor is able to perform resourceintensive operations much more faster than a conventional DBMS.
Keywords and phrasesVery large databases parallel query processing column indices domain-interval fragmentation
Unable to display preview. Download preview PDF.
- 1.V. Turner, J. F. Gantz, D. Reinsel, and S. Minton, The Digital Universe of Opportunities: Rich Data and the creasing Value of the Internet of Things. IDC white paper. April 2014. Available: http://idcdocserv.com/1678 [November 06, 2014].Google Scholar
- 4.K. Y. Besedin and P. S. Kostenetskiy, Simulating of query processing on multiprocessor database systems with modern coprocessors, 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) 2014, Opatija, Croatia, May 26–30, IEEE, 1835–1837 (2014).Google Scholar
- 5.D. J. Abadi, S. R. Madden, and N. Hachem, Column-Stores vs. Row-Stores: How Different Are They Really? Proceedings of the 2008 ACM SIGMOD international conference on Management of data, June 912, 2008 (Vancouver, BC, Canada. ACM, 2008), p. 967–980.Google Scholar
- 7.J. Fang, A. L. Varbanescu, and H. Sips, Sesame: A User-Transparent Optimizing Framework for Many- Core Processors, Proceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid2013), May 13–16, 2013 (Delft, Netherlands. IEEE, 2013), p. 70–73.CrossRefGoogle Scholar
- 8.S. Breß, F. Beier, H. Rauhe, K.-U. Sattler, E. Schallehn, G. Saake, Efficient Co-Processor Utilization in Database Query Processing, Information Systems. 38 (8), 1084–1096 (2013).Google Scholar
- 9.M. Scherger, Design of an In-Memory Database Engine Using Intel Xeon Phi Coprocessors, Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’14), July 21–24, 2014 (Las Vegas, US A. CSREA Press, 2014), p. 21–27.Google Scholar
- 11.H. Le Hong and J. Fenn, Hype Cycle for Emerging Technologies. Gartner Inc. Research Report. August 2013. Available: http://www.gartner.com/doc/2571624 [December 16, 2014].Google Scholar
- 12.H. Garcia-Molina, J. D. Ullman, and J. Widom, Database Systems: The Complete Book (2nd Edition) (Prentice Hall, 2008), 1224 p.Google Scholar
- 13.E. V. Ivanova and L. B. Sokolinsky, Decomposition of Natural Join Based on Domain-Interval Fragmented Column Indices, 38th International Convention on Information and Communication Technology, Electronics and Microelectronics,MIPRO, 2015, Proceedings, IEEE, 2015, pp. 210–213.Google Scholar