Skip to main content
SpringerLink
Log in

Limitations of Intra-operator Parallelism Using Heterogeneous Computing Resources

  • Conference paper
  • First Online:
Book cover Advances in Databases and Information Systems (ADBIS 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9809))

Abstract

The hardware landscape is changing from homogeneous multi-core systems towards wildly heterogeneous systems combining different computing units, like CPUs and GPUs. To utilize these heterogeneous environments, database query execution has to adapt to cope with different architectures and computing behaviors. In this paper, we investigate the simple idea of partitioning an operator’s input data and processing all data partitions in parallel, one partition per computing unit. For heterogeneous systems, data has to be partitioned according to the performance of the computing units. We define a way to calculate the partition sizes, analyze the parallel execution exemplarily for two database operators, and present limitations that could hinder significant performance improvements. The findings in this paper can help system developers to assess the possibilities and limitations of intra-operator parallelism in heterogeneous environments, leading to more informed decisions if this approach is beneficial for a given workload and hardware environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://bitbucket.org/msaecker/monetdb-opencl.

  2. 2.

    http://clogs.sourceforge.net.

References

  1. Albutiu, M.-C., Kemper, A., Neumann, T.: Massively parallel sort-merge joins in main memory multi-core database systems. Proc. VLDB Endow. 5, 1064–1075 (2012)

    Article  Google Scholar 

  2. Batcher, K.E.: Sorting networks and their applications. In: Proceedings of the April 30–May 2, 1968, Spring Joint Computer Conference, AFIPS 1968 (Spring), New York, USA (1968)

    Google Scholar 

  3. Boncz, P.A., Kersten, M.L., Manegold, S.: Breaking the memory wall in MonetDB. Commun. ACM 51(12), 77–85 (2008)

    Article  Google Scholar 

  4. DeWitt, D.J., Gerber, R.H., Graefe, G., Heytens, M.L., Kumar, K.B., Muralikrishna, M.: GAMMA - a high performance dataflow database machine. In: Proceedings of VLDB (1986)

    Google Scholar 

  5. Esmaeilzadeh, H., Blem, E., Amant, R.S., Sankaralingam, K., Burger, D.: Dark silicon and the end of multicore scaling. In: ISCA, New York, USA. ACM (2011)

    Google Scholar 

  6. Heimel, M., Saecker, M., Pirk, H., Manegold, S., Markl, V.: Hardware-oblivious parallelism for in-memory column-stores. PVLDB 6, 709–720 (2013)

    Google Scholar 

  7. Huismann, I., Stiller, J., Froehlich, J.: Two-level parallelization of a fluid mechanics algorithm exploiting hardware heterogeneity. Comput. Fluids 117, 114–124 (2015)

    Article  MathSciNet  Google Scholar 

  8. Karnagel, T., Habich, D., Schlegel, B., Lehner, W.: Heterogeneity-aware operator placement in column-store DBMS. Datenbank-Spektrum 14, 211–221 (2014)

    Article  Google Scholar 

  9. Mayr, T., Bonnet, P., Gehrke, J., Seshadri, P.: Query processing with heterogeneous resources. Technical Report, Cornell University, March 2000

    Google Scholar 

  10. Merrill, D.G., Grimshaw, A.S.: Revisiting sorting for GPGPU stream architectures. In: Proceedings of PACT 2010, New York, USA. ACM (2010)

    Google Scholar 

  11. Merry, B.: A performance comparison of sort and scan libraries for GPUs. Parallel Process. Lett. 25(04), 1550007 (2015)

    Article  MathSciNet  Google Scholar 

  12. Satish, N., Harris, M., Garland, M.: Designing efficient sorting algorithms for manycore GPUs. In: Proceedings of IPDPS 2009, Washington, DC, USA. IEEE Computer Society (2009)

    Google Scholar 

Download references

Acknowledgments

This work is funded by the German Research Foundation (DFG) within the Cluster of Excellence “Center for Advancing Electronics Dresden”. Parts of the hardware were generously provided by Dresden GPU Center of Excellence.

Author information

Authors and Affiliations

  1. Database Technology Group, Technische Universität Dresden, Dresden, Germany

    Tomas Karnagel, Dirk Habich & Wolfgang Lehner

Authors
  1. Tomas Karnagel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dirk Habich
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wolfgang Lehner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tomas Karnagel .

Editor information

Editors and Affiliations

  1. MFF, Charles University MFF, Prague, Czech Republic

    Jaroslav Pokorný

  2. Faculty of Sciences, University of Novi Sad Faculty of Sciences, Novi Sad, Serbia

    Mirjana Ivanović

  3. Christian-Albrechts-Universität Kiel , Kiel, Germany

    Bernhard Thalheim

  4. VSB-Technical University Ostrava , Ostrava, Czech Republic

    Petr Šaloun

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Karnagel, T., Habich, D., Lehner, W. (2016). Limitations of Intra-operator Parallelism Using Heterogeneous Computing Resources. In: Pokorný, J., Ivanović, M., Thalheim, B., Šaloun, P. (eds) Advances in Databases and Information Systems. ADBIS 2016. Lecture Notes in Computer Science(), vol 9809. Springer, Cham. https://doi.org/10.1007/978-3-319-44039-2_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-44039-2_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-44038-5

  • Online ISBN: 978-3-319-44039-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation