Encyclopedia of Database Systems

2018 Edition
| Editors: Ling Liu, M. Tamer Özsu

Operator-Level Parallelism

  • Nikos Hardavellas
  • Ippokratis Pandis
Reference work entry
DOI: https://doi.org/10.1007/978-1-4614-8265-9_661

Synonyms

Inter-operator parallelism

Definition

Operator-level parallelism (or inter-operator parallelism) is a form of intra-query parallelism obtained by executing concurrently several operators of the same query. By contrast, intra-operator parallelism is obtained by executing the same operator on multiple processors, with each instance working on a different subset of data.

Historical Background

Parallelism has been a key focus of database research since the 1970s. For example, as early as 1978 Teradata was building highly-parallel database systems and quietly pioneered many of the ideas on parallel query execution [5]. However, the intra-query parallelism employed by these early systems was mostly intra-operator or independent parallelism (see Classes of Parallelism below). Gamma [4] was one of the first database systems that allowed operator-level parallelism through pipelining.

Foundations

Parallel processing uses multiple processors cooperatively to improve the performance of...

This is a preview of subscription content, log in to check access.

Recommended Reading

  1. 1.
    Boncz P, Zukowski M, Nes N. MonetDB/X100: hyper-pipelining query execution. In: Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research; 2005. p. 225–37.Google Scholar
  2. 2.
    Boral H. Prototyping bubba: a highly parallel database system. IEEE Trans Knowl Data Eng. 1990;2(1):4.CrossRefGoogle Scholar
  3. 3.
    Chen MS, Lo M, Yu PS, Young HC. Using segmented right-deep trees for the execution of pipelined hash joins. In: Proceedings of the 18th International Conference on Very Large Data Bases; 1992. p. 15–26.Google Scholar
  4. 4.
    DeWitt DJ, Gray J. Parallel database systems: the future of high-performance database computing. Commun ACM. 1992;35(6):85–98.CrossRefGoogle Scholar
  5. 5.
    DeWitt DJ., Gerber RH, Graefe G, Heytens ML, Kumar KB, Muralikrishna M. GAMMA - a high performance dataflow database machine. In: Proceedings of the 12th International Conference on Very Large Data Bases; 1986. p. 228–37.Google Scholar
  6. 6.
    Graefe G. Volcano - an extensible and parallel query evaluation system. IEEE Trans Knowl Data Eng. 1994;6(1):120–35.CrossRefGoogle Scholar
  7. 7.
    Harizopoulos S, Ailamaki A. Staged D.B.: designing database servers for modern hardware. IEEE Data Eng Bull. 2005;28(2):11–6.Google Scholar
  8. 8.
    IBM Corp. DB2 Version 9 Performance Guide. Part no. SC10-4222-00. 2006.Google Scholar
  9. 9.
    Oracle Corp. Oracle Database Data Warehousing Guide. 10 g Release 1 (10.1). Part no. B10736–01. 2003.Google Scholar
  10. 10.
    Schneider DA. DeWitt DJ. Tradeoffs in processing complex join queries via hashing in multiprocessor database machines. In: Proceedings of the 12th International Conference on Very Large Data Bases; 1986. p. 469–80.Google Scholar
  11. 11.
    Yu PS, Chen MS, Wolf JL, and Turek JJ. Parallel query processing. In: Adam N, Bhargava B, editors. Advanced database systems. LNCS, vol. 759. Berlin: Springer; 1993. p. 239–58.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Carnegie Mellon UniversityPittsburghUSA
  2. 2.Amazon Web ServicesSeattleUSA

Section editors and affiliations

  • Anastasia Ailamaki
    • 1
  1. 1.Informatique et CommunicationsEcole Polytechnique Fédérale de LausanneLausanneSwitzerland