Dataflow Query Execution in a Parallel, Main-memory Environment

A.N. Wilschut, Peter M.G. Apers

Research output: Contribution to journalArticleAcademicpeer-review

56 Citations (Scopus)
114 Downloads (Pure)

Abstract

In this paper, the performance and characteristics of the execution of various join-trees on a parallel DBMS are studied. The results of this study are a step into the direction of the design of a query optimization strategy that is fit for parallel execution of complex queries. Among others, synchronization issues are identified to limit the performance gain from parallelism. A new hash-join algorithm is introduced that has fewer synchronization constraints than the known hash-join algorithms. Also, the behavior of individual join operations in a join-tree is studied in a simulation experiment. The results show that the introduced Pipelining hash-join algorithm yields a better performance for multi-join queries. The format of the optimal join-tree appears to depend on the size of the operands of the join: A multi-join between small operands performs best with a bushy schedule; larger operands are better off with a linear schedule. The results from the simulation study are confirmed with an analytic model for dataflow query execution.
Original languageUndefined
Article number10.1007/BF01277522
Pages (from-to)103-128
Number of pages26
JournalDistributed and parallel databases
Volume1
Issue number1
DOIs
Publication statusPublished - Jan 1993

Keywords

  • IR-66248
  • EWI-6332
  • DB-PDB: PARALLEL DATABASES

Cite this