FPGA-based dynamically reconfigurable SQL query processing

Daniel Ziener, Florian Bauer, Andreas Becher, Christopher Dennl, Klaus Meyer-Wegener, Ute Schurfeld, Jürgen Teich, Jörg Stephan Vogt, Helmut Weber

Research output: Contribution to journalArticleAcademicpeer-review

10 Citations (Scopus)

Abstract

In this article, we propose an FPGA-based SQL query processing approach exploiting the capabilities of partial dynamic reconfiguration of modern FPGAs. After the analysis of an incoming query, a query-specific hardware processing unit is generated on the fly and loaded on the FPGA for immediate query execution. For each query, a specialized hardware accelerator pipeline is composed and configured on the FPGA from a set of presynthesized hardware modules. These partially reconfigurable hardware modules are gathered in a library covering all major SQL operations like restrictions and aggregations, as well as more complex operations such as joins and sorts. Moreover, this holistic query processing approach in hardware supports different data processing strategies including row-as column-wise data processing in order to optimize data communication and processing. This article gives an overview of the proposed query processing methodology and the corresponding library of modules. Additionally, a performance analysis is introduced that is able to estimate the processing time of a query for different processing strategies and different communication and processing architecture configurations. With the help of this performance analysis, architectural bottlenecks may be exposed and future optimized architectures, besides the two prototypes presented here, may be determined.

Original languageEnglish
Article number25
JournalACM Transactions on Reconfigurable Technology and Systems
Volume9
Issue number4
DOIs
Publication statusPublished - 1 Aug 2016
Externally publishedYes

Fingerprint

Query processing
Field programmable gate arrays (FPGA)
Processing
Hardware
Reconfigurable hardware
Communication
Computer hardware
Particle accelerators
Agglomeration
Pipelines

Keywords

  • Dynamic partial reconfiguration
  • FPGA
  • Reconfigurable computing
  • SQL processing

Cite this

Ziener, D., Bauer, F., Becher, A., Dennl, C., Meyer-Wegener, K., Schurfeld, U., ... Weber, H. (2016). FPGA-based dynamically reconfigurable SQL query processing. ACM Transactions on Reconfigurable Technology and Systems, 9(4), [25]. https://doi.org/10.1145/2845087
Ziener, Daniel ; Bauer, Florian ; Becher, Andreas ; Dennl, Christopher ; Meyer-Wegener, Klaus ; Schurfeld, Ute ; Teich, Jürgen ; Vogt, Jörg Stephan ; Weber, Helmut. / FPGA-based dynamically reconfigurable SQL query processing. In: ACM Transactions on Reconfigurable Technology and Systems. 2016 ; Vol. 9, No. 4.
@article{eb700f26e6ba4b37bcfac80f4147ba50,
title = "FPGA-based dynamically reconfigurable SQL query processing",
abstract = "In this article, we propose an FPGA-based SQL query processing approach exploiting the capabilities of partial dynamic reconfiguration of modern FPGAs. After the analysis of an incoming query, a query-specific hardware processing unit is generated on the fly and loaded on the FPGA for immediate query execution. For each query, a specialized hardware accelerator pipeline is composed and configured on the FPGA from a set of presynthesized hardware modules. These partially reconfigurable hardware modules are gathered in a library covering all major SQL operations like restrictions and aggregations, as well as more complex operations such as joins and sorts. Moreover, this holistic query processing approach in hardware supports different data processing strategies including row-as column-wise data processing in order to optimize data communication and processing. This article gives an overview of the proposed query processing methodology and the corresponding library of modules. Additionally, a performance analysis is introduced that is able to estimate the processing time of a query for different processing strategies and different communication and processing architecture configurations. With the help of this performance analysis, architectural bottlenecks may be exposed and future optimized architectures, besides the two prototypes presented here, may be determined.",
keywords = "Dynamic partial reconfiguration, FPGA, Reconfigurable computing, SQL processing",
author = "Daniel Ziener and Florian Bauer and Andreas Becher and Christopher Dennl and Klaus Meyer-Wegener and Ute Schurfeld and J{\"u}rgen Teich and Vogt, {J{\"o}rg Stephan} and Helmut Weber",
year = "2016",
month = "8",
day = "1",
doi = "10.1145/2845087",
language = "English",
volume = "9",
journal = "ACM Transactions on Reconfigurable Technology and Systems",
issn = "1936-7406",
publisher = "Association for Computing Machinery (ACM)",
number = "4",

}

Ziener, D, Bauer, F, Becher, A, Dennl, C, Meyer-Wegener, K, Schurfeld, U, Teich, J, Vogt, JS & Weber, H 2016, 'FPGA-based dynamically reconfigurable SQL query processing' ACM Transactions on Reconfigurable Technology and Systems, vol. 9, no. 4, 25. https://doi.org/10.1145/2845087

FPGA-based dynamically reconfigurable SQL query processing. / Ziener, Daniel; Bauer, Florian; Becher, Andreas; Dennl, Christopher; Meyer-Wegener, Klaus; Schurfeld, Ute; Teich, Jürgen; Vogt, Jörg Stephan; Weber, Helmut.

In: ACM Transactions on Reconfigurable Technology and Systems, Vol. 9, No. 4, 25, 01.08.2016.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - FPGA-based dynamically reconfigurable SQL query processing

AU - Ziener, Daniel

AU - Bauer, Florian

AU - Becher, Andreas

AU - Dennl, Christopher

AU - Meyer-Wegener, Klaus

AU - Schurfeld, Ute

AU - Teich, Jürgen

AU - Vogt, Jörg Stephan

AU - Weber, Helmut

PY - 2016/8/1

Y1 - 2016/8/1

N2 - In this article, we propose an FPGA-based SQL query processing approach exploiting the capabilities of partial dynamic reconfiguration of modern FPGAs. After the analysis of an incoming query, a query-specific hardware processing unit is generated on the fly and loaded on the FPGA for immediate query execution. For each query, a specialized hardware accelerator pipeline is composed and configured on the FPGA from a set of presynthesized hardware modules. These partially reconfigurable hardware modules are gathered in a library covering all major SQL operations like restrictions and aggregations, as well as more complex operations such as joins and sorts. Moreover, this holistic query processing approach in hardware supports different data processing strategies including row-as column-wise data processing in order to optimize data communication and processing. This article gives an overview of the proposed query processing methodology and the corresponding library of modules. Additionally, a performance analysis is introduced that is able to estimate the processing time of a query for different processing strategies and different communication and processing architecture configurations. With the help of this performance analysis, architectural bottlenecks may be exposed and future optimized architectures, besides the two prototypes presented here, may be determined.

AB - In this article, we propose an FPGA-based SQL query processing approach exploiting the capabilities of partial dynamic reconfiguration of modern FPGAs. After the analysis of an incoming query, a query-specific hardware processing unit is generated on the fly and loaded on the FPGA for immediate query execution. For each query, a specialized hardware accelerator pipeline is composed and configured on the FPGA from a set of presynthesized hardware modules. These partially reconfigurable hardware modules are gathered in a library covering all major SQL operations like restrictions and aggregations, as well as more complex operations such as joins and sorts. Moreover, this holistic query processing approach in hardware supports different data processing strategies including row-as column-wise data processing in order to optimize data communication and processing. This article gives an overview of the proposed query processing methodology and the corresponding library of modules. Additionally, a performance analysis is introduced that is able to estimate the processing time of a query for different processing strategies and different communication and processing architecture configurations. With the help of this performance analysis, architectural bottlenecks may be exposed and future optimized architectures, besides the two prototypes presented here, may be determined.

KW - Dynamic partial reconfiguration

KW - FPGA

KW - Reconfigurable computing

KW - SQL processing

UR - http://www.scopus.com/inward/record.url?scp=84984660700&partnerID=8YFLogxK

U2 - 10.1145/2845087

DO - 10.1145/2845087

M3 - Article

VL - 9

JO - ACM Transactions on Reconfigurable Technology and Systems

JF - ACM Transactions on Reconfigurable Technology and Systems

SN - 1936-7406

IS - 4

M1 - 25

ER -