Design and Evaluation of a Configurable Query Processing Hardware for Data Streams

Yasin OGE; Masato YOSHIMI; Takefumi MIYOSHI; Hideyuki KAWASHIMA; Hidetsugu IRIE; Tsutomu YOSHINAGA

doi:10.1587/transinf.2015EDP7203

Design and Evaluation of a Configurable Query Processing Hardware for Data Streams

Yasin OGE, Masato YOSHIMI, Takefumi MIYOSHI, Hideyuki KAWASHIMA, Hidetsugu IRIE, Tsutomu YOSHINAGA

Full Text Views

0

Share
Cite this

Summary :

In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimal-overhead execution engine designed to deliver real-time response for high-volume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQL-like queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).

Publication: IEICE TRANSACTIONS on Information Vol.E98-D No.12 pp.2207-2217

Publication Date: 2015/12/01

Publicized: 2015/09/14

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2015EDP7203

Type of Manuscript: PAPER

Category: Computer System

Authors

Yasin OGE
  The University of Electro-Communi-cations
Masato YOSHIMI
  The University of Electro-Communi-cations
Takefumi MIYOSHI
  e-trees. Japan, Inc.
Hideyuki KAWASHIMA
  University of Tsukuba
Hidetsugu IRIE
  The University of Tokyo
Tsutomu YOSHINAGA
  The University of Electro-Communi-cations

Keyword

FPGA, query processing, data stream, sliding-window aggregation, configurable hardware architecture

Cite this

Copy

Yasin OGE, Masato YOSHIMI, Takefumi MIYOSHI, Hideyuki KAWASHIMA, Hidetsugu IRIE, Tsutomu YOSHINAGA, "Design and Evaluation of a Configurable Query Processing Hardware for Data Streams" in IEICE TRANSACTIONS on Information, vol. E98-D, no. 12, pp. 2207-2217, December 2015, doi: 10.1587/transinf.2015EDP7203.
Abstract: In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimal-overhead execution engine designed to deliver real-time response for high-volume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQL-like queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).
URL: https://globals.ieice.org/en_transactions/information/10.1587/transinf.2015EDP7203/_p

Copy

@ARTICLE{e98-d_12_2207,
author={Yasin OGE, Masato YOSHIMI, Takefumi MIYOSHI, Hideyuki KAWASHIMA, Hidetsugu IRIE, Tsutomu YOSHINAGA, },
journal={IEICE TRANSACTIONS on Information},
title={Design and Evaluation of a Configurable Query Processing Hardware for Data Streams},
year={2015},
volume={E98-D},
number={12},
pages={2207-2217},
abstract={In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimal-overhead execution engine designed to deliver real-time response for high-volume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQL-like queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).},
keywords={},
doi={10.1587/transinf.2015EDP7203},
ISSN={1745-1361},
month={December},}

Copy

TY - JOUR
TI - Design and Evaluation of a Configurable Query Processing Hardware for Data Streams
T2 - IEICE TRANSACTIONS on Information
SP - 2207
EP - 2217
AU - Yasin OGE
AU - Masato YOSHIMI
AU - Takefumi MIYOSHI
AU - Hideyuki KAWASHIMA
AU - Hidetsugu IRIE
AU - Tsutomu YOSHINAGA
PY - 2015
DO - 10.1587/transinf.2015EDP7203
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E98-D
IS - 12
JA - IEICE TRANSACTIONS on Information
Y1 - December 2015
AB - In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimal-overhead execution engine designed to deliver real-time response for high-volume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQL-like queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).
ER -