A Load-Balanced Deterministic Runtime for Pipeline Parallelism

Chen CHEN; Kai LU; Xiaoping WANG; Xu ZHOU; Zhendong WU

doi:10.1587/transinf.2014EDL8171

A Load-Balanced Deterministic Runtime for Pipeline Parallelism

Chen CHEN, Kai LU, Xiaoping WANG, Xu ZHOU, Zhendong WU

Full Text Views

0

Share
Cite this

Summary :

Most existing deterministic multithreading systems are costly on pipeline parallel programs due to load imbalance. In this letter, we propose a Load-Balanced Deterministic Runtime (LBDR) for pipeline parallelism. LBDR deterministically takes some tokens from non-synchronization-intensive threads to synchronization-intensive threads. Experimental results show that LBDR outperforms the state-of-the-art design by an average of 22.5%.

Publication: IEICE TRANSACTIONS on Information Vol.E98-D No.2 pp.433-436

Publication Date: 2015/02/01

Publicized: 2014/10/21

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2014EDL8171

Type of Manuscript: LETTER

Category: Software System

Authors

Chen CHEN
  National University of Defense Technology
Kai LU
  National University of Defense Technology
Xiaoping WANG
  National University of Defense Technology
Xu ZHOU
  National University of Defense Technology
Zhendong WU
  National University of Defense Technology

Keyword

deterministic runtime, pipeline parallelism, round-robin scheduling, load balance

Cite this

Copy

Chen CHEN, Kai LU, Xiaoping WANG, Xu ZHOU, Zhendong WU, "A Load-Balanced Deterministic Runtime for Pipeline Parallelism" in IEICE TRANSACTIONS on Information, vol. E98-D, no. 2, pp. 433-436, February 2015, doi: 10.1587/transinf.2014EDL8171.
Abstract: Most existing deterministic multithreading systems are costly on pipeline parallel programs due to load imbalance. In this letter, we propose a Load-Balanced Deterministic Runtime (LBDR) for pipeline parallelism. LBDR deterministically takes some tokens from non-synchronization-intensive threads to synchronization-intensive threads. Experimental results show that LBDR outperforms the state-of-the-art design by an average of 22.5%.
URL: https://globals.ieice.org/en_transactions/information/10.1587/transinf.2014EDL8171/_p

Copy

@ARTICLE{e98-d_2_433,
author={Chen CHEN, Kai LU, Xiaoping WANG, Xu ZHOU, Zhendong WU, },
journal={IEICE TRANSACTIONS on Information},
title={A Load-Balanced Deterministic Runtime for Pipeline Parallelism},
year={2015},
volume={E98-D},
number={2},
pages={433-436},
abstract={Most existing deterministic multithreading systems are costly on pipeline parallel programs due to load imbalance. In this letter, we propose a Load-Balanced Deterministic Runtime (LBDR) for pipeline parallelism. LBDR deterministically takes some tokens from non-synchronization-intensive threads to synchronization-intensive threads. Experimental results show that LBDR outperforms the state-of-the-art design by an average of 22.5%.},
keywords={},
doi={10.1587/transinf.2014EDL8171},
ISSN={1745-1361},
month={February},}

Copy

TY - JOUR
TI - A Load-Balanced Deterministic Runtime for Pipeline Parallelism
T2 - IEICE TRANSACTIONS on Information
SP - 433
EP - 436
AU - Chen CHEN
AU - Kai LU
AU - Xiaoping WANG
AU - Xu ZHOU
AU - Zhendong WU
PY - 2015
DO - 10.1587/transinf.2014EDL8171
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E98-D
IS - 2
JA - IEICE TRANSACTIONS on Information
Y1 - February 2015
AB - Most existing deterministic multithreading systems are costly on pipeline parallel programs due to load imbalance. In this letter, we propose a Load-Balanced Deterministic Runtime (LBDR) for pipeline parallelism. LBDR deterministically takes some tokens from non-synchronization-intensive threads to synchronization-intensive threads. Experimental results show that LBDR outperforms the state-of-the-art design by an average of 22.5%.
ER -