Power-Effective File Layout Based on Large Scale Data-Intensive Application in Virtualized Environment

Shunsuke YAGAI; Masato OGUCHI; Miyuki NAKANO; Saneyasu YAMAGUCHI

doi:10.1587/transinf.2017PAP0003

Power-Effective File Layout Based on Large Scale Data-Intensive Application in Virtualized Environment

Shunsuke YAGAI, Masato OGUCHI, Miyuki NAKANO, Saneyasu YAMAGUCHI

Full Text Views

0

Share
Cite this

Summary :

In data centers, large numbers of computers are run simultaneously. These computers consume an enormous amount of energy. Several challenges related to this issue have been published. An energy-efficient storage management method that cooperates with applications was one effective approach. In this method, data and storage devices are managed using application support and the power consumption of storage devices is significantly decreased. However, existing studies do not take the virtualized environment into account. Recently, many data-intensive applications have been run in a virtualized environment, such as the cloud computing environment. In this paper, we focus on a virtualized environment wherein multiple virtual machines run on a physical computer and a data intensive application runs on each virtual machine. We discuss a method for reducing storage device power consumption using application support. First, we propose two storage management methods using application information. One method optimizes the inter-HDD file layout. This method removes frequently-accessed files from a certain HDD and switches the HDD to power-off mode. To balance loads and reduce seek distances, this method separates a heavily accessed file and consolidates files in a virtual machine with low access frequency. The other method optimizes the intra-HDD file layout, in addition to performing inter-HDD optimization. This method places frequently accessed files near each other. Second, we present our experimental results and demonstrate that the proposed methods can create sufficiently long HDD access intervals that power-off mode can be used, and thereby, reduce the power consumption of storage devices.

Publication: IEICE TRANSACTIONS on Information Vol.E100-D No.12 pp.2761-2770

Publication Date: 2017/12/01

Publicized: 2017/07/14

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2017PAP0003

Type of Manuscript: Special Section PAPER (Special Section on Parallel and Distributed Computing and Networking)

Category: Database system

Authors

Shunsuke YAGAI
  FUJITSU SYSTEMS WEB TECHNOLOGY LIMITED
Masato OGUCHI
  Ochanomizu University
Miyuki NAKANO
  Adcanced Institute of Industrial Technology
Saneyasu YAMAGUCHI
  Kogakuin University

Keyword

power consumption, storage, virtualized environment, DBMS

Cite this

Copy

Shunsuke YAGAI, Masato OGUCHI, Miyuki NAKANO, Saneyasu YAMAGUCHI, "Power-Effective File Layout Based on Large Scale Data-Intensive Application in Virtualized Environment" in IEICE TRANSACTIONS on Information, vol. E100-D, no. 12, pp. 2761-2770, December 2017, doi: 10.1587/transinf.2017PAP0003.
Abstract: In data centers, large numbers of computers are run simultaneously. These computers consume an enormous amount of energy. Several challenges related to this issue have been published. An energy-efficient storage management method that cooperates with applications was one effective approach. In this method, data and storage devices are managed using application support and the power consumption of storage devices is significantly decreased. However, existing studies do not take the virtualized environment into account. Recently, many data-intensive applications have been run in a virtualized environment, such as the cloud computing environment. In this paper, we focus on a virtualized environment wherein multiple virtual machines run on a physical computer and a data intensive application runs on each virtual machine. We discuss a method for reducing storage device power consumption using application support. First, we propose two storage management methods using application information. One method optimizes the inter-HDD file layout. This method removes frequently-accessed files from a certain HDD and switches the HDD to power-off mode. To balance loads and reduce seek distances, this method separates a heavily accessed file and consolidates files in a virtual machine with low access frequency. The other method optimizes the intra-HDD file layout, in addition to performing inter-HDD optimization. This method places frequently accessed files near each other. Second, we present our experimental results and demonstrate that the proposed methods can create sufficiently long HDD access intervals that power-off mode can be used, and thereby, reduce the power consumption of storage devices.
URL: https://globals.ieice.org/en_transactions/information/10.1587/transinf.2017PAP0003/_p

Copy

@ARTICLE{e100-d_12_2761,
author={Shunsuke YAGAI, Masato OGUCHI, Miyuki NAKANO, Saneyasu YAMAGUCHI, },
journal={IEICE TRANSACTIONS on Information},
title={Power-Effective File Layout Based on Large Scale Data-Intensive Application in Virtualized Environment},
year={2017},
volume={E100-D},
number={12},
pages={2761-2770},
abstract={In data centers, large numbers of computers are run simultaneously. These computers consume an enormous amount of energy. Several challenges related to this issue have been published. An energy-efficient storage management method that cooperates with applications was one effective approach. In this method, data and storage devices are managed using application support and the power consumption of storage devices is significantly decreased. However, existing studies do not take the virtualized environment into account. Recently, many data-intensive applications have been run in a virtualized environment, such as the cloud computing environment. In this paper, we focus on a virtualized environment wherein multiple virtual machines run on a physical computer and a data intensive application runs on each virtual machine. We discuss a method for reducing storage device power consumption using application support. First, we propose two storage management methods using application information. One method optimizes the inter-HDD file layout. This method removes frequently-accessed files from a certain HDD and switches the HDD to power-off mode. To balance loads and reduce seek distances, this method separates a heavily accessed file and consolidates files in a virtual machine with low access frequency. The other method optimizes the intra-HDD file layout, in addition to performing inter-HDD optimization. This method places frequently accessed files near each other. Second, we present our experimental results and demonstrate that the proposed methods can create sufficiently long HDD access intervals that power-off mode can be used, and thereby, reduce the power consumption of storage devices.},
keywords={},
doi={10.1587/transinf.2017PAP0003},
ISSN={1745-1361},
month={December},}

Copy

TY - JOUR
TI - Power-Effective File Layout Based on Large Scale Data-Intensive Application in Virtualized Environment
T2 - IEICE TRANSACTIONS on Information
SP - 2761
EP - 2770
AU - Shunsuke YAGAI
AU - Masato OGUCHI
AU - Miyuki NAKANO
AU - Saneyasu YAMAGUCHI
PY - 2017
DO - 10.1587/transinf.2017PAP0003
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E100-D
IS - 12
JA - IEICE TRANSACTIONS on Information
Y1 - December 2017
AB - In data centers, large numbers of computers are run simultaneously. These computers consume an enormous amount of energy. Several challenges related to this issue have been published. An energy-efficient storage management method that cooperates with applications was one effective approach. In this method, data and storage devices are managed using application support and the power consumption of storage devices is significantly decreased. However, existing studies do not take the virtualized environment into account. Recently, many data-intensive applications have been run in a virtualized environment, such as the cloud computing environment. In this paper, we focus on a virtualized environment wherein multiple virtual machines run on a physical computer and a data intensive application runs on each virtual machine. We discuss a method for reducing storage device power consumption using application support. First, we propose two storage management methods using application information. One method optimizes the inter-HDD file layout. This method removes frequently-accessed files from a certain HDD and switches the HDD to power-off mode. To balance loads and reduce seek distances, this method separates a heavily accessed file and consolidates files in a virtual machine with low access frequency. The other method optimizes the intra-HDD file layout, in addition to performing inter-HDD optimization. This method places frequently accessed files near each other. Second, we present our experimental results and demonstrate that the proposed methods can create sufficiently long HDD access intervals that power-off mode can be used, and thereby, reduce the power consumption of storage devices.
ER -