Content Espresso: A Distributed Large File Sharing System for Digital Content Productions

Daisuke ANDO; Fumio TERAOKA; Kunitake KANEKO

doi:10.1587/transinf.2017EDP7048

Content Espresso: A Distributed Large File Sharing System for Digital Content Productions

Daisuke ANDO, Fumio TERAOKA, Kunitake KANEKO

Full Text Views

0

Share
Cite this

Summary :

With rapid growth of producing high-resolution digital contents such as Full HD, 4K, and 8K movies, the demand for low cost and high throughput sharing of content files is increasing at digital content productions. In order to meet this demand, we have proposed DRIP (Distributed chunks Retrieval and Integration Procedure), a storage and retrieval mechanism for large file sharing using forward error correction (FEC) and global dispersed storage. DRIP was confirmed that it contributes to low cost and high throughput sharing. This paper describes the design and implementation of Content Espresso, a distributed large file sharing system for digital content productions using DRIP, and presents performance evaluations. We set up experimental environment using 79 physical machines including 72 inexpensive storage servers, and evaluate file metadata access performance, file storage/retrieval performance, FEC block size, and system availability by emulating global environments. The results confirm that Content Espresso has capability to deal with 15,000 requests per second, achieves 1 Gbps for file storage, and achieves more than 3 Gbps for file retrieval. File storage and retrieval performance are not significantly affected by the network conditions. Thus, we conclude that Content Espresso is capable of a global scale file sharing system for digital content productions.

Publication: IEICE TRANSACTIONS on Information Vol.E100-D No.9 pp.2100-2117

Publication Date: 2017/09/01

Publicized: 2017/06/19

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2017EDP7048

Type of Manuscript: PAPER

Category: Information Network

Authors

Daisuke ANDO
  Keio University
Fumio TERAOKA
  Keio University
Kunitake KANEKO
  Keio University

Keyword

distributed storage system, UDP data transmission, FEC, file sharing

Cite this

Copy

Daisuke ANDO, Fumio TERAOKA, Kunitake KANEKO, "Content Espresso: A Distributed Large File Sharing System for Digital Content Productions" in IEICE TRANSACTIONS on Information, vol. E100-D, no. 9, pp. 2100-2117, September 2017, doi: 10.1587/transinf.2017EDP7048.
Abstract: With rapid growth of producing high-resolution digital contents such as Full HD, 4K, and 8K movies, the demand for low cost and high throughput sharing of content files is increasing at digital content productions. In order to meet this demand, we have proposed DRIP (Distributed chunks Retrieval and Integration Procedure), a storage and retrieval mechanism for large file sharing using forward error correction (FEC) and global dispersed storage. DRIP was confirmed that it contributes to low cost and high throughput sharing. This paper describes the design and implementation of Content Espresso, a distributed large file sharing system for digital content productions using DRIP, and presents performance evaluations. We set up experimental environment using 79 physical machines including 72 inexpensive storage servers, and evaluate file metadata access performance, file storage/retrieval performance, FEC block size, and system availability by emulating global environments. The results confirm that Content Espresso has capability to deal with 15,000 requests per second, achieves 1 Gbps for file storage, and achieves more than 3 Gbps for file retrieval. File storage and retrieval performance are not significantly affected by the network conditions. Thus, we conclude that Content Espresso is capable of a global scale file sharing system for digital content productions.
URL: https://globals.ieice.org/en_transactions/information/10.1587/transinf.2017EDP7048/_p

Copy

@ARTICLE{e100-d_9_2100,
author={Daisuke ANDO, Fumio TERAOKA, Kunitake KANEKO, },
journal={IEICE TRANSACTIONS on Information},
title={Content Espresso: A Distributed Large File Sharing System for Digital Content Productions},
year={2017},
volume={E100-D},
number={9},
pages={2100-2117},
abstract={With rapid growth of producing high-resolution digital contents such as Full HD, 4K, and 8K movies, the demand for low cost and high throughput sharing of content files is increasing at digital content productions. In order to meet this demand, we have proposed DRIP (Distributed chunks Retrieval and Integration Procedure), a storage and retrieval mechanism for large file sharing using forward error correction (FEC) and global dispersed storage. DRIP was confirmed that it contributes to low cost and high throughput sharing. This paper describes the design and implementation of Content Espresso, a distributed large file sharing system for digital content productions using DRIP, and presents performance evaluations. We set up experimental environment using 79 physical machines including 72 inexpensive storage servers, and evaluate file metadata access performance, file storage/retrieval performance, FEC block size, and system availability by emulating global environments. The results confirm that Content Espresso has capability to deal with 15,000 requests per second, achieves 1 Gbps for file storage, and achieves more than 3 Gbps for file retrieval. File storage and retrieval performance are not significantly affected by the network conditions. Thus, we conclude that Content Espresso is capable of a global scale file sharing system for digital content productions.},
keywords={},
doi={10.1587/transinf.2017EDP7048},
ISSN={1745-1361},
month={September},}

Copy

TY - JOUR
TI - Content Espresso: A Distributed Large File Sharing System for Digital Content Productions
T2 - IEICE TRANSACTIONS on Information
SP - 2100
EP - 2117
AU - Daisuke ANDO
AU - Fumio TERAOKA
AU - Kunitake KANEKO
PY - 2017
DO - 10.1587/transinf.2017EDP7048
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E100-D
IS - 9
JA - IEICE TRANSACTIONS on Information
Y1 - September 2017
AB - With rapid growth of producing high-resolution digital contents such as Full HD, 4K, and 8K movies, the demand for low cost and high throughput sharing of content files is increasing at digital content productions. In order to meet this demand, we have proposed DRIP (Distributed chunks Retrieval and Integration Procedure), a storage and retrieval mechanism for large file sharing using forward error correction (FEC) and global dispersed storage. DRIP was confirmed that it contributes to low cost and high throughput sharing. This paper describes the design and implementation of Content Espresso, a distributed large file sharing system for digital content productions using DRIP, and presents performance evaluations. We set up experimental environment using 79 physical machines including 72 inexpensive storage servers, and evaluate file metadata access performance, file storage/retrieval performance, FEC block size, and system availability by emulating global environments. The results confirm that Content Espresso has capability to deal with 15,000 requests per second, achieves 1 Gbps for file storage, and achieves more than 3 Gbps for file retrieval. File storage and retrieval performance are not significantly affected by the network conditions. Thus, we conclude that Content Espresso is capable of a global scale file sharing system for digital content productions.
ER -