An Integrated Hole-Filling Algorithm for View Synthesis

Wenxin YU; Weichen WANG; Minghui WANG; Satoshi GOTO

doi:10.1587/transfun.E96.A.1306

An Integrated Hole-Filling Algorithm for View Synthesis

Wenxin YU, Weichen WANG, Minghui WANG, Satoshi GOTO

Full Text Views

0

Share
Cite this

Summary :

Multi-view video can provide users with three-dimensional (3-D) and virtual reality perception through multiple viewing angles. In recent years, depth image-based rendering (DIBR) has been generally used to synthesize virtual view images in free viewpoint television (FTV) and 3-D video. To conceal the zero-region more accurately and improve the quality of a virtual view synthesized frame, an integrated hole-filling algorithm for view synthesis is proposed in this paper. The proposed algorithm contains five parts: an algorithm for distinguishing different regions, foreground and background boundary detection, texture image isophotes detection, a textural and structural isophote prediction algorithm, and an in-painting algorithm with gradient priority order. Based on the texture isophote prediction with a geometrical principle and the in-painting algorithm with a gradient priority order, the boundary information of the foreground is considerably clearer and the texture information in the zero-region can be concealed much more accurately than in previous works. The vision quality mainly depends on the distortion of the structural information. Experimental results indicate that the proposed algorithm improves not only the objective quality of the virtual image, but also its subjective quality considerably; human vision is also clearly improved based on the subjective results. In particular, the algorithm ensures the boundary contours of the foreground objects and the textural and structural information.

Publication: IEICE TRANSACTIONS on Fundamentals Vol.E96-A No.6 pp.1306-1314

Publication Date: 2013/06/01

Publicized

Online ISSN: 1745-1337

DOI: 10.1587/transfun.E96.A.1306

Type of Manuscript: Special Section PAPER (Special Section on Circuit, System, and Computer Technologies)

Category

Authors

Wenxin YU
  Waseda University
Weichen WANG
  Waseda University
Minghui WANG
  Waseda University
Satoshi GOTO
  Waseda University

Keyword

DIBR, virtual view, hole-filling, in-painting

Cite this

Copy

Wenxin YU, Weichen WANG, Minghui WANG, Satoshi GOTO, "An Integrated Hole-Filling Algorithm for View Synthesis" in IEICE TRANSACTIONS on Fundamentals, vol. E96-A, no. 6, pp. 1306-1314, June 2013, doi: 10.1587/transfun.E96.A.1306.
Abstract: Multi-view video can provide users with three-dimensional (3-D) and virtual reality perception through multiple viewing angles. In recent years, depth image-based rendering (DIBR) has been generally used to synthesize virtual view images in free viewpoint television (FTV) and 3-D video. To conceal the zero-region more accurately and improve the quality of a virtual view synthesized frame, an integrated hole-filling algorithm for view synthesis is proposed in this paper. The proposed algorithm contains five parts: an algorithm for distinguishing different regions, foreground and background boundary detection, texture image isophotes detection, a textural and structural isophote prediction algorithm, and an in-painting algorithm with gradient priority order. Based on the texture isophote prediction with a geometrical principle and the in-painting algorithm with a gradient priority order, the boundary information of the foreground is considerably clearer and the texture information in the zero-region can be concealed much more accurately than in previous works. The vision quality mainly depends on the distortion of the structural information. Experimental results indicate that the proposed algorithm improves not only the objective quality of the virtual image, but also its subjective quality considerably; human vision is also clearly improved based on the subjective results. In particular, the algorithm ensures the boundary contours of the foreground objects and the textural and structural information.
URL: https://globals.ieice.org/en_transactions/fundamentals/10.1587/transfun.E96.A.1306/_p

Copy

@ARTICLE{e96-a_6_1306,
author={Wenxin YU, Weichen WANG, Minghui WANG, Satoshi GOTO, },
journal={IEICE TRANSACTIONS on Fundamentals},
title={An Integrated Hole-Filling Algorithm for View Synthesis},
year={2013},
volume={E96-A},
number={6},
pages={1306-1314},
abstract={Multi-view video can provide users with three-dimensional (3-D) and virtual reality perception through multiple viewing angles. In recent years, depth image-based rendering (DIBR) has been generally used to synthesize virtual view images in free viewpoint television (FTV) and 3-D video. To conceal the zero-region more accurately and improve the quality of a virtual view synthesized frame, an integrated hole-filling algorithm for view synthesis is proposed in this paper. The proposed algorithm contains five parts: an algorithm for distinguishing different regions, foreground and background boundary detection, texture image isophotes detection, a textural and structural isophote prediction algorithm, and an in-painting algorithm with gradient priority order. Based on the texture isophote prediction with a geometrical principle and the in-painting algorithm with a gradient priority order, the boundary information of the foreground is considerably clearer and the texture information in the zero-region can be concealed much more accurately than in previous works. The vision quality mainly depends on the distortion of the structural information. Experimental results indicate that the proposed algorithm improves not only the objective quality of the virtual image, but also its subjective quality considerably; human vision is also clearly improved based on the subjective results. In particular, the algorithm ensures the boundary contours of the foreground objects and the textural and structural information.},
keywords={},
doi={10.1587/transfun.E96.A.1306},
ISSN={1745-1337},
month={June},}

Copy

TY - JOUR
TI - An Integrated Hole-Filling Algorithm for View Synthesis
T2 - IEICE TRANSACTIONS on Fundamentals
SP - 1306
EP - 1314
AU - Wenxin YU
AU - Weichen WANG
AU - Minghui WANG
AU - Satoshi GOTO
PY - 2013
DO - 10.1587/transfun.E96.A.1306
JO - IEICE TRANSACTIONS on Fundamentals
SN - 1745-1337
VL - E96-A
IS - 6
JA - IEICE TRANSACTIONS on Fundamentals
Y1 - June 2013
AB - Multi-view video can provide users with three-dimensional (3-D) and virtual reality perception through multiple viewing angles. In recent years, depth image-based rendering (DIBR) has been generally used to synthesize virtual view images in free viewpoint television (FTV) and 3-D video. To conceal the zero-region more accurately and improve the quality of a virtual view synthesized frame, an integrated hole-filling algorithm for view synthesis is proposed in this paper. The proposed algorithm contains five parts: an algorithm for distinguishing different regions, foreground and background boundary detection, texture image isophotes detection, a textural and structural isophote prediction algorithm, and an in-painting algorithm with gradient priority order. Based on the texture isophote prediction with a geometrical principle and the in-painting algorithm with a gradient priority order, the boundary information of the foreground is considerably clearer and the texture information in the zero-region can be concealed much more accurately than in previous works. The vision quality mainly depends on the distortion of the structural information. Experimental results indicate that the proposed algorithm improves not only the objective quality of the virtual image, but also its subjective quality considerably; human vision is also clearly improved based on the subjective results. In particular, the algorithm ensures the boundary contours of the foreground objects and the textural and structural information.
ER -