A High Presence Shared Space Communication System Using 2D Background and 3D Avatar

Kyohei YOSHIKAWA; Takashi MACHIDA; Kiyoshi KIYOKAWA; Haruo TAKEMURA

A High Presence Shared Space Communication System Using 2D Background and 3D Avatar

Kyohei YOSHIKAWA, Takashi MACHIDA, Kiyoshi KIYOKAWA, Haruo TAKEMURA

Full Text Views

0

Share
Cite this

Summary :

Displaying a 3D geometric model of a user in real time is an advantage for a telecommunication system because depth information is useful for nonverbal communication such as finger-pointing and gesturing that contain 3D information. However, the range image acquired by a rangefinder suffers from errors due to image noises and distortions in depth measurement. On the other hand, a 2D image is free from such errors. In this paper, we propose a new method for a shared space communication system that combines the advantages of both 2D and 3D representations. A user is represented as a 3D geometric model in order to exchange nonverbal communication cues. A background is displayed as a 2D image to give the user adequate information about the environment of the remote site. Additionally, a high-resolution texture taken by a video camera is projected onto the 3D geometric model of the user. This is done because the low resolution of the image acquired by the rangefinder makes it difficult to exchange facial expressions. Furthermore, to fill in the data occluded by the user, old pixel values are used for the user area in the 2D background image. We have constructed a prototype of a high presence shared space communication system based on our method. Through a number of experiments, we have found that our method is more effective for telecommunication than a method with only a 2D or 3D representation.

Publication: IEICE TRANSACTIONS on Information Vol.E87-D No.12 pp.2532-2539

Publication Date: 2004/12/01

Publicized

Online ISSN

DOI

Type of Manuscript: Special Section INVITED PAPER (Special Section on New Technologies and their Applications of the Internet)

Category

Cite this

Copy

Kyohei YOSHIKAWA, Takashi MACHIDA, Kiyoshi KIYOKAWA, Haruo TAKEMURA, "A High Presence Shared Space Communication System Using 2D Background and 3D Avatar" in IEICE TRANSACTIONS on Information, vol. E87-D, no. 12, pp. 2532-2539, December 2004, doi: .
Abstract: Displaying a 3D geometric model of a user in real time is an advantage for a telecommunication system because depth information is useful for nonverbal communication such as finger-pointing and gesturing that contain 3D information. However, the range image acquired by a rangefinder suffers from errors due to image noises and distortions in depth measurement. On the other hand, a 2D image is free from such errors. In this paper, we propose a new method for a shared space communication system that combines the advantages of both 2D and 3D representations. A user is represented as a 3D geometric model in order to exchange nonverbal communication cues. A background is displayed as a 2D image to give the user adequate information about the environment of the remote site. Additionally, a high-resolution texture taken by a video camera is projected onto the 3D geometric model of the user. This is done because the low resolution of the image acquired by the rangefinder makes it difficult to exchange facial expressions. Furthermore, to fill in the data occluded by the user, old pixel values are used for the user area in the 2D background image. We have constructed a prototype of a high presence shared space communication system based on our method. Through a number of experiments, we have found that our method is more effective for telecommunication than a method with only a 2D or 3D representation.
URL: https://globals.ieice.org/en_transactions/information/10.1587/e87-d_12_2532/_p

Copy

@ARTICLE{e87-d_12_2532,
author={Kyohei YOSHIKAWA, Takashi MACHIDA, Kiyoshi KIYOKAWA, Haruo TAKEMURA, },
journal={IEICE TRANSACTIONS on Information},
title={A High Presence Shared Space Communication System Using 2D Background and 3D Avatar},
year={2004},
volume={E87-D},
number={12},
pages={2532-2539},
abstract={Displaying a 3D geometric model of a user in real time is an advantage for a telecommunication system because depth information is useful for nonverbal communication such as finger-pointing and gesturing that contain 3D information. However, the range image acquired by a rangefinder suffers from errors due to image noises and distortions in depth measurement. On the other hand, a 2D image is free from such errors. In this paper, we propose a new method for a shared space communication system that combines the advantages of both 2D and 3D representations. A user is represented as a 3D geometric model in order to exchange nonverbal communication cues. A background is displayed as a 2D image to give the user adequate information about the environment of the remote site. Additionally, a high-resolution texture taken by a video camera is projected onto the 3D geometric model of the user. This is done because the low resolution of the image acquired by the rangefinder makes it difficult to exchange facial expressions. Furthermore, to fill in the data occluded by the user, old pixel values are used for the user area in the 2D background image. We have constructed a prototype of a high presence shared space communication system based on our method. Through a number of experiments, we have found that our method is more effective for telecommunication than a method with only a 2D or 3D representation.},
keywords={},
doi={},
ISSN={},
month={December},}

Copy

TY - JOUR
TI - A High Presence Shared Space Communication System Using 2D Background and 3D Avatar
T2 - IEICE TRANSACTIONS on Information
SP - 2532
EP - 2539
AU - Kyohei YOSHIKAWA
AU - Takashi MACHIDA
AU - Kiyoshi KIYOKAWA
AU - Haruo TAKEMURA
PY - 2004
DO -
JO - IEICE TRANSACTIONS on Information
SN -
VL - E87-D
IS - 12
JA - IEICE TRANSACTIONS on Information
Y1 - December 2004
AB - Displaying a 3D geometric model of a user in real time is an advantage for a telecommunication system because depth information is useful for nonverbal communication such as finger-pointing and gesturing that contain 3D information. However, the range image acquired by a rangefinder suffers from errors due to image noises and distortions in depth measurement. On the other hand, a 2D image is free from such errors. In this paper, we propose a new method for a shared space communication system that combines the advantages of both 2D and 3D representations. A user is represented as a 3D geometric model in order to exchange nonverbal communication cues. A background is displayed as a 2D image to give the user adequate information about the environment of the remote site. Additionally, a high-resolution texture taken by a video camera is projected onto the 3D geometric model of the user. This is done because the low resolution of the image acquired by the rangefinder makes it difficult to exchange facial expressions. Furthermore, to fill in the data occluded by the user, old pixel values are used for the user area in the 2D background image. We have constructed a prototype of a high presence shared space communication system based on our method. Through a number of experiments, we have found that our method is more effective for telecommunication than a method with only a 2D or 3D representation.
ER -