HOME > Detail View

Detail View

Effects of avatar's visual form and environment adaptation in mixed reality tele-conference systems

Effects of avatar's visual form and environment adaptation in mixed reality tele-conference systems

Material type
학위논문
Personal Author
조동식 趙東植
Title Statement
Effects of avatar's visual form and environment adaptation in mixed reality tele-conference systems / Dongsik Jo
Publication, Distribution, etc
Seoul :   Graduate School, Korea University,   2017  
Physical Medium
xv, 113장 : 삽화(일부천연색), 도표 ; 26 cm
기타형태 저록
Effects of avatar's visual form and environment adaptation in mixed reality tele-conference systems   (DCOLL211009)000000076446  
학위논문주기
학위논문(박사)-- 고려대학교 대학원: 컴퓨터·전파통신공학과, 2017. 8
학과코드
0510   6YD36   332  
General Note
지도교수: 金政賢  
Bibliography, Etc. Note
참고문헌: 장 102-110
이용가능한 다른형태자료
PDF 파일로도 이용가능;   Requires PDF file reader(application/pdf)  
비통제주제어
혼합현실 , 아바타 , Tele-conference , 증강현실,,
000 00000nam c2200205 c 4500
001 000045915415
005 20171012171250
007 ta
008 170627s2017 ulkad bmAC 000c eng
040 ▼a 211009 ▼c 211009 ▼d 211009
085 0 ▼a 0510 ▼2 KDCP
090 ▼a 0510 ▼b 6YD36 ▼c 332
100 1 ▼a 조동식 ▼g 趙東植
245 1 0 ▼a Effects of avatar's visual form and environment adaptation in mixed reality tele-conference systems / ▼d Dongsik Jo
260 ▼a Seoul : ▼b Graduate School, Korea University, ▼c 2017
300 ▼a xv, 113장 : ▼b 삽화(일부천연색), 도표 ; ▼c 26 cm
500 ▼a 지도교수: 金政賢
502 1 ▼a 학위논문(박사)-- ▼b 고려대학교 대학원: ▼c 컴퓨터·전파통신공학과, ▼d 2017. 8
504 ▼a 참고문헌: 장 102-110
530 ▼a PDF 파일로도 이용가능; ▼c Requires PDF file reader(application/pdf)
653 ▼a 혼합현실 ▼a 아바타 ▼a Tele-conference ▼a 증강현실
776 0 ▼t Effects of avatar's visual form and environment adaptation in mixed reality tele-conference systems ▼w (DCOLL211009)000000076446
900 1 0 ▼a Jo, Dong-sik, ▼e
900 1 0 ▼a 김정현 ▼g 金政賢, ▼e 지도교수
900 1 0 ▼a Kim, Joung-hyun, ▼e 지도교수
945 ▼a KLPA

Electronic Information

No. Title Service
1
Effects of avatar's visual form and environment adaptation in mixed reality tele-conference systems (40회 열람)
View PDF Abstract Table of Contents

Holdings Information

No. Location Call Number Accession No. Availability Due Date Make a Reservation Service
No. 1 Location Science & Engineering Library/Stacks(Thesis)/ Call Number 0510 6YD36 332 Accession No. 123056937 Availability Available Due Date Make a Reservation Service B M

Contents information

Abstract

With the continued technology innovation in 3D avatar reconstruction for easier live capture of humans and more viable methods of human tracking to present animated avatars, traditional 2D video-based tele-conference systems are evolving into immersive and interactive 3D mixed reality (MR) based on which one can communicate with the teleported and remote other as if present, moving and interacting naturally in the same location. Compared to the traditional 2D tele-conference systems which offer only flat 2D upper body imageries, mostly a fixed view point, and inconsistent gaze directions, a shared MR tele-conference system situated in an augmented space with 3D teleported avatars would be more natural and realistic, and the system can give an enhanced and immersive communication experience. 

In such MR development, 3D teleported avatars to construct more natural tele-conference systems like talking to real people need to consider two aspects: the represented way to maximize quality of conversation in the situation of talking with participants in front of the position, and placement to the specific location in remote sites.

Then, one important quality of the tele-collaboration system is how to improve the tele-conference experience and collaboration through the sense of co-presence and trust as felt by the participating users with the teleported avatar. Also, another central concern is the need to resolve the differences in the physical environments between two sites and the teleported avatar’s motion anomaly between the remote site and the local one. For instance, the human controller is interacting at one (e.g. sitting on a low chair) and the teleported avatar is being displayed at the other (e.g. augmented on a high chair). 

In this thesis, first, we experimentally investigated the effects of the teleported 3D avatar’s visual forms (photo-realistically reconstructed vs. pre-built 3D avatar) and the form of background (traditional 2D video vs. 3D VR vs. 3D MR) on the sense of co-presence with tele-conference prototypes. Note that the video-typed background in 2D flat screen was compared as a reference. Second, we carried out a preliminary study comparing the level of trust toward the effectiveness in communication performance of 3D MR tele-conference systems. 

In addition, to express the teleported avatar to overcome environmental differences between remote sites, we presented a novel method to first establish a spatial and object-level match between the remote and local sites, and a method to align the position and adapt the motion of the teleported avatar according to the matched information in the physical configuration of the other site. The adaptation technique is based on preserving a spatial property using the avatar and its interaction objects between the two sites. 

In the experiment, our study in terms of co-presence of background types showed that participants generally exhibited a higher sense of co-presence when situated with a MR environment by the real background, and they showed greater confidence/trust when interacting with a realistically reconstructed avatar in the avatar’s visual forms. 

Also, to adapt the teleported avatar’s position and motion, we have developed a test prototype to demonstrate our approach using the Kinect-based human tracking and a video see-through head-mounted display, and techniques for scene matching and adapting the teleported avatar’s motions to the remote site configuration in real-time. The spatial relationship between two sites is pre-established between the important joint positions of the user/avatar and carefully selected points on the environment interaction objects. The motions of the user transmitted to the other site are then modified in real-time considering the “changed” environment object and preserving the spatial relationship as much as possible.

In the near future, our results will be able to help the design of more effective tele-conference and collaborative systems, and participants can a natural looking with spatially correct rendering of the remote user in the augmented space to provide a significantly improved tele-conference experience and communication performance.

Table of Contents

Chapter 1.	Introduction
1.1 Motivation
1.2 Research Areas
1.2.1 Co-presence: Comparison of Avatar’s Visual Forms and the Types of Background on User’s Co-presence in Tele-conference Systems
1.2.2 Trust: Effects of Avatar’s Visual Form and the Types of Background on Users’ Trust in MR Tele-conference Systems
1.2.3 Adaptive Control of the Teleported Avatar for Improved MR Tele-conference Experience
1.3 Thesis Aims and Contributions
1.3.1 Publications
1.4 Overview of Thesis Structure
1.5 Definition of Terms
Chapter 2.	Related Work
2.1 Introduction
2.2 Collaborative VR/AR/MR Tele-conference Systems
2.3 Virtual Avatars in Tele-conference Systems
2.4 Co-presence and Trust Evaluation of Virtual Avatars
2.5 Corresponding Matching and Avatar Motion Adaptation for Tele-conference Systems
2.6 Summary
Chapter 3.	Co-presence: Comparison of Avatar’s Visual Forms and the Types of Background on User’s Co-presence in Tele-conference Systems
3.1 Experimental Design
3.2 Experimental Setup
3.3 Detailed Task and Procedure
3.4 Hypotheses
3.5 Results
3.6 Summary and Discussion
Chapter 4.	Trust: Effects of Avatar’s Visual Form and the Type of Background on Users’ Trust in MR Tele-conference Systems
4.1 Experimental Design
4.2. Experimental Setup
4.3 Experimental Task and Procedure
4.4 Hypotheses
4.5 Results
4.6 Summary and Discussion
Chapter 5.	Adaptive Control of the Teleported Avatar in Improved MR Tele-conference Experience
5.1 Overview of Environment Adaptation with the Teleported Avatar
5.2 Scene Matching
5.3 Adaptive Control of the Teleported Avatar
5.3.1 Global Motion Adaptation: Gross Avatar Positioning
5.3.2 Local Motion Adaptation: Detailed Avatar Motion against the Interaction Object
5.4 Effects of Avatar’s Adaptation to the Enhanced Tele-conference Experience
5.4.1 Experimental Design
5.4.2 Experimental Task
5.4.3 Detailed Procedure
5.4.4 Results
5.5 Summary
Chapter 6.	Conclusions and Future Work
6.1 Summary
6.2 Future Work
References