The Design and Construction of a Movable Image-Based Rendering System and Its Application to Multiview Conferencing |
| |
Authors: | S C Chan Z Y Zhu K T Ng C Wang S Zhang Z G Zhang Zhongfu Ye H Y Shum |
| |
Affiliation: | (1) Department of Electrical and Electronic Engineering, The University of Hong Kong, Pokfulam Road, Hong Kong, China;(2) University of Science and Technology of China, Hefei, People’s Republic of China;(3) Microsoft Corporation, Redmond, WA, USA |
| |
Abstract: | Image-based rendering (IBR) is an promising technology for rendering photo-realistic views of scenes from a collection of
densely sampled images or videos. It provides a framework for developing revolutionary virtual reality and immersive viewing
systems. While there has been considerable progress recently in the capturing, storage and transmission of image-based representations,
most multiple camera systems are designed to be stationary and hence their ability to cope with moving objects and dynamic
environment is somewhat limited. This paper studies the design and construction of a movable image-based rendering system
based on a class of dynamic representations called plenoptic videos, its associated video processing algorithms and an application
to multiview audio-visual conferencing. It is constructed by mounting a linear array of 8 video cameras on an electrically
controllable wheel chair and its motion is controllable manually or remotely through wireless LAN by means of additional hardware
circuitry. We also developed a real-time object tracking algorithm and utilize the motion information computed to adjust continuously
the azimuth or rotation angle of the movable IBR system in order to cope with a given moving object in a large environment.
Due to imperfection in tracking and mechanical vibration encountered in movable systems, the videos may appear very shaky
and a new video stabilization technique is proposed to overcome this problem. The usefulness of the system is illustrated
by means of a multiview conferencing application using a multiview TV display. Through this pilot study, we hope to disseminate
useful experience for the design and construction of movable IBR systems with improved viewing freedom and ability to cope
with moving object in a large environment. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|