Free-viewpoint depth image based rendering |
| |
| Authors: | S Zinger L Do PHN de With |
| |
| Affiliation: | 1. Eindhoven University of Technology, P.O. Box 513, 5600 MB Eindhoven, The Netherlands;2. Cyclomedia Technology B.V., P.O. Box 68, 4180 BB Waardenburg, The Netherlands;1. Dept. Electronics & Comp. Engin., Korea University, 5-1 Anam-dong, Sungbuk-gu, Seoul, Republic of Korea;2. Dept. of Electronics, Nagoya University, Furo-cho, Chikusa-ku, Nagoya, 464, Japan;3. Dept. of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, 1406 W Green St - 702, Urbana, IL 61801-2991, Illinois, United States;4. Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, Einsteinufer 37, Berlin, 10587, Germany;5. General Mitsubishi Electric Research Laboratories, 201 Broadway, Cambridge, MA 02139, Massachusetts, United States |
| |
| Abstract: | In 3D TV research, one approach is to employ multiple cameras for creating a 3D multi-view signal with the aim to make interactive free-viewpoint selection possible in 3D TV media. This paper explores a new rendering algorithm that enables to compute a free-viewpoint between two reference views from existing cameras. A unique property is that we perform forward warping for both texture and depth simultaneously. Advantages of our rendering are manyfold. First, resampling artifacts are filled in by inverse warping. Second, disocclusions are processed while omitting warping of edges at high discontinuities. Third, our disocclusion inpainting approach explicitly uses depth information. We obtain an average PSNR gain of 3 dB and 4.5 dB for the ‘Breakdancers’ and ‘Ballet’ sequences, respectively, compared recently published results. Moreover, experiments are performed using compressed video from surrounding cameras. The overall system quality is dominated by rendering quality and not by coding. |
| |
| Keywords: | |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
