Optical Flow Rendering |
| |
Authors: | Tae-Joon Park Sung Yong Shin & Seungyong Lee |
| |
Affiliation: | Department of Computer Science, Korea Advanced Institute of Science and Technology, Taejon, Korea,;Department of Computer Science and Engineering, Pohang University of Science and Technology, Pohang, Korea |
| |
Abstract: | This paper proposes a new approach to image-based rendering that generates an image viewed from an arbitrary camera position and orientation by rendering optical flows extracted from reference images. To derive valid optical flows, we develop an analysis technique that improves the quality of stereo matching. Without using any special equipments such as range cameras, this technique constructs reliable optical flows from a sequence of matching results between reference images. We also derive validity conditions of optical flows and show that the obtained flows satisfy those conditions. Since environment geometry is inferred from the optical flows, we are able to generate more accurate images with this additional geometric information. Our approach makes it possible to combine an image rendered from optical flows with an image generated by a conventional rendering technique through a simple Z-buffer algorithm. |
| |
Keywords: | image-based rendering optical flow stereo matching depth information warp function statistical analysis image composition |
|
|