Automatic Real-Time Video Matting Using Time-of-Flight Camera and Multichannel Poisson Equations |
| |
Authors: | Liang Wang Minglun Gong Chenxi Zhang Ruigang Yang Cha Zhang Yee-Hong Yang |
| |
Affiliation: | (1) Department of Computer Science, University of Kentucky, 329 Rose Street, Lexington, KY 40506, USA;(2) Department of Computer Science, Memorial University of Newfoundland, St. John’s, NL, A1B 3X5, Canada;(3) Microsoft Research, Redmond One Microsoft Way, Redmond, WA 98052, USA;(4) Department of Computing Science, University of Alberta, Edmonton, AB, T6G 2E8, Canada |
| |
Abstract: | This paper presents an automatic real-time video matting system. The proposed system consists of two novel components. In
order to automatically generate trimaps for live videos, we advocate a Time-of-Flight (TOF) camera-based approach to video
bilayer segmentation. Our algorithm combines color and depth cues in a probabilistic fusion framework. The scene depth information
returned by the TOF camera is less sensitive to environment changes, which makes our method robust to illumination variation,
dynamic background and camera motion. For the second step, we perform alpha matting based on the segmentation result. Our
matting algorithm uses a set of novel Poisson equations that are derived for handling multichannel color vectors, as well
as the depth information captured. Real-time processing speed is achieved through optimizing the algorithm for parallel processing
on graphics hardware. We demonstrate the effectiveness of our matting system on an extensive set of experimental results. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|