Semi-automatic 2D-to-3D video conversion based on background sprite generation |
| |
| Affiliation: | 1. Department of Electrical Engineering, National Chung Cheng University, Taiwan;2. Advanced Institute of Manufacturing with High-tech Innovations (AIM-HI), National Chung Cheng University, Taiwan;3. Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, Taiwan;1. Yango University, Fuzhou 350015, China;2. Department of Public Finance and Taxation, National Kaohsiung University of Science and Technology , Kaohsiung City, 80778, Taiwan;3. Department of International Business, National Kaohsiung University of Science and Technology, Kaohsiung City 80778, Taiwan;1. School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China;2. School of Mechanical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China;3. School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China;1. National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan 430072, China;2. Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University, Wuhan 430072, China;3. Collaborative Innovation Center of Geospatial Technology, Wuhan 430079, China;4. Wuhan University of Technology, Wuhan 430070, China |
| |
| Abstract: | This paper presents a technique for semi-automatic 2D-to-3D stereo video conversion, which is known to provide user intervention in assigning foreground/background depths for key frames and then get depth maps for non-key frames via automatic depth propagation. Our algorithm treats foreground and background separately. For foregrounds, kernel pixels are identified and then used as the seeds for graph-cut segmentation for each non-key frame independently, resulting in results not limited by objects’ motion activity. For backgrounds, all video frames, after foregrounds being removed, are integrated into a common background sprite model (BSM) based on a relay-frame-based image registration algorithm. Users can then draw background depths for BSM in an integrated manner, thus reducing human efforts significantly. Experimental results show that our method is capable of retaining more faithful foreground depth boundaries (by 1.6–2.7 dB) and smoother background depths than prior works. This advantage is helpful for 3D display and 3D perception. |
| |
| Keywords: | Stereo video conversion Depth propagation Graph cut Background sprite model |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
