首页 | 本学科首页   官方微博 | 高级检索  
     

On-line Free-viewpoint Video: From Single to Multiple View Rendering
作者单位:Graduate School of Science and Technology Keio University,Graduate School of Science and Technology,Keio University,Kohoku-ku 223-8522,Japan,Kohoku-ku 223-8522,Japan
基金项目:This work was supported by Foundation of Technology Supporting the Creation of Digital Media Contents project (CREST, JST), Japan
摘    要:In recent years, many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering (VBR) methods. But actually, only a few of them can render new views on-line. We present a new VBR system that creates new views of a live dynamic scene. This system provides high quality images and does not require any background subtraction. Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware, graphics processing unit (GPU). Only one computer is used for both acquisition and rendering. The video stream acquisition is performed by at least 3 webcams. We propose an additional video stream management that extends the number of webcams to 10 or more. These considerations make our system low-cost and hence accessible for everyone. We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time. Our system is especially designed for stereovision using autostereoscopic displays. The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to a mobile phone. Using GPU programming, our method provides up to 16 images of the scene in real-time. The use of both GPU and CPU makes this method work on only one consumer grade computer.

关 键 词:在线视频  图像处理  图像插补  自动立体视觉
收稿时间:2007-12-25
修稿时间:2007-03-18

On-line free-viewpoint video: From single to multiple view rendering
Vincent Nozick,Hideo Saito. On-line free-viewpoint video: From single to multiple view rendering[J]. International Journal of Automation and computing, 2008, 5(3): 257-267. DOI: 10.1007/s11633-008-0257-y
Authors:Vincent Nozick  Hideo Saito
Affiliation:Graduate School of Science and Technology, Keio University, Kohoku-ku 223-8522, Japan
Abstract:In recent years,many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering(VBR) methods.But actually,only few of them can render new views on-line.We present a new VBR system that creates new views of a dynamic scene in live.This system provides high quality images and does not require any background subtraction.Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware,graphics processing unit(GPU).Only one computer is used for both acquisition and rendering.The video stream acquisition is performed by at least 3 webcams.We propose an additional video stream management that extends the number of webcams to 10 or more.These considerations make our system low-cost and hence accessible for everyone.We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time.Our system is especially designed for stereovision using autostereoscopic displays.The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to the mobile phone.Due to GPU programming,our method provides up to 16 images of the scene in real-time.The use of both GPU and CPU makes this method work on only one consumer grade computer.
Keywords:Video-based rendering(VBR)  free-viewpoint video  view interpolation  graphics processing unit(GPU)  webcam  stere-ovision  autostereoscopic
本文献已被 CNKI 维普 万方数据 SpringerLink 等数据库收录!
点击此处可从《国际自动化与计算杂志》浏览原始摘要信息
点击此处可从《国际自动化与计算杂志》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号