基于GPU加速的深度图像绘制

基于深度图像的绘制(DIBR)广泛应用于虚拟视点的合成,但是目前实现DIBR的算法复杂度都比较高,很难较实时地应用到3DTV系统中。采用单路纹理图像和其对应的深度图像进行虚拟视点的合成,在图形处理单元(GPU)上应用CUDA(Compute Unified Device Architecture)技术实现了基于深度图像的绘制。通过在NVIDIA Telsa C2050图形卡上运行,绘制分辨力1 024×768和640×480的图像速率分别达到了15 f/s(帧/秒)和24 f/s,分别能够准实时或实时地应用到3DTV系统中;同时本文的绘制方法有效地节约了传输带宽,绘制图像的主观质量良好。     

基于虚拟场景的绘制算法

虚拟场景的绘制算法是计算机可视化的重要内容,传统的基于几何模型的绘制和基于图像的绘制不能很好地满足需求,因此考虑以不同模型为基元的绘制算法.详细介绍了点绘制方法、面绘制方法和体绘制方法,使用双目相机获取深度图像,并选用了代表性的算法进行实验,点绘制算法中质量和速率兼顾的自适应绘制算法,面绘制中简单易实现的MC算法,体绘...     

多视绘制中的空洞填充算法

绘制新视点的质量决定3D视频在显示终端的效果,为填充基于深度图像的绘制(DIBR)算法中产生的空洞,本文提出"双路纹理+双路深度"的多视绘制算法。首先,应用DIBR技术,通过左侧参考纹理图像和其对应的深度图像绘制虚拟视点图像,从经中值滤波后的虚拟图像绘制空洞掩膜图像;然后,将掩膜图像中的大空洞点坐标反变换到右侧参考纹理图像中对应的具体像素坐标,根据深度值判断得到的像素点是否属于背景区域,以此得到虚拟视点图像的空洞填充图像;最后,将空洞填充图像与左视经过DIBR得到的虚拟图像进行融合,填补大空洞,应用插值算法填充小的空洞。实验结果表明,本文方法可有效修复DIBR绘制过程中产生的空洞,得到质量较好的虚拟视点图像。     

基于虚拟曝光图像的立体高动态范围图像合成算法

本文提出基于多视点多曝光图像的立体高动态范围图像合成算法。首 先,考虑多视点多曝光 图像以及相机响应函数曲线的特性,提出一种虚拟曝光图像绘制算法,将不同曝光的图像绘 制到同一视点;然后, 为了使绘制曝光图像保留更多细节和结构,需要对绘制虚拟曝光图像进行空洞填补及边缘修 复,故引入了边缘差值 掩膜图,对图像边缘信息进行校正平滑处理;最后利用绘制的虚拟曝光图像合成立体高动态 范围图像。实验结果表 明,获得的绘制曝光图像与参考曝光视点图像之间的结构相似性高达0.99以上,且合成的 高动态范围图像质量高。     

高质量的虚拟视点图像的绘制方法

针对应用深度图像的绘制(DIBR)技术生成的虚拟视点图像中存在的空洞问题,提出了一种基于DIBR的高质量的虚拟视点图像绘制算法.先由多幅参考图像分别生成同一虚拟视点位置的多幅目标图像,将这些虚拟视点目标图像融合为含有少量空洞的目标图像.然后采用逆映射的方法在多幅参考图像中找到这些剩余少量空洞的对应内容并填充空洞,从而生成高质量的虚拟视点图像.实验结果表明最后生成的虚拟视点图像具有良好的视觉效果.     

基于体绘制思维的人脸识别算法优化研究

传统的人脸识别算法主要解决二维正面图像识别,如果人体姿态发生明显变化,或外界环境发生显著变化,则算法性能大大降低,无法获取准确的识别结果。体绘制算法针对三维数据场进行绘制,绘制的图像能够描述人脸的内部细节,可提高人脸识别精度。因此,提出一种基于体绘制思维的人脸识别算法,依据聚类思想对二维人脸库进行聚类,在各分类的基础上,构建人脸相似模型。通过错切变形体制算法,构建人脸体数据,实现人脸体数据坐标系统的转换以及人脸三维图像的合成,从人脸三维图像中采集人脸特征,利用相似性模型对人脸关键特征同数据库已有的特征进行匹配分析,完成人脸身份识别。实验结果说明,所提算法对于不同表情和不同光照条件下的人脸图像,都具有较高的识别率和鲁棒性。     

三维可视化技术在医学领域中的应用

在医学软件的开发过程中,实现三维重建技术的优劣是系统设计的难点和重点.在探讨面绘制与体绘制技术的基础上,使用OpenGL及VTK工具包完成可视化具体操作,并对其结果进行简要分析.利用患者髋关节CT数据,实施了基于OpenGL的Marching Cube算法、三维纹理映射算法,以及基于VTK的Marching Cube、Ray Casting算法,并对实现过程及实现效果进行了对比分析.基于OpenGL与基于VTK的面绘制技术及体绘制技术均能较好呈现患者髋关节的三维解剖结构信息.其中,面绘制可有效地绘制出三维体的表面,但缺乏内部信息的表达;体绘制真实感较好,但渲染速度较慢,不适合用于实时系统的表达.VTK可视化方法实现简单,适用于快速显示数据空间信息,但其三维交互功能不足;OpenGL属于底层API,可灵活完成各项交互操作及渲染任务,但其编码较为复杂.     

基于块的分级空洞填充技术

空洞填充技术是基于深度图像绘制(Depth Image Based Rendering,DIBR)的一种非常重要的后期处理技术,针对单路彩色加深度3D视频系统,提出了一种基于块的分级空洞填充技术,该技术首先将含有空洞的目标图像中的空洞区域分成两个等级,等级一为小空洞区域,等级二为大空洞区域。然后对两个等级的空洞分别进行处理,对于等级一区域的空洞直接利用块的均值来填充空洞;对于等级二区域的空洞,先在空洞区域的边缘产生一个含有空洞的块,然后搜索周围与之最匹配的块来填充当前块中的空洞。实验结果显示,相较于传统的邻域和仅仅使用块均值填充,分级空洞算法较好地改善了填充后图像的主观质量,且其客观性能也有一定的提升。     

基于颌面部CT图像重建的信息提取研究

近年来,随着现代计算机技术及图形图像技术的迅速发展,图像处理与分析技术开始广泛应用于医学图像的重建.本文实现对颌面部二维计算机断层扫描图像(computed tomography,CT)的读取与显示,进行中值平滑与增强等预处理,再基于阈值法分割图像,然后应用本文改进的基于序列图像的面绘制、体绘制算法,将对象进行可视化设置,实现三维模型的放缩、测量、剖切交互操作,最后应用该重建模型提出一种下颌骨线拟合方法.实验证明,本文方法较传统方法优化重建质量,保留更多完整细节,提高重建效率,在辅助诊断、手术引导、临床教学等领域具有一定的应用价值.     

VTK技术在雷达图像可视化中的研究与应用

利用VTK对雷达图像数据进行三维可视化研究,其中研究了表面绘制和体绘制两种绘制技术：表面绘刺用移动立方体法实现,体绘制用合成光线投影算法实现。实验高效快捷地显示了雷达二维图像,实现了雷迭四波数据的空间整体三维重建显示和x,y,z三维任意切面的雷达回波强度显示,并且可以任意方向切割、旋转、放大与平移三维图像。VTK应用于雷达图像三维可视化更为直观和全面的展现了空间回波的分布状况。     

A flexible architecture for multi-view 3DTV based on uncalibrated cameras

This paper presents a novel flexible architecture for 3DTV based on multiple uncalibrated cameras. The proposed signal representation improves the interactivity of dense point-based methods, making them appropriate for modeling the scene semantics and free-viewpoint 3DTV applications. The main concern is to address the shortcomings of depth image-based 3D video systems for free-viewpoint visualization, and to provide an efficient implementation of the rendering part which is computationally intensive as well potentially determine the view quality. Novel rendering algorithms are added that specifically aim at solving the rendering artifacts, and sampling issues encountered in wide baseline extensions and arbitrary camera movements. To optimize the process, a “selective” warping technique is proposed that takes the advantage of temporal coherence to reduce the computational overhead. Performance is illustrated on challenging videos to prove the suitability and flexibility of the architecture for advanced 3DTV systems.     

Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability

Due to enormous progress in the areas of auto-stereoscopic 3D displays, digital video broadcast and computer vision algorithms, 3D television (3DTV) has reached a high technical maturity and many people now believe in its readiness for marketing. Experimental prototypes of entire 3DTV processing chains have been demonstrated successfully during the last few years, and the motion picture experts group (MPEG) of ISO/IEC has launched related ad hoc groups and standardization efforts envisaging the emerging market segment of 3DTV. In this context the paper discusses an advanced approach for a 3DTV service, which is based on the concept of video-plus-depth data representations. It particularly considers aspects of interoperability and multi-view adaptation for the case that different multi-baseline geometries are used for multi-view capturing and 3D display. Furthermore it presents algorithmic solutions for the creation of depth maps and depth image-based rendering related to this framework of multi-view adaptation. In contrast to other proposals, which are more focused on specialized configurations, the underlying approach provides a modular and flexible system architecture supporting a wide range of multi-view structures.     

Repetitive Delivery Scheme for Left and Right Views in Service‐Compatible 3D Video Service

This paper introduces a novel repetitive delivery scheme for the left and right views in service‐compatible (SC) 3D video that provides full backward compatibility to a legacy DTV system while retaining HD 3D visual quality without additional bandwidth or a codec over the legacy broadcasting channel. The proposed SC delivery scheme transmits individual view sequences of a 3D video in interlaced form, that is, a left‐view sequence of a 3DTV program to be used repeatedly is transmitted first and stored locally, and the right‐view sequence of the 3D program is then transmitted. This paper specifically describes the signaling, synchronization, and storage format methods used to validate the proposed SC delivery scheme. The experiment results show that the proposed SC delivery scheme can be effectively applied for an SC 3DTV service without degrading the DTV quality using only legacy DTV platforms.     

Joint VSB terrestrial digital TV indoor reception project

The reliability and efficacy of indoor reception of 8VSB digital terrestrial television (DTV) in four major U.S. cities was studied in an initial field measurement survey program and a subsequent data capture and processing program. Measurements from the initial survey identified problem sites for reliable DTV reception using currently available 2nd generation DTV receivers. Subsequent field dual channel data captures made at the identified problem sites provided data for testing and verification of new antenna diversity receiver algorithms destined for future generation DTV receivers. From data captures at selected problem sites of sufficient signal strength, but where currently available 2nd generation DTV receivers failed, it was found that in 70% of the cases DTV reception performance was satisfactory when using new antenna diversity receiver algorithms. These measurements and data captures corroborate the claim that the VSB DTV indoor reception problem may be less severe than implied from surveys using less advanced current 2nd generation receivers with a single antenna. For sites with severe multipath, 8VSB DTV reception could be potentially superior to NTSC, which would experience an unwatchable picture.     

Synchronous 2D/3D Switching System for Service‐Compatible 3DTV Broadcasting

This paper proposes a new broadcasting system for the service‐compatible 3DTV in which the 3D service can coexist with the conventional digital TV broadcast. In the proposed system, the commercial 3DTV service can be implemented via the existing DTV channel without utilizing the dedicated 3DTV system. This 2D/3D system interworks with the conventional system and can switch to 2D or 3D service according to the broadcast programming and schedule. The system also provides a mechanism that can prevent the synchronization mismatch between left and right video streams and between the stream and the associated signaling in the 2D/3D transition periods. The picture quality measurements are carried out based on the ITU‐R recommended test to check the level of quality of service provided by the proposed scheme. The conformity tests are also performed with the conventional channel and the receiver for the DTV system to confirm the feasibility of the proposed one for the commercial service.     

无重影立体电视摄像技术的研究

为了解决双目视差立体电视显示画面的重影问题,提出一种主景深上无重影的立体电视摄像技术.该方法用光开关对镜头光路左右对称分割,获得视差图像,可实现立体电视与平面电视双向兼容,重现图像立体感强.     

数字电视传送流丢包和丢包率研究

定义了数字电视传送流丢包,并通过实验指出丢包对电视信号有重要影响,建议把定义的丢包率作为评价数字电视信号传输质量的客观指标之一.为此,提出了两种分析丢包和统计丢包率的算法,并进行了实验验证.     

ATSC DTV的移动接收技术

文章从改进ATSC标准、引进自适应阵列天线技术和提出快速均衡算法三方面论述了提高ATSC DTV移动接收性能的方法.通过仿真验证了这些方法的有效性.     

Virtual view synthesis using layered depth image generation and depth-based inpainting for filling disocclusions and translucent disocclusions

View synthesis is an efficient solution to produce content for 3DTV and FTV. However, proper handling of the disocclusions is a major challenge in the view synthesis. Inpainting methods offer solutions for handling disocclusions, though limitations in foreground-background classification causes the holes to be filled with inconsistent textures. Moreover, the state-of-the art methods fail to identify and fill disocclusions in intermediate distances between foreground and background through which background may be visible in the virtual view (translucent disocclusions). Aiming at improved rendering quality, we introduce a layered depth image (LDI) in the original camera view, in which we identify and fill occluded background so that when the LDI data is rendered to a virtual view, no disocclusions appear but views with consistent data are produced also handling translucent disocclusions. Moreover, the proposed foreground-background classification and inpainting fills the disocclusions with neighboring background texture consistently. Based on the objective and subjective evaluations, the proposed method outperforms the state-of-the art methods at the disocclusions.