双视立体视频同步合成系统设计与实现

以立体视频左右放置合成算法为核心算法,使用DDRSDRAM作为帧同步缓冲器件,采用FPGA作为平台,实现了一套立体视频合成系统。该系统降低了因制作立体视频需要处理两路带视差的视频而带来的对额外传输带宽和编解码器的需求,合成视频具有实时性好、失真小、立体感良好等特点。     

基于时空一致性的立体视频稳像改进方法

随着立体拍摄设备的普及,立体影视的后期稳像需求大大增加.直接观看带有抖动的立体视频,极易造成视觉疲劳.利用传统2D稳像方法分别稳像合成的立体视频很可能引入新的垂直视差,并且会导致水平视差的不稳定,大大影响视觉体验.因此,提出了一种改进的立体视频稳像方法,在3D运动模型进行单目稳像的基础上,增强两路视频的时空一致性约束,更好地稳定水平视差及消除垂直视差.最后对稳定后的序列进行合理的裁切放大.对几组不同的立体抖动视频进行了试验,测试结果表明所提出的方法是有效的.     

一种基于立体视邻接帧时空相关性的最小代价函数帧估计算法

为了在立体视频序列编码中获得高的压缩率,需要对立体视频序列中一个视的序列按传统方法进行独立编码;另一个视的序列中,只对其中一些参考帧(I帧或P帧)按视差补偿预测的方法进行编码,其余帧不进行编码和传输,而在解码端用立体视帧估计的方法得到重建.本文提出了一种基于立体视中邻接帧在图像、视差场和运动矢量场之间高度相关性的方法.对于因遮挡而缺乏估计的区域,则结合了图像强度的连续性和运动,视差矢量的分布特性,构造了代价方程并估计出该部分的运动矢量及强度值.实验证明,重建出来的帧图像在视觉和信噪比意义上均具有较好的效果.     

一种基于MPEG-2的立体视频编码中的视差匹配快速算法

高效，快速的视差匹配是立体视频处理中的一项关键技术。本文在分析立体图像序列的视差矢量与运动矢量之间的相关性的基础上，提出一种基于MPEG-2的立体视频编码中的视差匹配快速算法。实验结果表明，与全搜索法相比，在保证重建图像质量的前提下，快速算法能显著降低视差估计的计算复杂度。     

自适应选择联合补偿预测模式的立体视频编码算法

运动补偿预测．视差补偿预测以及两者相结合的联合补偿预测是研究立体视频编码的关键技术。不同预测模式不仅考虑了左右视频通道各自的时间相关性、而且考虑到了左右视频通道之间的空间相关性。本文提出了一种自适应选择预测模式的立体视频编码算法,并在预测模式确定后通过选取不同的加权值来达到联合补偿预测的目的。实验结果表明,本文提出的算法在改善编码性能的同时,提高了编码速度。     

立体电视视频质量影响因素分析

从立体电视技术链的角度出发,首先分析了立体电视双目视差基本原理,然后分析了立体电视在视频采集制作、发端压缩编码、信道传输、收端解码和立体显示这5大环节中,现行技术对立体视频质量分别造成的影响以及已有的改进措施,最后展望了最新立体电视技术对于立体视频质量的提升。     

立体视觉与立体成像

讲述了主要立体视觉因素的形成机理,导出双目视差关系式,给出了相应参数的约略值,分析了主要参数与立体视觉效果的关系。可供立体成像、制作较符合视觉特性的立体电视节目、高效编码立体电视视频数据流和重显立体视频图像参考。     

联合彩色信息的多视点深度视频视差矢量预测

多视点加深度(MVD)格式可以利用虚拟视点绘制技术生成任意视点的视频,能高效地向观看者提供立体感知。由于MVD中的深度视频与对应的彩色视频采集于同一场景,具有高度的相关性。因此,深度视频可以利用已编码的彩色信息辅助编码。提出一种联合彩色信息的多视点深度视频视差矢量预测方法。该方法首先获得当前编码深度块对应位置的彩色块,提取彩色块预测得到的视差矢量作为深度块的一个候选视差矢量。然后,利用深度块信息计算得到另一个候选视差矢量。最后,对两个候选视差矢量通过计算下采样均方差,选择更精确的一个作为当前深度块的视差矢量预测值。实验结果表明,所提出的方法性能优于3D-HEVC编码平台HTM。     

分布式多视点视频编码中的立体边信息生成

新兴的分布式多视点视频编码通过在解码端使用立体边信息可充分挖掘传统单视点的时间相关性和多视点特有的视间相关性.研究了一种多视点运动预测的立体边信息生成算法,提出了近似视差估计和编码端掩模融合算法.实验证明,解码端采用近似的视差矢量,编码端传递某些先验信息,都能有效提高立体边信息精度,降低计算复杂度.     

立体图像视差自适应调整算法

针对不同尺寸立体显示器播放立体视频时立体视觉效果存在的差异,提出一种通过调节图像水平视差改善立体显示效果的方法。首先应用立体匹配算法得到立体图像初始视差,通过图像分割与连通性检测从中可靠地获取水平视差范围;为保证图像中全部景物在舒适立体融像区内成像,根据显示器尺寸与观看距离,调整左右眼图像在原立体视频中相对位置,形成合理的水平视差,从而在立体显示器上产生舒适的立体视觉效果。实验证明,本文提出的方法可自适应地调整立体图像的水平视差并较好地改善立体显示效果。     

基于双向运动补偿的三维小波变换方法

提出了基于双向运动补偿的三维小波变换方法,与以往的三维小波变换方法相比较,该方法在三维小波视频编码方法中应用了双向的运动估计/补偿,进而实现了两种时域可扩展方式的组合,提高了视频编码的可扩展性。     

Cross-layer optimized authentication and error control for wireless 3D medical video streaming over LTE

3D video for tele-medicine applications is gradually gaining momentum since the 3D technology can provide precise location information. However, the weak link for 3D video streaming is the necessary wireless link of the communication system. Neglecting the wireless impairments can severely degrade the performance of 3D video streaming that communicates complex critical medical data. In this paper, we propose systematic methodology for ensuring high performance of the 3D medical video streaming system. First, we present a recursive end-to-end distortion estimation approach for MVC (multiview video coding)-based 3D video streaming over error-prone networks by considering the 3D inter-view prediction. Then, based on the previous model, we develop a cross-layer optimization scheme that considers the LTE wireless physical layer (PHY). In this optimization, the authentication requirements of 3D medical video are also taken into account. The proposed cross-layer optimization approach jointly controls and manages the authentication, video coding quantization of 3D video, and the modulation and channel coding scheme (MCS) of the LTE wireless PHY to minimize the end-to-end video distortion. Experimental results show that the proposed approach can provide superior 3D medical video streaming performance in terms of peak signal-to-noise ratio (PSNR) when compared to state-of-the-art approaches that include joint source-channel optimized streaming with multi-path hash-chaining based-authentication, and also conventional video streaming with single path hash-chaining-based authentication.     

AVS 3D Video Coding Technology and System

Following the success of the audio video standard(AVS) for 2D video coding,in 2008,the China AVS workgroup started developing 3D video(3DV) coding techniques.In this paper,we discuss the background,technical features,and applications of AVS 3DV coding technology.We introduce two core techniques used in AVS 3DV coding:inter-view prediction and enhanced stereo packing coding.We elaborate on these techniques,which are used in the AVS real-time 3DV encoder.An application of the AVS 3DV coding system is presented to show the great practical value of this system.Simulation results show that the advanced techniques used in AVS 3DV coding provide remarkable coding gain compared with techniques used in a simulcast scheme.     

HEVC-based 3D holoscopic video coding using self-similarity compensated prediction

Holoscopic imaging, also known as integral, light field, and plenoptic imaging, is an appealing technology for glassless 3D video systems, which has recently emerged as a prospective candidate for future image and video applications, such as 3D television. However, to successfully introduce 3D holoscopic video applications into the market, adequate coding tools that can efficiently handle 3D holoscopic video are necessary. In this context, this paper discusses the requirements and challenges for 3D holoscopic video coding, and presents an efficient 3D holoscopic coding scheme based on High Efficiency Video Coding (HEVC). The proposed 3D holoscopic codec makes use of the self-similarity (SS) compensated prediction concept to efficiently explore the inherent correlation of the 3D holoscopic content in Intra- and Inter-coded frames, as well as a novel vector prediction scheme to take advantage of the peculiar characteristics of the SS prediction data. Extensive experiments were conducted, and have shown that the proposed solution is able to outperform HEVC as well as other coding solutions proposed in the literature. Moreover, a consistently better performance is also observed for a set of different quality metrics proposed in the literature for 3D holoscopic content, as well as for the visual quality of views synthesized from decompressed 3D holoscopic content.     

基于3D视频的错误隐藏技术分析

随着3D视频产品的逐步问世,3D视频技术逐渐成为当前研究的热点。由于3D视频编码是利用多个视点的空间、时间及视点间的相关性进行压缩编码,导致当3D视频遭遇不可靠信道差错时,其受损的影响比传统的2D视频更严重。因此,研究基于3D视频的差错控制技术十分必要,针对3D视频的3种视频格式,初步探讨了目前已经出现或正在研究中的错误隐藏技术。     

高性能三维小波视频编码方法

讨论并实现了基于３Ｄ－ＳＰＩＨＴ算法的三维小波视频编码方法。该方法建立在真三维小波分解基础上，通过定义一种新的时空方向树结构，实现了静止图像ＳＰＩＨＴ算法的三维扩展。该方法不涉及运动估计，具有较低的计算负荷和时间延迟，所产生的视频流是完全嵌入的。实验结果表明该方法能够快速地、高质量地压缩视频图像，是一种很有潜力的视频编码方法。     

基于三维小波变换嵌入式视频压缩算法的研究

本文把二维图像的等级树集分割编码方法(SPIHT)推广应用于三维的视频编码中,提出了一种用于三维视频序列图像的扩展等级树集分割编码方法.此方法所编码码流是嵌入式码流,在解码端可随意截取一段码流解码以达到所要求的码率和视频质量.另外此方法无需进行运动补偿,降低了算法的复杂度.通过理论分析和仿真实验得出,此方法有很好的编码效率,但对于帧内图像较复杂的序列,编码效率有所下降.     

MPEG-4自然视频编码技术

对MPEG－4自然视频编码的关键技术作了详细的分析和阐述。首先介绍MPEG－4频语法结构，并对视频编码的框架概要分析。接着分析了自然视频编码中涉及到的关键技术，包括：VOP的产生；二值和灰度级α平面的编码技术；运动估计和补偿方法；纹理编码；基于对象的时间分级和空间分级；MPEG－4提供的再同步和各种错误掩盖，刷新方法，精 编码技术和零树小波基的静止图像编码技术。指出MPEG－4和MPEG－1，MPEG－2等标准的异同，突出MPEG－4的三个主要特点。最后给出MPEG－4技术在网络视频传输中的应用，并给出测试和分析。     

Bit-stream allocation methods for scalable video coding supporting wireless communications

The demand for video access services through wireless networks, as important parts of larger heterogeneous networks, is constantly increasing. To cope with this demand, flexible compression technology to enable optimum coding performance, especially at low bit-rates, is required. In this context, scalable video coding emerges as the most promising technology. A critical problem in wavelet-based scalable video coding is bit-stream allocation at any bit-rate and in particular when low bit-rates are targeted. In this paper two methods for bit-stream allocation based on the concept of fractional bit-planes are reported. The first method assumes that minimum rate-distortion (R–D) slope of the same fractional bit-plane within the same bit-plane across different subbands is higher than or equal to the maximum R–D slope of the next fractional bit-plane. This method is characterised by a very low complexity since no distortion evaluation is required. Contrasting this approach, in the second method the distortion caused by quantisation of the wavelet coefficients is considered. Here, a simple yet effective statistical distortion model that is used for estimation of R–D slopes for each fractional bit-plane is derived. Three different strategies are derived from this method. In the first one it is assumed that the used wavelet is nearly orthogonal, i.e. the distortion in the transform domain is treated as being equivalent to the distortion in the signal domain. To reduce the error caused by direct distortion evaluation in the wavelet domain, the weighting factors are applied to the used statistical distortion model in the second strategy. In the last strategy, the derived statistical model is used during the bit-plane encoding to determine optimal position of the fractional bit-plane corresponding to refinement information in the compressed bit-stream. Results of selected experiments measuring peak signal to noise ratio (PSNR) of decoded video at various bit-rates are reported. Additionally, the PSNR of decoded video at various bit-rates is measured for two specific cases: when the methods for bit-stream allocation are used to assign quality layers in the compressed bit-stream, and when quality layers are not assigned.