Successive refinement of side information frames in distributed video coding

Multimedia Tools and Applications - In distributed video coding, generation of high-quality side information is required for reliable soft-input information for decoding each DCT band of a...     

Phase-based side information generation in distributed video coding

Multimedia Tools and Applications - In distributed video coding, the quality of side information (SI) directly affects the final compression efficiency and rate-distortion performance. In the...     

A flexible side information generation framework for distributed video coding

One of the most efficient approaches to generate the side information (SI) in distributed video codecs is through motion compensated frame interpolation where the current frame is estimated based on past and future reference frames. However, this approach leads to significant spatial and temporal variations in the correlation noise between the source at the encoder and the SI at the decoder. In such scenario, it would be useful to design an architecture where the SI can be more robustly generated at the block level, avoiding the creation of SI frame regions with lower correlation, largely responsible for some coding efficiency losses. In this paper, a flexible framework to generate SI at the block level in two modes is presented: while the first mode corresponds to a motion compensated interpolation (MCI) technique, the second mode corresponds to a motion compensated quality enhancement (MCQE) technique where a low quality Intra block sent by the encoder is used to generate the SI by doing motion estimation with the help of the reference frames. The novel MCQE mode can be overall advantageous from the rate-distortion point of view, even if some rate has to be invested in the low quality Intra coding blocks, for blocks where the MCI produces SI with lower correlation. The overall solution is evaluated in terms of RD performance with improvements up to 2 dB, especially for high motion video sequences and long Group of Pictures (GOP) sizes.     

一种多目分布式视频编码的边信息生成算法

针对多目视频传感器网络,提出了一种新的空间边信息生成算法,该算法将体现图像空间信息的三焦点张量引入边信息的计算.三焦点张量的匹配点计算采用了改进的基于SIFT(Scale Invariable Feature Transform)特征描述符的匹配算法,在保持对匹配有旋转、尺度缩放、亮度变化不变性的优点同时,大大提高了计算速度.仿真结果表明.无论从率失真表现还是主观质量表现角度进行比较,该算法明显优于常用的边信息生成算法、基于运动的外推法MC-E和基于运动的内插法MC-I.     

Multi-resolution extreme learning machine-based side information estimation in distributed video coding

Multimedia Tools and Applications - Context: Encoding of video frames in a traditional video coding architecture involves exhaustive computations due to the motion estimation (ME) task. Hence, it...     

Decoder driven side information generation using ensemble of MLP networks for distributed video coding

Multimedia Tools and Applications - This paper proposes an ensemble of multi-layer perceptron (MLP) networks for side information (SI) generation in distributed video coding (DVC). In the proposed...     

Adaptive multi-view video streaming using side information over peer-to-peer networks

Multimedia Tools and Applications - Multi-view plus-depth-map (MVD) video streaming with autostereoscopic displays provides multi-user immersive media experiences. In this context, delivery of MVD...     

Wyner-Ziv视频编码中边信息估计改进算法

首先简要介绍了分布式编码基本原理和一种典型的分布式编码方案——Wyner-Ziv视频编码。然后在Wyner-Ziv视频编码中提出了一种改进边信息估计算法,该算法中运动估计采用加权MAD准则。实验仿真结果表明,采用该文算法得到的运动矢量场更为准确,同时在相同输出码率时PSNR比原始算法平均提高0.7 dB。     

Wyner-Ziv视频编码中边信息估计算法改进*

与传统视频编码方法相比,DVC（distributed video coding）在编码性能方面还存在着较大差距。边信息估计是其中的关键技术之一,在很大程度上决定着编码效率。为缩短性能差距,改善边信息估计效率,提出一种针对像素域Wyner-Ziv视频编码系统的改进算法,在解码端改善了关键帧之间的运动矢量获取以及采用重叠块运动补偿来生成边信息。通过对大量测试序列的实验,验证了改进算法的率失真性能得到改善。     

新的多视点视频编码优化算法

分析研究了多视点视频编码中的TZSearch算法的性能与不足,并针对平行摄像机采集的多视点视频序列,提出一种新的多视点视频编码优化算法。主要从搜索模型选取、搜索策略、自适应阈值设置三个方面进行算法优化,以减少算法计算复杂度。在多视点视频软件测试平台——JMVC4.0上进行验证,结果表明:在保证重建视频质量在容忍度内,同时编码开销可控的前提下,优化算法与原始算法相比,算法平均编码时间减少75%左右,大大提高了编码的实时性。     

灵活的多视点视频编码预测结构

多视点视频的时空相关性不仅随着序列的变化而改变,而且视频序列内的相关性特征随着时间的推移也会发生变化,固定的预测结构难以适应复杂情况下多视点视频编码的各种要求。在分析分层B帧预测结构和多视点视频图像中当前帧及其参考帧之间时间相关性和视点间相关性的基础上,提出一种灵活的预测编码结构,根据该多视点视频的时间及视点间相关关系和当前帧与其时间参考帧之间的距离来确定该帧是否采用耗时的视点间预测。实验结果表明,与分层B帧的改进算法——可扩展性预测结构多视点编码算法相比,本文算法在保证编码效率基本不变的前提下,编码复杂度降低了约45%,随机访问性能提高28%,解码图像缓冲区要求降低46%左右。     

On multi-view video segmentation for object-based coding

A novel scheme for multi-view segmentation and tracking is proposed aiming to acquire perceptually consistent results for object-based coding. Firstly, a classic image segmentation technique is employed to perform initial segmentation to divide the whole image into spatially homogeneous regions. Secondly, the motion information is extracted based on frame differences and the disparity information is derived by employing a classic disparity estimation technique. Thirdly, a novel scheme is proposed to perform merging of the initial segmentation results based on both motion and disparity information to remove over-segmented regions and extract perceptually consistent semantic objects. Finally, a contour-based tracking algorithm is proposed to implement accurate and robust object tracking along both temporal and view directions. Experiments are conducted and the results demonstrate that the proposed scheme is effective and, compared with the existing technique, it can acquire more perceptually consistent results.     

一种改进预测结构的多视点视频编码

多视点视频编码是视频编码的研究热点之一。针对联合多视点视频编码（Joint Multi-view Video Coding,JMVC）采用的分层B帧预测结构编码复杂度高,随机访问性能较差等缺点,提出了一种改进的预测结构。所提出的预测结构对B视点中以前一帧作为其时间参考的帧仅采用时间预测,对所有P视点的非关键帧均不进行视点间预测,有效地降低了计算复杂度,提高了随机访问性能。通过选取合适的I视点位置,以减少结构简化带来的编码效率损失。实验结果表明,与分层B帧预测结构相比,所提出的预测结构在保证编码效率损失不大的情况下,显著降低了平均编码时间。改进的预测结构也具有更好的随机访问性能。     

多视点视频编码快速帧间模式选择算法

为解决多视点视频编码(MVC)可变尺寸块的模式选择计算复杂度过大的问题,提出了基于模式复杂度的多视点视频编码快速模式选择算法。该算法首先分析了多视点视频编码参考模型(JMVC)中各尺寸块的分布特点。然后,提出模式复杂度的概念以确定当前宏块的模式特征。最后,将宏块分成3个不同的模式类型:如果当前宏块属于简单模式,那么仅16×16分块被检查,其他分块均跳过;若当前宏块属于中等模式,则8×8块被跳过;若当前宏块属于复杂模式,所有模式分块都要检查。这样算法对那些不必要的模式选择过程就可以提前终止,从而使得计算量大大减少。实验结果表明:所提算法能保持同JMVC中全搜索算法几乎相同的编码效率,同时使计算复杂度减少62.75%。     

Wyner-Ziv视频编码中边信息估计研究

Wyner-Ziv视频编码是一种典型的分布式视频编码。为了产生较为精确的边信息,提出了一种基于运动估计双向预测边信息的方法,构造了运动补偿内插框架以及改进了算法。Matlab仿真结果表明,改进方法的率失真性能比H.264帧内编码高出0.1~9.0 dB,比基于Turbo码的Discover软件高出0.01~0.90 dB。     

Network-driven low complexity coding for wireless multi-view video system

For wireless multi-view video system, which has very limited capability for storage and computation at the encoder, it is essential to design a video coding scheme with low complexity. Wyner-Ziv (WZ) coding scheme shifts large computational complexities to decoder with side information reconstruction, however, its encoding efficiency is not high enough. To obtain higher encoding efficiency and lower encoding complexity for wireless multi-view video applications, a network-driven low complexity video coding method is proposed in the paper. The proposed method is designed to implement color correction, motion vector extrapolation and disparity extraction at the central node of network, so as to reduce large computational complexities of motion estimation at the encoder and disparity estimation at the decoder. Experimental results show that encoding efficiency of the proposed method is higher than those of WZ coding and H.264 intraframe coding methods. The encoding complexity of the proposed method is greatly decreased and the decoded views are of color consistency, which is favorable to high quality view rendering at the decoder.     

Rate control of hierarchical B prediction structure for multi-view video coding

Rate control plays an important role in regulating bit streams in video coding. In order to obtain good coding performance, the hierarchical B prediction structure has been adopted in Multi-view Video Coding (MVC). However, the conventional rate control scheme is not efficient in the hierarchical B prediction structure. In this paper, we propose a rate control algorithm to address this problem. First, the accurate estimation of Mean Absolute Distortion (MAD) of the current frame is desired for both quantization parameter (QP) selection and Rate Distortion Optimization (RDO). Considering the hierarchical B structure, a bi-directional MAD prediction model is proposed to predict the MAD of the current frame by using the actual MADs of the encoded frames in the lower Temporal Layers (TLs). Second, the number of header bits has a close relationship with the TLs in the hierarchical B prediction structure. Therefore, we propose an enhanced prediction method in which a proportional relationship of the header bits is introduced if the frames are located in different TLs. Experimental results show that our proposed algorithm can achieve both accurate target bit rate and good coding performance.     

分布式视频编码关键技术及研究进展

系统地阐述了分布式视频编码(distributed video coding,DVC)技术框架的基本原理和近五年的发展历程;列举了国内外多个研究小组的基本思想研究现状;分析了分布式视频编码技术的发展趋势;揭示了技术的关键和研究热点;展望了该技术在信息安全、可伸缩编码、多描述编码以及光场编码中的应用前景.     

分布式视频编码技术研究进展

介绍了分布式视频编码与传统视频编码方法思路的不同及各自适用的应用场景,阐述了分布式视频编码的理论基础和目前普遍采用的编解码框架,分析了分布式视频编码中的Wyner-Ziv编解码器设计、辅助边信息生成、虚拟"相关信道"建模等几项关键技术存在的问题及各自解决方案的最新研究进展,最后总结了分布式视频编码的发展与研究方向,并介绍了分布式编码在视频领域的其它应用.