基于长支集小波的可伸缩视频编码及其并行实现

离散小波变换由于具有良好的时空频率局域性和多分辨率特性，已经成为可伸缩视频编码的理想工具．可伸缩视频编码只需编码一次就可产生完全可伸缩的嵌入式码流，对码流的一部分解码可以得到不同质量和时空分辨率的视频、本文在MC-EZBC的基础上，通过采用提升型长支集小波进行亚像素精度的运动补偿时间滤波和空间分解实现了对MC—EZBC的改进，在中高码率时的性能可与H、264／AVC相比较．在南开之星上实现了并行编码，取得了较高的加速比．     

A novel hybrid 3D video service algorithm based on scalable video coding (SVC) technology

A scalable video coding (SVC) server can simultaneously provide a single bitstream with a fixed maximum service layer for different kinds of devices having different memory capacity, network bandwidth, and CPU performance requirements. An efficient hybrid 3D video service scheme is proposed without violation of the SVC standard technology for multiple transmission paths. A dynamic local disparity vector estimation algorithm is used to reflect the motion shift component between stereo views in the inter-layer prediction stage of the SVC encoder. To improve the coding efficiency, an adaptive search scheme based on distortion rates (DRs) between corresponding and reference macroblocks is used. Based on experimental results, up to 1.41 dB of quality improvement using JSVM 9.19 reference software is verified.     

Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding

H.264/AVC scalable video coding (H.264/AVC SVC), as the scalable extension of H.264/AVC, offers the flexible adaptivity in terms of spatial, temporal and SNR scalabilities for the generated bitstream. However, such compressed video still suffers from the bad playback quality when packet loss occurs over unreliable networks. In this paper, we present an error concealment algorithm to tackle the whole-picture loss problem in H.264/AVC SVC when hierarchical B-picture coding is used to support temporal scalability. In the proposed algorithm, by taking advantage of the temporal relationship among the adjacent video pictures, the motion information of the lost picture is derived simply and efficiently based on the principle of temporal direct mode. Utilizing the derived motion information, the lost picture is concealed by performing motion compensation on the correctly received temporally previous and future video pictures. The experimental results demonstrate that as a post-processing tool, the proposed error concealment algorithm is able to significantly improve both the objective and subjective qualities of the decoded video pictures in the presence of packet losses when compared to the error concealment algorithm used in H.264/AVC SVC reference software. The proposed method can also be applied to H.264/AVC with hierarchical B-picture coding for error concealment.     

一种基于小波域规则三角形网格运动补偿的可扩展视频编码方法

可扩展视频编码是指已编码码流在解码端能够进行部分解码,且重构图像的质量与接收到的信息量成比例变化,同时空域分辨率和时域分辨率可以根据解码端的要求改变。为了提供小波编码视频码流的高度可扩展性,提出了一种基于小波域规则三角形网格运动补偿的可扩展视频编码方法。该方法首先对参考帧使用冗余离散小波变换(RDWT)进行分解,并在RDWT小波域使用网格运动模型进行运动补偿,以提高运动补偿效率;其次在编码阶段则采用基于子带扫描顺序的改进SPIHT技术来保障码流的可扩展特性。实验表明,该方法在获得较高编码效率的同时,还提供了码流的高度可扩展特性。     

一个优化运动矢量码率分配的快速算法

从信息论的角度看，运动补偿的最终目的是极小化信源熵率。因此，对具有四叉树结构的运动矢量场，当使用叶部运动矢量替代相应根部运动矢量作运动补偿预测时，若编码运动矢量所增加的熵大于相应补偿帧差所减少的熵，则删除相应的叶部运动矢量，反之，则应使用叶部运动矢量替代根部的运动矢量。依据这一准则，该文通过对正向搜索的运动矢量场进行自下而上反向优化截断，得到了一个全局优化运动矢量场码率分配的快速算法。通过假设补偿帧差系数的选验概率分布，该文首先给出了一个闭式补偿帧差系数熵理论计算公式，考虑到视频压缩的有损特性，然后又对这个闭式理论公式作了带权修正，为了进一步提高运动矢量的编码效率，文中同时也给出了一种运动矢量融合方案。最后，该文在运动补偿的三维小波视频编码系统上对这个算法进行了验证和比较。模拟实验证实该文所提出的运动矢量码率分配算法不仅速度快而且收敛性态稳定，只要提供合适的搜索深度，总可以获得最佳的分配结果。由于优化算法避开了补偿帧差的具体后处理，因此该文的算法也可以应用到传统的DCT视频编码器。     

Multiresolution,perceptual and vector quantization based video codec

This paper presents a novel Multiresolution, Perceptual and Vector Quantization (MPVQ) based video coding scheme. In the intra-frame mode of operation, a wavelet transform is applied to the input frame and decorrelates it into its frequency subbands. The coefficients in each detail subband are pixel quantized using a uniform quantization factor divided by the perceptual weighting factor of that subband. The quantized coefficients are finally coded using a quadtree-coding algorithm. Perceptual weights are specifically calculated for the centre of each detail subband. In the inter-frame mode of operation, a Displaced Frame Difference (DFD) is first generated using an overlapped block motion estimation/compensation technique. A wavelet transform is then applied on the DFD and converts it into its frequency subbands. The detail subbands are finally vector quantized using an Adaptive Vector Quantization (AVQ) scheme. To evaluate the performance of the proposed codec, the proposed codec and the adaptive subband vector quantization coding scheme (ASVQ), which has been shown to outperform H.263 at all bitrates, were applied to six test sequences. Experimental results indicate that the proposed codec outperforms the ASVQ subjectively and objectively at all bit rates.     

基于RDWT-子带运动补偿的可扩展视频编码方法

随着技术的发展，视频编码方法要求的不再仅是压缩效率，还包括码流的可扩展性．本文提出了一种基于RDWT-子带运动补偿的可扩展视频编码方法．首先对输入帧组进行空域DWT分解，在其后集成运动补偿过程的时域分解步骤中，使用冗余离散小波变换（RDWT）分解得到的各相位子带作为候选，选取一个最佳相位子带作为预测，提高运动补偿效率；在编码阶段，提出基于子带扫描顺序的改进3DSPIHT技术，保障码流的扩展特性．实验表明，所提出的方法获得较高编码效率的同时，提供了码流的高度可扩展特性。     

Low-Delay Low-Complexity Bandwidth-Constrained Wireless Video Transmission Using SVC Over MIMO Systems

We propose an efficient strategy for the transmission of scalable video over multiple-input multiple-output (MIMO) wireless systems. In this paper, we use the latest scalable H.264 codec (SVC), which provides combined temporal, quality and spatial scalability. At the transmitter, we estimate the decoded video distortion for given channel conditions taking into account the effects of quantization, packet loss and error concealment. The proposed scalable decoder distortion algorithm offers low delay and low complexity. The performance of this method is validated using experimental results. In our proposed system, we use a MIMO system with orthogonal space-time block codes (O-STBC) that provides spatial diversity and guarantees independent transmission of different symbols within the block code. The bandwidth constrained allocation problem considered here is simplified and solved for one O-STBC symbol at a time. Furthermore, we take the advantage of the hierarchical structure of SVC to attain the optimal solution for each group of pictures (GOP) of the video sequence. We incorporate the estimated decoder distortion to optimally select the application layer parameter, i.e., quantization parameter (QP), and physical layer parameters, i.e., channel coding rate and modulation type for wireless video transmission.      

Motion-compensated temporal filtering with optimized motion estimation

The lifting-based discrete wavelet transforms applied temporally along the motion trajectory is a powerful tool in scalable video compression. The longer filter is used for motion-compensated temporal filtering (MCTF) for better de-correlation. The bidirectional motion estimation (ME) used for MCTF is the major speed bottleneck. This paper propose two stages motion predictive technique to optimize the ME. In the first stage, zero motion block prediction is carried out using the content of high frequency frame, obtained after TF without motion compensation. In the second stage, the inter-frame and inter-layer prediction technique is applied to skip the coarse search of any fast ME, except for the first pair of frames in a group of pictures. The proposed algorithm is implemented in MC-EZBC. The variations observed in objective or subjective quality of the decoded video is negligible compared to the speed gained.     

基于可变尺寸重叠块运动补偿的小波视频编码器

通过排序算法和四叉树编码的改进以及快速运动矢量搜索算法的应用实现了优化的可变尺寸运动估计局部生长算法,将SPIHT小波图像编码器和可变尺寸重叠块运动补偿算法相结合,设计了一种混合小波视频编码器.仿真试验表明这是一种有效的视频编码方法,对于具有复杂运动的视频序列的编码较为有效.     

小波视频编码中运动补偿技术研究进展

近年来小波视频编码技术在快速发展，作为视频编码核心步骤的运动补偿技术更是受到了高度重视．许多用于提高编码效率和提供新功能的观点和方法被提出．在介绍小波视频编码技术特点和基本方法的基础上，着重介绍了运动补偿技术在时域和小波域实现的最新进展，并对发展趋势进行了展望．     

多解析度自适应零块判决算法

在视频会议等应用中,视频编码的速度是保证系统实时性的关键.为了减小视频编码的运算量并提高系统的整体性能,提出了多解析度的自适应零块发现判决算法.多解析度通过对图像的子采样从而大幅度降低了搜索最佳匹配块的次数;而自适应的零块判决算法使得运动搜索速度收敛的更快,在不影响图像质量的前提下提高了编码的效率,并且减少了后续模块(DCT、量化等)所占用的时间.利用H.263算法进行了测试,结果显示在图像主客观质量基本不变的前提下,编码时间最多减少了近40%.     

Real-time error concealing bitstream adaptation methods for SVC in IPTV systems

The current heterogeneity in networks and devices demands for a high degree of flexibility in IPTV systems for digital television. A scalable video coding scheme (in this paper we focus on H.264/AVC’s scalable video coding extension SVC) accommodates this flexibility from the coding point of view. Because the IP-based network delivery chain in IPTV systems may suffer from packet loss (having a severe impact on the visual quality) it is necessary to provide means for error concealment. In this paper we propose a novel method that performs adaptation on impaired SVC bitstreams so that the resulting adapted bitstream is compliant to the SVC specification and that the reconstruction result at the decoder is equivalent compared to the approach where the error concealment is implemented in the decoder itself. The adapted bitstreams have a significantly higher visual quality while our approach does not require any modification to existing SVC-compliant decoders. The results of several experiments show that the proposed method is extremely fast (over 900 frames/s) and that it introduces a negligible overhead in terms of bit rate (ca. 0.02%).     

OpTrans:一个率失真优化的MC-EZBC转换编码算法

可伸缩性视频转换编码算法是大型分层视频组播系统层次化代理自适应机制的核心技术.好的转换编码算法不仅要满足拥塞速率控制的要求,而且要使分层视频组播流中的增强层数据以率失真优化的方式进行截断,以提高接收者的接收效能.本文对可伸缩三维小波编码算法MC-EZBC视频转换编码的联合率失真目标函数和优化算法进行了深入研究,提出了率失真优化的MC-EZBC转换编码算法及其分层速率控制方法.对比实验结果表明,采用了联合率失真优化后的转换编码码率控制方法比原有的按顺序截断方法可提高平均视频质量PSNR0.3-0.5dB,进而可优化大型分层视频组播系统的整体效能.     

Architectures for Fast Transcoding of H.264/AVC to Quality-Scalable SVC Streams

The scalable extension of H.264/AVC (SVC) was recently standardized, and offers scalability at a minor penalty in rate-distortion efficiency when compared to single-layer H.264/AVC coding. In SVC, a scaled version of the original video sequence can easily be extracted by dropping layers from the stream. However, most of the video content nowadays is still produced in a single-layer format. While decoding and reencoding is a possible solution to introduce scalability in the existing bitstreams, this is an approach which requires a tremendous amount of time and effort. In this paper, we show that transcoding can be used to intelligently derive scalable bitstreams from existing single-layer streams. We focus on SNR scalability, and introduce techniques that are able to create multiple quality layers in the bitstreams. We also discuss bitstream rewriting from SVC to H.264/AVC, and examine how our newly proposed architectures can benefit from the changes that were introduced for bitstream rewriting. Architectures with different rate distribution flexibility and computational complexity are discussed. Rate-distortion performance of transcoding is shown to be comparable to that of reencoding at a fraction of the time needed for the latter.     

基于SAD矢量合成的1/4像素精度运动估计快速算法

H.264作为新一代的视频标准,对基于块匹配法的运动估计做了新的改进。运动估计是视频编码过程中极其重要的一个环节,它的算法效率对整个编码效率有很大的影响。针对H.264标准中提出的1/4像素精度的运动估计,对其基本算法以及几种快速算法进行分析比较,并在此基础上提出了一种快速的矢量合成算法。实验结果证明,这种算法在提高搜索速度的同时,也保证了图像质量。     

Statistical, DCT and vector quantisation-based video codec

The authors present a novel hybrid statistical, DCT and vector quantisation-based video-coding technique. In intra mode of operation, an input frame is divided into a number of non-overlapping pixel blocks. A discrete cosine transform then converts the coefficients in each block into the frequency domain. Coefficients with the same frequency index at different blocks are put together generating a number of matrices, where each matrix contains the coefficients of a particular frequency index. The matrix, which contains the DC coefficients, is losslessly coded. Matrices containing high frequency coefficients are coded using a novel statistical encoder. In inter mode of operation, overlapped block motion estimation / compensation is employed to exploit temporal redundancy between successive frames and generates a displaced frame difference (DFD) for each inter-frame. A wavelet transform then decomposes the DFD-frame into its frequency subbands. Coefficients in the detail subbands are vector quantised while coefficients in the baseband are losslessly coded. To evaluate the performance of the codec, the proposed codec and the adaptive subband vector quantisation (ASVQ) video codec, which has been shown to outperform H.263 at all bitrates, were applied to a number of test sequences. Results indicate that the proposed codec outperforms the ASVQ video codec subjectively and objectively at all bitrates.     

对具有帧间相关性的分层视频码流的非均匀错误保护

在分层视频码流的网络实时传输中,非均匀错误保护（UEP）技术已经被广泛地研究。至今为止,几乎所有的UEP相关工作都是针对具有链式结构的单一码流。但是,在一些实际的图像及视频编码系统（例如MPEG-4）产生的码流中,都存在着更为复杂的树型相关性结构。针对这种具有树型相关性结构的码流提出了一种打包方案,并在此基础上提供了两种带宽分配方案。试验中,采用MPEG-4FGS作为信源编码器。试验结果表明,采用灵活的帧间自适应带宽分配方案可以有效地提高系统性能。     

Performance analysis of inter-layer prediction in scalable extension of HEVC (SHVC) for adaptive media service

Scalable video coding (SVC) has been a popular research topic to provide an adaptive media service for many years. To deliver very high quality content such as ultra high definition (UHD) video in various environment, a scalable extension of high efficiency video coding (SHVC) has been developed by the Joint Collaborative Team on Video Coding (JCT-VC) of ISO/IEC MPEG and ITU-T VCEG. This paper introduces the SHVC standard technology and analyzes the performance of inter-layer prediction as an important feature. Unlike the previous scalable video coding technologies, the SHVC standard employs a multi-loop decoding structure. Also, inter-layer prediction scheme is used to remove the redundancy between layers when encoding enhancement layer syntax elements, such as motion parameters and the intra prediction mode. This paper reviews inter-layer prediction techniques that have been developed for the SHVC standard. The performance of inter-layer prediction techniques is verified and analyzed using the SHVC reference software 5.0.