基于深层特征学习的高效率视频编码中帧内快速预测算法

高效视频编码(HEVC)标准相对于H.264/AVC标准提升了压缩效率,但由于引入的编码单元四叉树划分结构也使得编码复杂度大幅度提升。对此,该文提出一种针对HEVC帧内编码模式下编码单元(CU)划分表征矢量预测的多层特征传递卷积神经网络(MLFT-CNN),大幅度降低了视频编码复杂度。首先,提出融合CU划分结构信息的降分辨率特征提取模块;其次,改进通道注意力机制以提升特征的纹理表达性能;再次,设计特征传递机制,用高深度编码单元划分特征指导低深度编码单元的划分;最后建立分段特征表示的目标损失函数,训练端到端的CU划分表征矢量预测网络。实验结果表明,在不影响视频编码质量的前提下,该文所提算法有效地降低了HEVC的编码复杂度,与标准方法相比,编码复杂度平均下降了70.96%。     

基于零块分析的高效视频编码通信

为了实现高清、超高清视频实时编码通信传输, 针对高效视频编码(HEVC)帧间编码计算复杂度过高的问题,根据图像的文理复杂度和 编码单元的零块统计特征,提出一种新的HEVC快速帧间模式判决算法。根据Merge模式下 整单元一分为四的4个子编码单元纹 理相似度确定是否提前终止编码单元(CU)划分,同时利用帧间2N×2N预测模式下零系数与非零系数分布的区域统计特征,选择符合零块分 布特征的最佳预测单元(PU)模式。实验结果表明,在低延迟B(LDB,low-delay B)和随机访 问(RA,random access)配置条件下,提出的算法在保持编码 性能基本不变的情况下,HEVC帧间预测编码时间分别平均减少了60.2%与59.4%。     

基于深层特征学习的高效率视频编码中帧内快速预测算法

高效视频编码(HEVC)标准相对于H.264/AVC标准提升了压缩效率,但由于引入的编码单元四叉树划分结构也使得编码复杂度大幅度提升.对此,该文提出一种针对HEVC帧内编码模式下编码单元(CU)划分表征矢量预测的多层特征传递卷积神经网络(MLFT-CNN),大幅度降低了视频编码复杂度.首先,提出融合CU划分结构信息的降分辨率特征提取模块;其次,改进通道注意力机制以提升特征的纹理表达性能;再次,设计特征传递机制,用高深度编码单元划分特征指导低深度编码单元的划分;最后建立分段特征表示的目标损失函数,训练端到端的CU划分表征矢量预测网络.实验结果表明,在不影响视频编码质量的前提下,该文所提算法有效地降低了HEVC的编码复杂度,与标准方法相比,编码复杂度平均下降了70.96％.     

一种基于时域相关性的高性能视频编码快速帧间预测单元模式判决算法

为了降低高性能视频编码(HEVC)的编码计算复杂度,根据视频时域上高度相关性的特点,该文提出一种快速高性能视频编码(HEVC)帧间预测单元(PU)模式判决算法。分析了时域上相邻帧两帧相同位置编码单元(CU)的PU模式之间的相关性;同时,针对视频中可能存在对象运动,还分析了前一帧对应位置CU的周边CU与当前帧中当前CU间PU模式的相关性。根据分析的时域相关性,跳过当前CU中冗余的PU模式,从而降低编码复杂度。实验结果表明,在编码效率和峰值信噪比(PSNR)损失很小的情况下,在目前已有的HEVC快速帧间预测算法的基础上,进一步降低了31.30%的编码时间。     

基于运动特征的HEVC快速帧间预测编码研究

为了降低高效视频编码(HEVC,high efficiency v ideo coding)的帧间预测复杂度,提出了一种基于运动特征的HEVC快速帧间预测新方 法。首先利用视频相邻帧的时域相关性,通过计算 每个待编码单元(CU)及其子块的帧差离散度(FDD)确定该CU的最佳编码深度d ;再依据该深度下CU的区 域运动特征(RMF_d)将待编码CU划分为3类运动区域,进而确 定该CU的候选帧间预测模式,减少 不必要的帧间预测模式遍历过程。试验结果表明,本算法可以在保证编码性能损失不大的前 提下显著提高编码效率;与标准算法相比,在低延时和随机访问两种编码结构下,同等客观 质量下码率(BDBR)分别增加0.89% 和0.83%,同时节省了51.6%和48.5%的编码时间。     

新一代视频编码技术HEVC算法分析及比较

新一代视频编码标准HEVC更倾向于处理高清视频,实现在设备复杂度有一定增加的前提下提高视频,尤其是高清视频的编码效率。结合现行的H.264标准,对比了HEVC标准在编码结构、帧内预测、帧间预测以及熵编码技术上的改进和算法上的优化。对HEVC的具体编码技术进行分析,并将HEVC与H.264编码性能进行了比较。实验结果表明,HEVC在编码性能上有了明显提高。     

一种低复杂度的HEVC帧内快速编码算法

为了降低高效视频编码(HEVC)帧内编码复杂度,提出一种HEVC帧内快速编码算法。根据视频图像的纹理复杂性,提前跳过或者中止部分尺寸的编码单元(CU)的划分,减少CU深度遍历区间;同时,根据粗选过程后预测模式和代价值的统计特性采用阈值法或者梯度模式直方图法进一步筛选掉粗选后可能性较小的预测模式,从而减少最后进行率失真(RD)代价计算的帧内预测模式数量,进一步降低编码复杂度。实验结果表明,本文算法与HEVC原始平台相比,在全I帧编码模式下编码时间平均减少42.20%,码率(BR)上升约1.75%,峰值信噪比(PSNR)降低了0.108dB,有利于实时应用。     

基于最邻近帧质量增强的视频编码参考帧列表优化算法

帧间预测是视频编码的核心模块,其利用参考帧的重建样本来预测当前图像样本,从而通过传输少量预测残差数据表示复杂视频内容。在有损视频编码中,参考帧质量受到量化失真的影响,导致预测精度较差,影响编码性能。针对低时延视频业务,提出一种基于最邻近帧质量增强的参考帧列表优化算法,通过基于深度学习的卷积神经网络增强与当前帧最邻近参考帧的质量,并将增强后的高质量帧整合到当前帧的参考帧列表中,提高了帧间预测精度。以高效视频编码H.265/HEVC参考软件平台HM16.22为参考基准,所提算法在Y、Cb、Cr这3个分量上可分别节省9.06%、14.92%、13.19%的编码码率。     

基于时域相关性的快速HEVC帧间模式判决方法

高效率视频编码(HEVC)相比目前的国际视频编码标准H.264/AVC,在压缩率方面有了较大的提高,但也带来了巨大的编码计算复杂度。为了降低HEVC的编码计算复杂度,提出了一种快速HEVC帧间模式判决方法。统计并分析了相邻两帧之间对应块的编码单元(CU)和预测单元(PU)的时域相关性,在此相关性基础上,跳过了一些冗余CU分割层和PU预测模式,CU层最多只取两种PU预测模式,从而大大减少了所需要进行的率失真代价计算的数量,实验结果显示,与HM7.0相比,该方法在仅损失了0.21%-1.66%的压缩率和0.01~0.09 dB的峰值信噪比的前提下,降低了52.3%~63.5%的编码时间。     

基于HEVC帧内预测的复杂度控制

帧内预测在视频编码中是非常重要的模块.在视频实时编码与传输过程中,场景切换会经常出现.此时,一般会采用全Ⅰ帧编码.研究发现,即使是全Ⅰ帧编码,也往往会非常耗时.基于编码单元深度范围和帧内预测中候选预测方向个数研究了HEVC编码器的复杂度控制问题.针对不同的目标编码复杂度,算法自适应地选择不同的方法来优化编码过程.实验结果表明,该算法在保证视频质量的前提下实现了对不同复杂度目标的控制.     

Introduction to the High-Efficiency Video Coding Standard

The high-efficiency video coding(HEVC) standard is the newest video coding standard currently under joint development by ITU-T Video Coding Experts Group(VCEG) and ISO/IEC Moving Picture Experts Group(MPEG).HEVC is the next-generation video coding standard after H.264/AVC.The goals of the HEVC standardization effort are to double the video coding efficiency of existing H.264/AVC while supporting all the recognized potential applications,such as,video telephony,storage,broadcast,streaming,especially for large picture size video(4k × 2k).The HEVC standard will be completed as an ISO/IEC and ITU-T standard in January 2013.In February 2012,the HEVC standardization process reached its committee draft(CD) stage.The ever-improving HEVC standard has demonstrated a significant gain in coding efficiency in rate-distortion efficiency relative to the existing H.264/AVC.This paper provides an overview of the technical features of HEVC close to HEVC CD stage,covering high-level structure,coding units,prediction units,transform units,spatial signal transformation and PCM representation,intra-picture prediction,inter-picture prediction,entropy coding and in-loop filtering.The HEVC coding efficiency performances comparing with H.264/AVC are also provided.     

A low-complexity image compression approach with single spatial prediction mode and transform

The well-known low-complexity JPEG and the newer JPEG-XR systems are based on block-based transform and simple transform-domain coefficient prediction algorithms. Higher complexity image compression algorithms, obtainable from intra-frame coding tools of video coders H.264 or HEVC, are based on multiple block-based spatial-domain prediction modes and transforms. This paper explores an alternative low-complexity image compression approach based on a single spatial-domain prediction mode and transform, which are designed based on a global image model. In our experiments, the proposed single-mode approach uses an average 20.5 % lower bit-rate than a standard low-complexity single-mode image coder that uses only conventional DC spatial prediction and 2-D DCT. It also does not suffer from blocking effects at low bit-rates.     

Efficient Inter Prediction Mode Decision Method for Fast Motion Estimation in High Efficiency Video Coding

High Efficiency Video Coding (HEVC) is the most recent video coding standard to achieve a higher coding performance than the previous H.264/AVC. In order to accomplish this improved coding performance, HEVC adopted several advanced coding tools; however, these cause heavy computational complexity. Similar to previous video coding standards, motion estimation (ME) of HEVC requires the most computational complexity; this is because ME is conducted for three inter prediction modes — namely, uniprediction in list 0, uniprediction in list 1, and biprediction. In this paper, we propose an efficient inter prediction mode (EIPM) decision method to reduce the complexity of ME. The proposed EIPM method computes the priority of all inter prediction modes and performs ME only on a selected inter prediction mode. Experimental results show that the proposed method reduces computational complexity arising from ME by up to 51.76% and achieves near similar coding performance compared to HEVC test model version 10.1.     

Fast CU size and prediction mode decision method for HEVC encoder based on spatial features

In the high-efficiency video coding (HEVC) standard, intra prediction has higher computational complexity compared with H.264/AVC (advanced video coding) because of increasing the number of intra prediction modes and also higher number of coding unit (CU) sizes. The HEVC encoder evaluates 35 prediction modes on five possible prediction unit (PU) sizes to find the one with the minimum rate–distortion cost. Although this approach improves coding efficiency, it is very time-consuming. In this paper, we propose a fast intra prediction method to reduce the complexity of I-frame coding. The proposed method consists of three stages which is based on smoothness spatial feature. In the first stage, a measure is introduced to estimate CU smoothness by using sum of absolute differences (SAD) among CU pixels in four directions. By considering that a smooth region can be predicted with larger CUs, when the measured smoothness parameter is lower than a predefined threshold, only the prediction modes in the current CU are evaluated. In the second stage, the number of intra prediction modes is reduced based on the calculated SADs in the previous stage. In the last stage, if the first three candidate modes resulted from rough mode decision stage in the previous PU and the current PU are similar, then the best mode prediction of the previous PU is selected as the best candidate mode. Experimental results indicate that the proposed method can reduce the coding time on average to 43 % and maintain coding video quality, whereas bitrate increases negligibly (0.5 %).     

新一代基于HEVC的3D视频编码技术

HEVC标准出台后,新一代基于HEVC的多视点加深度编码也将正式推出。基于HEVC的3D视频编码作为HEVC标准的扩展部分,主要面向立体电视和自由立体视频。从该编码方式的基本结构出发,较全面地介绍了视频编码方式、深度图编码方式和对深度图的编码控制三个方面的关键技术,包括视点间运动预测、深度图建模模式和视点合成优化等技术。     

Piecewise DC prediction in HEVC

In this paper, we propose an improved DC prediction method for high-efficiency video coding (HEVC) intra coding. The technique involves the application of pixel-wise predictors rather than block-based predictor in the DC mode. In HEVC, the pixels of neighboring reconstructed blocks are used to support multiple directional spatial prediction modes and reduce spatial redundancy. For lossless coding, pixel-by-pixel differential pulse code modulation (DPCM) is applied to directional predictions. Consequently, residuals are reduced and coding efficiency is improved. Since DC prediction still employs block-based coding, pixel-wise DC prediction is needed for better coding efficiency. When compared to HEVC lossless intra coding, the proposed algorithm reduces the bit rate by 5.95%. Furthermore, with pixel-by-pixel DPCM, the average bit rate reduction is 10.64% when compared to HEVC lossless intra coding.     

Low complexity encoder optimization for HEVC

High Efficiency Video Coding (HEVC) improved the coding efficiency significantly. Compared to its predecessor H.264/AVC, it can provide equivalent subjective quality with more than 57% bit rate reduction. However, the improvement on coding efficiency is obtained at the expense of much more intensive computation complexity. In this paper, based on an overall analysis of computation complexity at the HEVC encoder, a low complexity encoder optimization scheme is proposed by reducing the number of available candidates for evaluation in terms of the intra prediction mode decision, early termination of coding unit (CU) splitting and adaptive reference frame selection. With the proposed scheme, the rate distortion optimization (RDO) technique of HEVC can be implemented in a low-complexity way for complexity-constrained encoders. Experimental results demonstrate that, compared with the original HEVC reference encoder implementation, the proposed optimization scheme can achieve more than 40% complexity reduction on average with coding performance degradation as only 0.43% which can be ignorable.     

Performance enhancement of HEVC lossless mode using sample-based angular and planar predictions

High-efficiency video coding (HEVC) is the state-of-the-art video compression standard designed to handle the storage and transmission requirements of next-generation multimedia services. In the lossless mode HEVC, prevailing sample-based prediction algorithms in the literature have shown better prediction accuracy compared to the conventional block-based prediction within the HEVC anchor. This work proposes a sample-based prediction technique to modify the planar prediction mode of HEVC and a complete sample-based predictive encoder for the lossless mode of HEVC. In this work, we propose gradient adaptive sample-based intraprediction (GASP) as a replacement for the block-based planar prediction in HEVC. To obtain the benefits of sample-based prediction methods in both angular and planar prediction modes, we also propose a combination of ISAP, a sample-based angular prediction in the literature, with the newly proposed GASP (CIG). The experimental results demonstrate the superiority of GASP and CIG over other state-of-the-art sample-based prediction strategies in angular and planar prediction modes.