Fast mode decision algorithm for H.264/SVC enhancement layer

Scalable video coding (SVC) has been standardized to extend the capabilities of the H.264 advanced video coding (AVC). The SVC can compress several video sequences of various resolutions as a single bit-stream. In the SVC enhancement layer, for Joint Scalable Video Model (JSVM) software implementation, an exhaustive mode decision process based on the base layer mode predictions is performed to obtain the best mode for each macroblock (MB). This technique may achieve a higher coding efficiency; however, it induces a significant computational complexity in the encoding engine. In order to speedup the SVC encoder, a fast mode decision algorithm was proposed in this paper. In other words, our aim was to decrease the number of candidate modes to reduce the computational complexity and maintain the same level of coding efficiency, this approach used the spatial and temporal correlation between MB situated at the enhancement layer and its co-located MB at the base layer. Our statistical analyses were made using several HD sequences with different motion characteristics. Experimental results show a significant improvement in terms of time encoding which is a major constraint for any real-time implementation. However, this gain is accompanied with an acceptable loss in video quality and a tolerable bit rate increase for most media supports. In fact, our proposed algorithm permits a major improvement that can reach up to 64.9 % in terms of computational effort. This gain will induce an average loss yield to 10.5 or 13.87 % that is comparable to the 13.12 % of the He Li’s algorithm with an acceptable loss in terms of subjective video quality.     

H.264/AVC快速模式选择算法的研究与改进

针对H.264 运用基于率失真优化的全模式搜索技术,带来的模式选择异常复杂的计算,JVT提出了一种新的快速模式选择算法（简化为NFMD）。介绍了该新算法,对其综合性能的优越性进行了初步研究和分析,并提出了改进策略,如早期预测当前宏块编码模式、引入适时终止模式选择策略、快速帧内模式选择判断。实验结果表明,改进的策略能减少NFMD算法35%~55%的编码时间和45%~60%的运动估计时间,而码率和率失真性能的变化可以忽略不计。     

H.264/AVC中基于决策树的P帧快速模式选择（HHME2013第61号论文）

目的：H.264/AVC帧间预测编码需要对所有可能编码模式计算并比较率失真代价,众多的模式类型导致了P帧编码的计算复杂度非常高。本文提出了一种针对P帧的基于决策树的快速选择候选模式算法。方法：在对宏块进行16×16的帧间运动估计后,首先根据残差宏块中4×4全零系数块个数对部分宏块直接选择出候选模式;然后使用16个4×4块的SATD值,采用决策树分类方法对其余宏块选择候选模式。结果：由于只需对候选模式进行编码,因此有效降低了编码器的计算复杂度。实验结果表明,与原始全搜索编码算法相比,该算法对不同运动程度的视频序列获得了较一致的编码时间节省,同时平均峰值信噪比的损失和平均比特率的增加均较少。结论：本文提出了一种新的P帧帧间预测候选模式选择算法,根据帧间运动估计后的残差宏块信息,采用决策树方法对候选模式集进行分类。实验结果表明,该算法能在保证视频编码质量的前提下,有效地降低编码过程中的计算量,缩短编码时间。     

面向视频会议的运动估计快速算法

针对H.264/AVC视频压缩算法中运动估计模块计算复杂度高的问题,提出了一种基于积分图像的运动估计快速算法.算法通过对单元块进行预计算求和,在块匹配运算时使用单元块级绝对差值.该算法能够在保证视频编码质量的前提下,大幅度提高运动估计模块的计算效率.算法适用于视频会议等要求视频实时压缩的应用.     

An early split and skip algorithm for fast intra CU selection in HEVC

The rapid development and increase of multimedia applications, as well as the demand for higher video-quality services at restricted resources such as storage capacity, transmission bandwidth and power consumption, has brought the urgent need for more efficient video compression techniques. The new video coding standard high efficiency video coding (HEVC) has a significant superiority over its predecessor advanced video coding (AVC). HEVC is reported to halve the bit rate with the same visual quality, or a better quality with the same bit rate when compared with AVC. Beside other improvements, HEVC significantly gets its power from the use of dynamic hierarchical quad-tree structure by partitioning the frames into smaller regions called coding units (CU), by means of a rate–distortion optimization process. However, this improvement yields to a dramatic increase of high computational complexity and increased encoding time, which primarily restricts its adaptation in real-time applications. In this paper, we proposed an early CU determination algorithm for fast encoder realization to reduce the encoding time which is the most important part of the standard standing for development. The experimental results show that the proposed algorithm has approximately 45 % encoding time saving with a 4.6 % bit-rate increment, on average.     

Fast multiframe motion estimation algorithms by motion vector composition for the MPEG-4/AVC/H.264 standard

The MPEG-4/AVC/H.264 video coding standard adopts various coding schemes such as multiple reference frames and variable block sizes for motion estimation. Hence, MPEG-4/AVC/H.264 provides gains in compression efficiency of up to 50% over a wide range of bit rates and video resolutions compared to previous standards. However, these features result in a considerable increase in encoder complexity, mainly regarding to mode decision and motion estimation. The proposed algorithms use the stored motion vectors to compose the motion vector without performing the full search in each reference frame. Therefore, the proposed algorithms can obtain an average speed up ratio of four for encoding, thus benefiting from the prediction of the motion vector for the reference frames in advance and maintaining good performance. Any fast search algorithm can be utilized to further largely reduce the computational load.     

H.264/AVC帧间多种块模式的编码性能分析与研究

H.264/AVC是最新的国际视频标准,与其它视频编码标准相比,其在编码效率方面有强大的优势:在相同的重建图像质量下,H.264/AVC比MPEG-2H.263++和MPEG-4的第2部分分别节约64.46%、、48.80%和38.62%的码率。但H.264/AVC中编码效率的提高是以增加巨大的运算量为前提的。该文在介绍H.264/AVC中的宏块分块模式、运动估计及模式选择算法的基础上,重点对各种帧间块模式下的运动估计及4×4亮度变换与量化操作进行了分析,然后对各种帧间块模式的组合进行了实验研究,实验结果表明,当帧间只用块模式1～4时,在相同的比特率下客观图像质量亮度分量的PSNR比帧间使用全部块模式时平均降低0.13dB,而编码的时间平均能减少40%左右。     

利用纹理和空间相关性的HEVC帧内预测模式选择

目的 提出一种结合图像纹理方向和空间相关性的高效视频编码（HEVC）帧内模式选择快速算法,减少粗模式选择过程的候选模式数目,加快帧内模式选择速度。方法 首先,使用Sobel算子获得当前预测单元（PU）的纹理方向,利用此纹理方向选取相应的角度预测模式组成粗模式选择的候选模式列表;另外,利用图像的空间相关性,将相邻预测单元的最优帧内预测模式添加到候选模式列表中。结果 本文算法将粗模式选择过程的候选模式数目从35种减少到不超过10种,比特率升高0.41%,峰值信噪比下降0.0314 dB,编码时间缩短了34.9%。结论 实验结果显示,在保持编码质量基本不变的情况下,此算法明显减少了粗模式选择过程的预测模式数量,提高了HEVC的编码效率。     

An Efficient Mode Decision Algorithm for H.264/AVC Encoding Optimization

The H.264 video coding standard significantly outperforms previous standards in terms of coding efficiency. However, this comes as a cost of extremely high computational complexity due to mode decision where variable block size motion estimation (ME) is employed. In this paper, we propose an efficient algorithm to jointly optimize mode decision and ME. A theoretical analysis is performed to study the sufficient condition to detect all-zero blocks in H.264, and thus adaptive thresholds are derived to early terminate mode decision and ME. Besides the aforementioned early termination technique, the proposed algorithm also introduces temporal-spatial checking, thresholds based prediction and monotonic error surface based prediction methods to skip checking unnecessary modes. Experimental results demonstrate that the proposed algorithm can significantly reduce the computational complexity of H.264 encoding while maintaining almost the same rate distortion (RD) performance as the original encoder     

All-layer search algorithm using mean inequality and improved checkerboard partial distortion search for fast motion estimation

Block-matching motion estimation algorithm is used in many video compression coding systems because it could greatly reduce the temporal redundancy between the consequent video sequences. In this paper, an all-layer search algorithm using mean inequality and improved checkerboard partial distortion search scheme for fast block-matching motion estimation is proposed. A layer in the proposed method refers to a processed image which is derived from the reference frame or the adjacent lower layer. Firstly, the proposed algorithm constructs all layers from the reference frame or the adjacent lower layer by summing up all pixels over a sub-block. Then, a new mean inequality elimination method is introduced to reject a lot of unnecessary candidate search points on the top layers before calculating the real block matching distortion. Finally, the proposed algorithm utilizes an improved checkerboard partial distortion search scheme in the process of the real block distortion calculation on the following layers to further reduce the amount of computation. Experimental results show that the proposed algorithm can effectively reduce the computational complexity of motion estimation meanwhile guarantee the matching quality compared to other motion estimation algorithms. Compared to the full search algorithm, the proposed algorithm can reduce 97.30 % computational complexity with a negligible degradation of the peak signal to noise ratio (PSNR). Compared to the diamond search algorithm, directional gradient descent search algorithm, partial distortion search algorithm, transform-domain successive elimination algorithm and two-layer motion estimation algorithm, the proposed algorithm can also save 63.56 %, 52.73 %, 92.87 %, 85.77 % and 33.96 % computational complexity, respectively.     

Adaptive mode decision for multiview video coding based on macroblock position constraint model

Multiview video coding (MVC) exploits mode decision, motion estimation and disparity estimation to achieve high compression ratio, which results in an extensive computational complexity. This paper presents an efficient mode decision approach for MVC using a macroblock (MB) position constraint model (MPCM). The proposed approach reduces the number of candidate modes by utilizing the mode correlation and rate distortion cost (RD cost) in the previously encoded frames/views. Specifically, the mode correlations both in the temporal-spatial domain and the inter-view are modeled with MPCM. Then, MPCM is exploited to select the optimal prediction direction for the current encoding MB. Finally, the inter mode is early determined in the optimal prediction direction. Experimental results show that the proposed method can save 86.03 % of encoding time compared with the exhaustive mode decision used in the reference software of joint multiview video coding, with only 0.077 dB loss in Bjontegaard delta peak signal-to-noise ratio (BDPSNR) and 2.29 % increment of the total Bjontegaard delta bit rate (BDBR), which is superior to the performances of state-of-the-art approaches.     

An AR based fast mode decision for H.265/HEVC intra coding

As a critical technique to raise coding efficiency in H.265/HEVC (H.265/High Efficiency Video Coding), the number of prediction modes for intra coding is much larger than that in H.264/AVC. However, the large number of prediction modes also leads to high complexity. In this paper, an AR (Auto Regression) based fast mode decision method for H.265/HEVC intra coding is proposed, including an AR based fast mode selection and an MPM (Most Probable Mode) joint fast mode selection method. Considering the correlation between SATD (Sum of Absolute Transformed Differences) cost and RD (Rate-Distortion) cost, we establish a selective function controlled by an adaptive parameter which is acquired by an AR model. According to the distribution of the SATD cost, the selective function can decide which modes can be discarded and which modes can be used for the FMD (Fine Mode Decision). In addition, in order to further reduce the number of candidate modes for FMD, an MPM joint fast mode selection method is presented based on the relationship between MPMs and candidate modes. Experimental results show that just in PU layer, the proposed AR based fast intra mode decision method can save encoding time by 32 % with negligible coding loss in all-intra main configuration compared to the intra mode decision of HM13.0.     

HEVC视频编码器快速算法

高效视频编码(HEVC)采用了多种先进的编码工具来大幅度提高压缩效率,但同时也带来了高的编码复杂度。考虑到LCU编码时需遍历所有的CU模式、PU模式和TU模式,来确定当前LCU的最优模式组合,其过程耗时较大。针对这点本文分别对CU、PU和TU提出模式判决过程优化算法,同时,每一种PU模式在进行运动矢量搜索时复杂度较高,继而提出运动估计优化方法。实验结果表明,相比于原始的HEVC编码方法,高速模式判决算法可将编码速度提高近15～20倍。     

H.264/AVC中基于决策树的P帧快速模式选择

目的 H.264/AVC帧间预测编码需要对所有可能编码模式计算并比较率失真代价,众多的模式类型导致了P帧编码的计算复杂度非常高。为此提出一种针对P帧的基于决策树的快速候选模式选择算法。方法在对宏块进行16×16的帧间运动估计后,首先根据残差宏块中4×4全零系数块个数对部分宏块直接选择出候选模式;然后使用16个4×4块的变换域系数绝对值之和(SATD)值,采用决策树分类方法对其余宏块选择候选模式。结果由于只需对候选模式进行编码,因此有效降低了编码器的计算复杂度。实验结果表明,与原始全搜索编码算法相比,该算法对不同运动程度的视频序列获得了较一致的编码时间的节省,同时平均峰值信噪比的损失和平均比特率的增加均较少。结论新的P帧帧间预测候选模式选择算法,根据帧间运动估计后的残差宏块信息,采用决策树方法对候选模式集进行分类。实验结果表明,该算法能在保证视频编码质量的前提下,有效地降低编码过程中的计算量,缩短编码时间。     

Fast Inter Mode Decision Using Spatial Property of Motion Field

Variable size motion estimation with multiple reference frames has been adopted by the new video coding standard H.264. It can achieve significant coding efficiency compared to coding a macroblock (MB) in regular size with single reference frame. On the other hand, it causes high computational complexity of motion estimation at the encoder. Rate distortion optimized (RDO) decision is one powerful method to choose the best coding mode among all combinations of block sizes and reference frames, but it requires extremely high computation. In this paper, a fast inter mode decision is proposed to decide best prediction mode utilizing the spatial continuity of motion field, which is generated by motion vectors from 4 $, times ,$4 motion estimation. Motion continuity of each MB is decided based on the motion edge map detected by the Sobel operator. Based on the motion continuity of a MB, only a small number of block sizes are selected in motion estimation and RDO computation process. Simulation results show that our algorithm can save more than 50% computational complexity, with negligible loss of coding efficiency.      

基于边缘特征的H.264/AVC帧内模式选择算法

为降低H.264帧内预测模式的计算复杂度,提出了一种率失真优化（RDO）准则下的基于边缘特征的快速帧内模式选择算法。该算法根据主要边缘强度（KES）等边缘方向特征,选择出与该特征相对应的模式子集进行RDO计算,大幅度降低了帧内预测的模式选择数;同时将亮度宏块和色度宏块分别优化以降低计算复杂度。仿真结果表明,与原H.264相比,所提出的算法在比特率略有增加和信噪比基本保持不变的条件下,大约减少75%的计算时间,大大降低了算法的计算复杂度;与PAN FENG等人提出的基于Sobel算子的边缘矢量检测算法相比,两者的比特率基本相同,但算法的平均峰值信噪比明显高于PAN的算法,编码时间也有明显降低,同时运算简单规则,更易于VLSI的实现。     

Fast CU size decision and mode decision algorithm for intra prediction in HEVC

In the intra prediction process, High Efficiency Video Coding (HEVC) provides a quadtree-based coding unit (CU) block partitioning structure and up to 35 kinds of prediction modes to improve the coding performance. These technologies improve the coding efficiency significantly while the coding complexity is simultaneously increased rapidly as well. In this paper, a novel fast CU size decision and mode decision algorithm is proposed for the intra prediction of HEVC. The overall algorithm consists of two processes, the fast CU size decision and fast mode decision. In the fast CU size decision process, we adopt an adaptive discretization total variation (DTV) threshold-based CU size determination algorithm to skip some specific depth levels. In the fast mode decision process, an orientation gradient-based mode decision is proposed to reduce the candidate modes involved in the rough mode decision (RMD) and the rate distortion optimization (RDO) process. The experimental results on the HEVC reference software HM demonstrate that the proposed algorithm can significantly reduce the coding time with negligible performance loss.     

Improved rate-distortion optimized video coding using non-integer bit estimation and multiple Lambda search

Many modern video encoders use the Lagrangian rate-distortion optimization (RDO) algorithm for mode decisions during the compression procedure. For each encoding stage, this approach involves minimizing a cost, which is a function of rate, distortion and a multiplier called Lambda. This paper proposes to improve the RDO process by applying two modifications. The first modification is to increase the accuracy of rate estimation, which is achieved by computing a non-integer number of bits for arithmetic coding of the syntax elements. This leads to a more accurate cost computation and therefore a better mode decision. The second modification is to search and adjust the value of Lambda based on the characteristics of each coding stage. For the encoder used, this paper proposes to search multiple values of Lambda for the intra-4×4mode decision. Moreover, a simple shift in Lambda value is proposed for motion estimation. Each of these modifications offers a certain gain in RDO performance, and, when all are combined, an average bit-rate saving of up to 7.0% can be achieved for the H.264/AVC codec while the same concept is applicable to the H.265/HEVC codec as well. The extra added complexity is contained to a certain level, and is also adjustable according to the processing resources available.     

面向视频监控的AVS帧间预测模式快速选择算法*

针对监控视频多噪点以及存在大量静止背景的特点,以AVS视频编码标准为基础,提出了一种结合降采样视频预处理技术和及早停止准则的快速帧间预测模式选择算法。实验结果表明,该算法在保持视频主观质量相当的条件下,编码过程的计算复杂度和码率分别降低了50％和20％左右。     

H.264标准中的宏块编码模式的时空相关性预测算法

与以往的各种视频编码标准相比,H．264视频编码标准在编码效率上获得了相当大的提高。但这是以提高编码的计算复杂度为代价的,其中运动估计和模式选择的计算复杂度最大。文中提出一种宏块编码模式的快速预测算法,该算法首先检查根据宏块编码模式的时空相关性预测得到的模式,再与相应的阈值进行比较,判断是否结束模式选择过程,而不用检查所有的模式。试验结果表明：在保持相近率失真性能的同时,该算法可以有效地降低编码的计算复杂度。