帧间编码模式选择及其择优早期终止的H.264/AVC快速算法

通过研究H.264/AVC帧间编码中最佳模式分布,提出了3种模式选择早期终止策略,分别对SKIP,P16×16,P16×8和P8×16这3类模式成为最佳编码模式进行判断,适当地结束编码模式选择过程,避免了对后面不可能模式率失真代价的计算,从而减少了帧间编码的计算复杂度。实验结果表明,该算法可以减少H.264/AVC编码器50％～70％的编码时间,同时保持与全搜索算法基本一致的编码性能,峰值信噪比PSNR平均下降0.17 dB左右,编码比特率平均增加2.42％。     

H.264帧内预测快速模式选择

H.264/AVC视频编码标准中用率失真优化(RDO)方法为一个宏块(MB)判决最佳编码模式来提高编码效果,加大了算法复杂度并且计算冗余大。为了克服这一缺点,一种快速帧内预测模式选择算法被提出。在色度预测中,根据宏块的色度纹理复杂度,把原先的4种模式降到1或2种;在亮度16×16块模式判决中,根据最小哈达玛变换的绝对误差和(SATD)来选择最佳模式;在亮度4×4块模式判决中,该算法在9种模式中选择3种可能模式作为候选模式。通过比较16个4×4块总代价与1个16×16块的代价来选择最佳块选择模式,实验表明,该算法能在节省69%左右编码时间的情况下,比特率与峰值信噪比(PSNR)保持不变。     

H.264/AVC帧内预测模式选择算法研究

H.264/AVC采用空间域上的帧内预测技术,进一步提高了编码效率,但由于H.264/AVC支持的帧内预测模式数较多,使预测的复杂度大幅度增加。详细分析了帧内预测模式的选择过程,提出一种快速的率失真优化(RDO)模式下的快速Intra_4×4模式选择算法,该算法根据SATD(SumofAbsoluteTransformedDifference)以及相邻块的预测模式之间的相关性等特征,预先排除了超过65%可能性小的Intra_4×4模式,避免了不必要的计算,从而大幅度降低帧内预测的复杂度,同时基本保持了H.264/AVC的编码性能。     

H.264/AVC中基于决策树的P帧快速模式选择（HHME2013第61号论文）

目的：H.264/AVC帧间预测编码需要对所有可能编码模式计算并比较率失真代价,众多的模式类型导致了P帧编码的计算复杂度非常高。本文提出了一种针对P帧的基于决策树的快速选择候选模式算法。方法：在对宏块进行16×16的帧间运动估计后,首先根据残差宏块中4×4全零系数块个数对部分宏块直接选择出候选模式;然后使用16个4×4块的SATD值,采用决策树分类方法对其余宏块选择候选模式。结果：由于只需对候选模式进行编码,因此有效降低了编码器的计算复杂度。实验结果表明,与原始全搜索编码算法相比,该算法对不同运动程度的视频序列获得了较一致的编码时间节省,同时平均峰值信噪比的损失和平均比特率的增加均较少。结论：本文提出了一种新的P帧帧间预测候选模式选择算法,根据帧间运动估计后的残差宏块信息,采用决策树方法对候选模式集进行分类。实验结果表明,该算法能在保证视频编码质量的前提下,有效地降低编码过程中的计算量,缩短编码时间。     

H.264帧内4×4块预测模式选择快速算法研究

在H．264视频编码过程中，编码时间受诸多因素的影响，如帧间／帧内模式选择、运动估计（ME）、率失真优化（RDO）等。为了以较快速度和较好质量进行编码，针对H．264帧内模式选择，提出了一种适用于H．264帧内4×4块预测的模式选择快速算法。该算法利用帧内4×4块最优预测模式与和它相邻的预测模式之间率失真代价（RDCost）的高相关性，以及绝对变换误差和（SATD）与率失真（RD）性能之间的强相关性，有效地跳过一些不太可能的预测模式，从而使帧内4×4块模式选择过程只需进行4次率失真代价计算即可。实验结果显示，该算法在编码性能和编码速度之间取得了很好的折衷。     

H.264/AVC帧间多种块模式的编码性能分析与研究

H.264/AVC是最新的国际视频标准,与其它视频编码标准相比,其在编码效率方面有强大的优势:在相同的重建图像质量下,H.264/AVC比MPEG-2H.263++和MPEG-4的第2部分分别节约64.46%、、48.80%和38.62%的码率。但H.264/AVC中编码效率的提高是以增加巨大的运算量为前提的。该文在介绍H.264/AVC中的宏块分块模式、运动估计及模式选择算法的基础上,重点对各种帧间块模式下的运动估计及4×4亮度变换与量化操作进行了分析,然后对各种帧间块模式的组合进行了实验研究,实验结果表明,当帧间只用块模式1～4时,在相同的比特率下客观图像质量亮度分量的PSNR比帧间使用全部块模式时平均降低0.13dB,而编码的时间平均能减少40%左右。     

H.264帧内预测编码模式选择的快速算法研究

H.264引入帧内预测编码并用率失真优化（RDO）进行预测模式选择,显著提高了压缩率,但增加了计算复杂性。H.264帧内预测编码包括Intra_4×4、Intra_16×16两种预测模式,在分析此两种帧内预测模式特性的基础上,提出设置阈值的方法来快速选择Intra_4×4、Intra_16×16预测模式的最优模式,并以此对原算法进行了改进。仿真实验表明,改进的算法在保持PSNR基本不变和码率微小增加的情况下,计算量能显著减少。     

一种基于H.264/AVC的帧内预测模式选择快速算法

视频编码标准H.264/AVC用帧内和帧间模式预测来提高率失真性能。但是这种多模式选择和穷举式搜索大大增加了编码复杂度。本文提出了一种帧内预测模式选择快速算法,其i核心思想是根据已确定的Intra_16x16最优预测模式来削减Intra_4x4块的预测模式数。通过本算法,可在比特率和PSNR值基本上不变的情况下使得H.264/AVC编码时间大为降低。     

一种基于H.264/AVC的帧内预测模式快速选择算法

在H.264/AVC中,帧内编码是采用帧内预测来提高编码效率,其色度块尺寸为8×8,亮度块包括4×4和16×16两种尺寸。由于每种块可提供多种预测模式,因此这种多模式选择大大增加了编码的复杂性。针对这种多模式选择,为了加快编码速度,利用色度块和亮度块以及亮度4×4和16×16块模式选择之间的关系,提出一种基于RDO(rate d istortion optim ization)的不同判决依据的快速帧内预测模式选择算法。实验证明,在信噪比和码率变化不大的同时,该算法可使编码速度平均提高6倍。     

基于H.264宏块预判断的快速帧内算法

针对视频压缩标准H.264/AVC 的压缩率很高,但其算法复杂、编码时间较长,提出了基于MAD值的宏块模式选择的预判断;针对帧内4×4块,提出利用相邻块和相邻方向预测模式的相关性进行帧内模式预测。实验结果表明,与全搜索算法相比,在采用全I帧编码的情况下,该算法的编码时间减少73%,输出的视频比特率仅增加2.14%,且PSNR 基本保持不变。     

基于宏块的具有时域和SNR精细可伸缩性的视频编码

提出了一个高效灵活的视频编码方法，称为基于宏块的具有时域和SNR精细可伸缩性的视频编码方法（简称为PFGST视频编码方法），将原有的基于帧的渐进精细可伸缩的视频编码技术扩展为基于宏块的编码技术，即增强层编码中运动补偿和重建时所用的参考信息是基于宏块选择的而不是基于帧、然后将时域可伸缩特性引入到基于宏块的渐进精细可伸缩的视频编码中，从而实现了PFGST编码方案，在时域可伸缩的增强层编码中，根据运动补偿中使用的参考宏块的不同，提出了时域可伸缩增强层宏块编码的两种方法，由于在时域可伸缩的增强层编码中使用高质量的参考宏块不会造成任何误差传播，因此通过选用最佳的参考宏块，PFGST方法的编码效率得到了显著的提高，实验结果显示，同MPEG－4标准中的FGST编码方法相比，基于宏块的PFGST视频编码技术的编码效率提高了2．8dB，并且同样具有FGST的所有特性，即可以根据不同的通道，客户和服务器的需求来分别支持精细的SNR可伸缩特性，时域可伸缩特性和SNR－时域混合可伸缩特性。     

Low-delay rate control for real-time H.264/AVC video coding

This paper presents an efficient rate control scheme for the H.264/AVC video coding in low-delay environments. In our scheme, we propose an enhancement to the buffer-status based H.264/AVC bit allocation method. The enhancement is by using a PSNR-based frame complexity estimation to improve the existing mean absolute difference based (MAD-based) complexity measure. Bit allocation to each frame is not just computed by encoder buffer status but also adjusted by a combined frame complexity measure. To prevent the buffer from undesirable overflow or underflow under small buffer size constraint in low delay environment,the computed quantization parameter (QP) for the current MB is adjusted based on actual encoding results at that point. We also propose to compare the bits produced by each mode with the average target bits per MB to dynamically modify Lagrange multiplier (/spl lambda//sub MODE/) for mode decision. The objective of QP and /spl lambda//sub MODE/ adjustment is to produce bits as close to the frame target as possible, which is especially important for low delay applications. Simulation results show that the H.264 coder, using our proposed scheme, obtains significant improvement for the mismatch ratio of target bits and actual bits in all testing cases, achieves a visual quality improvement of about 0.6 dB on the average, performs better for buffer overflow and underflow,and achieves a similar or smaller PSNR deviation.     

一种通用的视频传输端到端失真度估算方法

在综合考虑差错扩散、差错掩盖策略及信道误码率的基础上,从像素级对端到端的视频传输差错扩散失真情况进行了分析,根据帧间相关系数和掩盖比率,提出了一种适用于各种时域差错掩盖方法的通用传输失真度估算模型.基于包丢失的仿真实验表明,该模型能够较好地近似估计出差错扩散失真情况,可以适应于各种不同的时域掩盖方法.实验还显示,基于该模型的宏块编码模式的帧内更新选择,与传统的R-D模式帧内更新算法相比,达到了较好地抑制差错扩散的效果,可适用于多种时域掩盖方法.     

H.264中基于上下文的参考帧选择算法

多参考帧选择技术提高了有暴露背景或新增景物区域的编码效率,但对视频编码性能的提升不大。该文提出基于上下文的多参考帧选择算法,利用宏块的运动特性决定当前宏块搜索的最大参考帧数目,通过分析当前参考帧预测的结果,动态地判断是否需要进行下一参考帧预测。实验结果表明,在编码质量接近全搜索算法的基础上,该算法搜索速度为全搜索算法的2.10倍~2.65倍。     

Fast Inter Mode Decision Using Spatial Property of Motion Field

Variable size motion estimation with multiple reference frames has been adopted by the new video coding standard H.264. It can achieve significant coding efficiency compared to coding a macroblock (MB) in regular size with single reference frame. On the other hand, it causes high computational complexity of motion estimation at the encoder. Rate distortion optimized (RDO) decision is one powerful method to choose the best coding mode among all combinations of block sizes and reference frames, but it requires extremely high computation. In this paper, a fast inter mode decision is proposed to decide best prediction mode utilizing the spatial continuity of motion field, which is generated by motion vectors from 4 $, times ,$4 motion estimation. Motion continuity of each MB is decided based on the motion edge map detected by the Sobel operator. Based on the motion continuity of a MB, only a small number of block sizes are selected in motion estimation and RDO computation process. Simulation results show that our algorithm can save more than 50% computational complexity, with negligible loss of coding efficiency.      

A Novel MBAFF Scheme of AVS

Adaptive frame/field coding techniques have been adopted in many international video standards for interlaced sequence coding. When the frame/field adaptation is applied on the picture level, the coding efficiency is improved greatly, compared with the pure frame coding or the pure field coding. The picture-level adaptive frame/field coding （PAFF） selects frame coding or field coding once for one picture. If this frame/field adaptation is extended to Macro Block （MB） level, the coding efficiency will be further increased. In this paper, a novel MB-level adaptive frame/field （MBAFF） coding scheme is proposed. In the proposed MBAFF scheme, the top field of the current picture is used as a reference. The experiments are implemented on the platforms of Audio Video coding Standard （AVS） base profile and H.264/AVC, respectively. On the AVS platform, 0.35dB gain can be achieved averagely, compared with AVS1.0 anchor. On the H.264/AVC platform, 0.16dB gain can be achieved averagely, compared with MBAFF scheme of H.264/AVC. Additionally, an extensive subjective quality enhancement can be achieved by the proposed scheme.     

Perceptual rate-distortion optimization for H.264/AVC video coding from both signal and vision perspectives

Recent researches have shown that the Structural SIMilariy (SSIM)-based Rate-Distortion Optimization (RDO) can obtain more structural information than the traditional SSE-based RDO for video coding. Correspondingly, the perceptual video quality is improved at certain degree for the video stream encoded by the SSIM-based RDO. However, for the MB with significant luminance change (due to the flashlight or sunshine change, etc.) but little structure change compared to the co-located MB in the referred frame, the SSIM-based RDO may select improper encoding mode (SKIP) which leads to uncomfortable visual experience. In this paper, involving the surrounding pixels of the current coding MB into the measurement of spacial texture quality degradation, the RDO which jointly considers the SSIM-based distortion and SSE-based distortion is proposed to improve H.264/AVC perceptual coding performance. The Lagrange multiplier in the proposed RDO is firstly derived at the frame level. Then, to make the Lagrange multiplier more adaptive to the specific video content, the Lagrange multiplier for each individual MB is refined based on the visual information theory. Experimental results show that the proposed perceptual RDO can select the optimal encoding mode which preserves as much structural information as possible with as little SSE-based distortion as possible, and that the perceptual quality of the encoded video is improved.     

Adaptive mode decision for multiview video coding based on macroblock position constraint model

Multiview video coding (MVC) exploits mode decision, motion estimation and disparity estimation to achieve high compression ratio, which results in an extensive computational complexity. This paper presents an efficient mode decision approach for MVC using a macroblock (MB) position constraint model (MPCM). The proposed approach reduces the number of candidate modes by utilizing the mode correlation and rate distortion cost (RD cost) in the previously encoded frames/views. Specifically, the mode correlations both in the temporal-spatial domain and the inter-view are modeled with MPCM. Then, MPCM is exploited to select the optimal prediction direction for the current encoding MB. Finally, the inter mode is early determined in the optimal prediction direction. Experimental results show that the proposed method can save 86.03 % of encoding time compared with the exhaustive mode decision used in the reference software of joint multiview video coding, with only 0.077 dB loss in Bjontegaard delta peak signal-to-noise ratio (BDPSNR) and 2.29 % increment of the total Bjontegaard delta bit rate (BDBR), which is superior to the performances of state-of-the-art approaches.     

H.264/SVC mode decision based on mode correlation and desired mode list

Design of video encoders involves implementation of fast mode decision (FMD) algorithm to reduce computation complexity while maintaining the performance of the coding. Although H.264/scalable video coding (SVC) achieves high scalability and coding efficiency, it also has high complexity in implementing its exhaustive computation. In this paper, a novel algorithm is proposed to reduce the redundant candidate modes by making use of the correlation among layers. A desired mode list is created based on the probability to be the best mode for each block in base layer and a candidate mode selection in the enhancement layer by the correlations of modes among reference frame and current frame. Our algorithm is implemented in joint scalable video model (JSVM) 9.19.15 reference software and the performance is evaluated based on the average encoding time, peak signal to noise ration (PSNR) and bit rate. The experimental results show 41.89% improvement in encoding time with minimal loss of 0.02 dB in PSNR and 0.05% increase in bit rate.     

存储应用中AVS编码的可变码率控制

针对数字视频存储应用,分析二次编码可变码率（VBR）控制的原理和特性,提出一种固定容量视频存储应用的可变码率控制算法。对序列进行恒定码率编码,统计并记录重要的编码信息。在数据处理阶段分析每个场景的复杂度等视频特性并预分配比特数。对同一个序列进行二次VBR编码。实验结果表明,采用该算法能获得PSNR波动很小的高质量视频。