H.264中基于先验预测的帧间编码模式选择算法研究

帧间编码的模式选择算法是H.264视频编码器中计算量较大的部分。该文首先简要介绍了H.264帧间多模式编码原理,然后对帧间编码的最佳模式进行统计、分析,提出了一种基于先验预测的帧间编码模式选择快速算法。仿真实验结果表明该文提出的快速模式选择策略可以在保证视频编码质量的同时,很大程度上降低编码器的计算复杂度。     

融合宏块平坦度和时空相关性的预测模式选择算法

H.264/AVC以巨大编码复杂度为代价,在获得更高压缩率的同时,编码实时性也随之降低。针对视频编码中重要且耗时的帧间预测技术,分析了宏块平坦度和时空相关性,提出了一种快速的预测模式选择算法。仿真实验结果表明,本文提出算法与H.264/AVC(JM12.2)标准算法相比,在保持重建视频图像质量和输出码流结构的前提下,平均节省约70%的编码时间,并继承了H.264/AVC低码率的编码优势。     

H．264视频编码技术研究

H．264作为新一代的视频编码标准,在近年来成为首选的视频标准。为了提高视频编码效率,H．264已采用了许多新技术,但仍面临一些瓶颈问题,影响其编码效率。结合JM8．6从视频编码层出发对H．264的帧间预测、帧内预测、变换及熵编码进行了分析和研究。结合实验分析得出帧内及帧间预测模式的概率,结果说明H．264复杂度和实时性能仍有待进一步的改善。     

一种基于H．264的有效运动估计算法

运动估计算法是实时视频编解码技术的研究重点，高精度的匹配和补偿可以减少预测误差，提高视频图像的压缩效果．为降低在视频编码标准H．264中运动估计的高计算复杂度问题，提出了采用一种基于节点模型的可变形块匹配运动估计算法来搜索最佳运动矢量．该算法充分利用了H．264运动矢量的的统计特性和相关性，并采用基于像素差值分类的运动估计匹配准则．实验表明，在编码性能损失很小的条件下，该算法有效降低了视频压缩编码中运动估计的运算复杂度．     

基于多参考帧的平行立体视频视间编码的实现

Side-by-Side(SbS)是立体视频常用的格式。传统的视频编码方法利用帧内预测或帧间预测对视频进行压缩编码。基于H.264视频压缩编码标准,针对SbS格式的立体视频提出了一种基于多参考帧方式的视间预测编码方法,并在JM测试代码基础上将其实现。实验结果表明,加入视间预测编码后,以很小的PSNR损失为代价,使得SbS视频的压缩效率提高了大约10%～20%。     

H.264中的运动估计和帧内预测算法研究

 针对一些算法过早的确定搜索方向,容易陷入局部最优点缺失搜索准确度的情况,提出一种新的基于搜索方向预测的运动估计算法.实验结果表明,与单一搜索图形相比,该算法具有更高的搜索精度和搜索速度.帧内预测技术作为影响帧编码效率的关键,一直被广泛研究,为此,本文提出了一种快速的帧内预测算法,对宏块划分提出了新的"模板"宏块对比算法思想,并在已有的抽样算法和搜索窗算法的基础上,提出了改进方法.实验结果证明,算法在不降低图像质量的基础上,编码速度平均提高80%.     

一种基于多参考帧的平行立体视频视间编码实现方法

Side-by-Side（SbS）是立体视频常用的格式。传统的视频编码方法利用帧内预测或帧间预测对视频进行压缩编码。本文基于H.264视频压缩编码标准,针对SbS格式的立体视频提出了一种基于多参考帧方式的视间预测编码方法,并在JM测试代码基础上将其实现。实验结果表明,加入视间预测编码后,以很小的PSNR损失为代价,使得SbS视频的压缩效率提高了大约10%至20%。     

基于H.264的内容自适应分数像素运动估计算法

分数像素精确运动估计的改进是整个运动估计模块优化的关键,本文提出了基于H.264的内容自适应分数像素运动估计算法。首先,提出基于平坦区域宏块预测的无效分数像素运动矢量(MV)搜索省略算法(SMBP);然后,改进H.264采用的基于中心的分数像素搜索算法(CBFPS),提出基于预测矢量的增强型菱形模板(EDSP)搜索算法。实验结果表明,内容自适应分数像素运动估计算法比分数像素全搜索算法(FFPS)在峰值信噪比(PSNR)有微小降低(0.095～0.209 dB)的情况下,平均减少了75.6%的分数像素搜索点,整个运动估计模块平均节省了38.5%的计算量。     

Computation-aware fast motion estimation for H.264/AVC using image indexing

The key to designing a real-time video coding system is efficient motion estimation, which reduces temporal redundancies. The motion estimation of the H.264/AVC coding standard can use multiple references and multiple block sizes to improve rate-distortion performance. The computational complexity of H.264 is linearly dependent on the number of allowed reference frames and block sizes using a full exhaustive search. Many fast block-matching algorithms reduce the computational complexity of motion estimation by carefully designing search patterns with different shapes or sizes, which have a significant impact on the search speed and distortion performance. However, the search speed and the distortion performance often conflict with each other in these methods, and their high computational complexity incurs a large amount of memory access. This paper presents a novel block-matching scheme with image indexing, which sets a proper priority list of search points, to encode a H.264 video sequence. This study also proposes a computation-aware motion estimation method for the H.264/AVC. Experimental results show that the proposed method achieves good performance and offers a new way to design a cost-effective real-time video coding system.     

Selective VS-MRF-ME and intra coding in H.264 based on spatiotemporal continuity of motion field

The new video coding standard, H.264 uses variable size motion estimation (VS-ME), multiple reference frame motion estimation (MRF-ME) and spatial-based intra prediction with selectable block size in inter frame coding. These tools have achieved significant coding efficiency compared to coding a macroblock (MB) only based on motion-compensation in regular size with single reference frame. However, these new features also give rise to an exhaustive computation in the coding procedure since there are so many combinations of coding modes and reference frames to be tried. In this paper, a fast motion estimation algorithm based on the selective VS-MRF-ME and intra prediction is proposed to reduce H.264 coding computational complexity. The basic idea of the method is to utilize the spatiotemporal property of motion field in predicting where VS-MRF-ME and intra prediction are needed, and only in these regions VS-MRF-ME and intra coding are enabled. The motion field is generated by motion vectors from 16×16 motion estimation on the nearest reference frame. Simulation results show that the proposed algorithm can save 50% computational complexity on average, with negligible loss of coding efficiency.     

A 3D-DCT video encoder using advanced coding techniques for low power mobile device

The three-dimensional discrete cosine transform (3D-DCT) has been researched as an alternative to existing dominant video standards based on motion estimation and compensation. Since it does not need to search macro block for inter/intra prediction, 3D-DCT has great advantages for complexity. However, it has not been developed well because of poor video quality while video standards such as H.263(+) and HEVC have been blooming. In this paper, we propose a new 3D-DCT video coding as a new video solution for low power mobile technologies such as Internet of Things (IoT) and Drone. We focus on overcoming drawbacks reported in previous research. We build a complete 3D-DCT video coding system by adopting existing advanced techniques and devising new coding algorithms to improve overall performance of 3D-DCT. Experimental results show proposed 3D-DCT outperforms H.264 low power profiles while offering less complexity. From GBD-PSNR, proposed 3D-DCT provides better performance by average 4.6 dB.     

Hybrid motion estimation scheme for secondary SP-frame coding using inter-frame correlation and FMO

To cope with considerable size of secondary SP-frames, quantized-transform domain motion estimation has recently been proved to be appropriate for the coding of secondary SP-frames in H.264/AVC. Nevertheless, its computational complexity is tremendous and there are still some situations that pixel-domain motion estimation can perform better. Both techniques are therefore not implemented solely in secondary SP-frame coding. In this paper, a hybrid scheme is proposed to effectively combine two existing motion estimation techniques. The combination is based on a new measurement of inter-frame correlation using the bit-counts of the macroblocks in SP-frames, so that the hybrid scheme is dominated by employing quantized-transform domain motion estimation in the macroblocks with weaker inter-frame correlation; otherwise, it approaches to pixel-domain motion estimation. With the further help of the explicit mode in Flexible Macroblock Ordering (FMO), the proposed hybrid scheme classifies MBs into two slice groups by examining the domain used in motion estimation prior to coding motion vectors in a secondary SP-frame. The slice structure of a secondary SP-frame using the explicit FMO mode is flexible and can be changed during the encoding of each new frame. Simulation results show that our proposed scheme overwhelmingly outperforms the quantized-transform domain motion estimation scheme. As a consequence, the size of secondary SP-frames can be reduced remarkably with significant computational reduction.     

一种H.264运动估计器的VLSI设计

MPEG4AVC／ITU—T H．264视频编码标准中所采用的多模式运动估计算法与传统的MPEG4、H．263 高级预测模式相比较而言，编码效率和性能都大大提高。但其诸如模式决策等问题却给运动估计器，特别是硬件运动估计器带来非常大的运算复杂度。本文提出一种H．264运动估计器硬件结构，它采用了新的模式决策算法和快速运动估计算法。仿真结果证明，这两种算法不但能使运动估计器降低其硬件实现成本，而且能减少模式决策和运动估计的时间。     

一种基于H.264/AVC的鲁棒性视频水印算法的研究

依据 H.264视频编码标准提出一种视频水印方案。结合H.264帧间预测编码的特点以及人类视觉系统原理,选择P帧宏块中的MV作为水印信息嵌入的对象,对MV进行量化处理,得到两个互相独立的区域。根据水印信息的不同,修改MV,使其指向不同的区域,对其采用扩频技术来实现水印嵌入,以提高水印的鲁棒性。实验结果表明,新方案能够抵抗重编码压缩、加载噪声、旋转等多种攻击,鲁棒性良好。     

A novel moving object segmentation framework utilizing camera motion recognition for H.264 compressed videos

This paper presents a novel coarse to fine moving object segmentation framework for H.264/AVC compressed videos. The proposed framework integrates the global motion estimation and global motion compensation steps in the segmentation pipeline unlike previous techniques which did not consider such an integration. The integration is based on testing for presence of global motion by classifying the interframe motion vectors into moving camera class and still camera class. The decision boundary separating these two classes is learnt from the training video data. The integration automates the moving object segmentation to be applicable for static, moving and combination of static/moving camera cases which to the best of our knowledge has not been carried out earlier. Further, a novel coarse segmentation technique is proposed by decomposing the inter-frame motion vectors into wavelet sub-bands and utilizing logical operations on LH, HL and HH sub-band wavelet coefficients. The premise is based on the fact that since the LH, HL and HH sub-bands contain the detail information pertaining to horizontal, vertical and diagonal moving blocks respectively, they can be exploited to identify the coarse moving boundaries. The coarse segmentation is fast in comparison to state-of-the-art coarse segmentation methods as demonstrated by our experiments. Finally, these coarse boundaries are modeled in an energy minimization framework and shown that by minimizing the energy using graph cut optimization the segmentation is refined to obtain the fine segmentation. The proposed framework is tested on a number of standard video sequences encoded with H.264/AVC JM encoder and comparison is carried out with state-of-the-art compressed domain moving object segmentation methods as well as with an existing state-of-the-art pixel domain method to establish and validate the proposed moving object segmentation framework.     

一种适宜于H.264/AVC的帧间快速编码算法

针对新一代视频编码技术H.264/AVC编码计算复杂 度较高,为提高其编码速度,提出了一种新的适宜于H.264/AVC 的帧间快速编码算法。首先利用运 动和纹理预测可能的编码模式,排除可能性较小的模式;然后利用时间和空间相关性预测各 种编码模式的 可能性大小和编码顺序,并结合相关性和量化参数利用率失真和残差系数提前终止。实验结 果表明,本文算法编码速度能提高72%左右,同时对编码效率影响很小。     

结合空时域下采样与重建的H.264/AVC压缩性能优化

为提高H.264/AVC标准在带宽资源严重受限时的压缩效率,采用空时域相结合的编码思路,提出了一种基于运动检测的自适应抽帧方法,并结合空域下采样与重建研究了一种改进的H.264/AVC压缩性能优化框架。在编码端,原视频先空域下采样以减少空间分辨率,然后根据视频运动特征,采用不同抽帧模式自适应地降低帧率,再经H.264/AVC编码,有效降低了编码码率。在解码端,解码视频则采用与抽帧模式相对应的运动估计与补偿插帧方法重建出抽取帧,再利用超分辨率重建技术将视频恢复到原空间分辨率。实验结果表明,所提方法在低码率段的视频压缩性能优于H.264/AVC标准编解码及相关文献方法。     

New rate-distortion modeling and efficient rate control for H.264/AVC video coding

Rate control (RC) is crucial in controlling compression bit rates and qualities for networked video applications. In this paper, we propose a new rate-distortion (R-D) model and an efficient rate control scheme for H.264/AVC video coding, which elegantly resolve the inter-dependency problem between rate-distortion optimization and rate control by eliminating the need of coding complexity prediction for an inter-frame. The objective is to achieve accurate bit rate, obtain optimal video quality while reducing quality variations and simultaneously handling buffer fullness effectively. The proposed algorithm encapsulates a number of new features, including a coding complexity measure for intra-frames, a rate-distortion model, an accurate quantization parameter (QP) estimation for intra-frames, an incremental quantization parameter calculation method for inter-frames, a proportional+integral+derivative (PID) buffer controller, and an intelligent bit-allocation-balancing technique. Our experimental results demonstrate that the proposed scheme outperforms the JVT-G012 solution by providing accurate rate regulation, effectively reducing frame skipping, and finally improving coding quality by up to 1.80 dB.     

Fast multi-frame motion estimation for H264/AVC system

Advanced video compression standard, H264/AVC, with multi-frame motion estimation, can offer better motion-compensation than the previous coding standards. However, the implementation of real-time multi-frame estimation for an H264/AVC system is difficult due to heavy computations. In this paper, a fast algorithm is proposed in an effort to reduce the searching computation for motion estimation with five reference frames. The fast multi-frame motion estimation consists of the adaptive full-search, three-step search, and diamond search methods using the content adaptive control process. Efficient control flow is proposed to select the searching algorithm dependent on video features. The adaptive algorithm can achieve better rate-distortion and lower computation for H264/AVC coding. The experiments indicate that the speed-up is 6–15 times compared with the full search method, while the image quality slightly degrades.