多视点视频双向实时转码技术的设计与实现

目的 多视点视频编码标准－MVC是国际标准组织针对3D视频制定的编码标准,支持实时编码和兼容已有H.264标准是MVC应用推广迫切需要解决的问题。方法 本文基于拓扑排序,提出一种二维预测结构到一维参考序列的映射变换机制,利用已有的H.264编码单元技术,实现了MVC-H.264双向实时转码。结果 实验表明该方法能够兼容现有的H.264编解码器,支持高清MVC实时编码,并通过3D视频直播实际应用验证了方法的有效性。结论 本文给出了MVC与H.264标准间进行预测参考结构映射和码流转换的机制,无需设计专用芯片就能同时兼容H.264和MVC标准。     

A low energy adaptive motion estimation hardware for H.264 multiview video coding

Multiview video coding (MVC) is the process of efficiently compressing stereo (two views) or multiview video signals. The improved compression efficiency achieved by H.264 MVC comes with a significant increase in computational complexity. Temporal prediction and inter-view prediction are the most computationally intensive parts of H.264 MVC. Therefore, in this paper, we propose novel techniques for reducing the amount of computations performed by temporal and inter-view predictions in H.264 MVC. The proposed techniques reduce the amount of computations performed by temporal and inter-view predictions significantly with very small PSNR loss and bit rate increase. We also propose a low energy adaptive H.264 MVC motion estimation hardware for implementing the temporal and inter-view predictions including the proposed computation reduction techniques. The proposed hardware is implemented in Verilog HDL and mapped to a Xilinx Virtex-6 FPGA. The FPGA implementation is capable of processing 30 × 8 = 240 frames per second (fps) of CIF (352 × 288) size eight view video sequence or 30 × 2 = 60 fps of VGA (640 × 480) size stereo (two views) video sequence. The proposed techniques reduce the energy consumption of this hardware significantly.     

H.264/AVC中基于决策树的P帧快速模式选择（HHME2013第61号论文）

目的：H.264/AVC帧间预测编码需要对所有可能编码模式计算并比较率失真代价,众多的模式类型导致了P帧编码的计算复杂度非常高。本文提出了一种针对P帧的基于决策树的快速选择候选模式算法。方法：在对宏块进行16×16的帧间运动估计后,首先根据残差宏块中4×4全零系数块个数对部分宏块直接选择出候选模式;然后使用16个4×4块的SATD值,采用决策树分类方法对其余宏块选择候选模式。结果：由于只需对候选模式进行编码,因此有效降低了编码器的计算复杂度。实验结果表明,与原始全搜索编码算法相比,该算法对不同运动程度的视频序列获得了较一致的编码时间节省,同时平均峰值信噪比的损失和平均比特率的增加均较少。结论：本文提出了一种新的P帧帧间预测候选模式选择算法,根据帧间运动估计后的残差宏块信息,采用决策树方法对候选模式集进行分类。实验结果表明,该算法能在保证视频编码质量的前提下,有效地降低编码过程中的计算量,缩短编码时间。     

H.264/AVC中基于决策树的P帧快速模式选择

目的 H.264/AVC帧间预测编码需要对所有可能编码模式计算并比较率失真代价,众多的模式类型导致了P帧编码的计算复杂度非常高。为此提出一种针对P帧的基于决策树的快速候选模式选择算法。方法在对宏块进行16×16的帧间运动估计后,首先根据残差宏块中4×4全零系数块个数对部分宏块直接选择出候选模式;然后使用16个4×4块的变换域系数绝对值之和(SATD)值,采用决策树分类方法对其余宏块选择候选模式。结果由于只需对候选模式进行编码,因此有效降低了编码器的计算复杂度。实验结果表明,与原始全搜索编码算法相比,该算法对不同运动程度的视频序列获得了较一致的编码时间的节省,同时平均峰值信噪比的损失和平均比特率的增加均较少。结论新的P帧帧间预测候选模式选择算法,根据帧间运动估计后的残差宏块信息,采用决策树方法对候选模式集进行分类。实验结果表明,该算法能在保证视频编码质量的前提下,有效地降低编码过程中的计算量,缩短编码时间。     

基于嵌入式处理器的H .264编码器的存储优化

由于H.264/AVC新标准采用了很多新技术，在可编程处理器的应用领域中，如果不进行优化将会需要非常大的存储空间。该文对编码器的存储复杂度进行了分析，在此基础上提出了基于宏块级的滤波和插值算法。为了便于嵌入式处理器的实现，提出了一种高效的内存管理调度策略。实验结果表明，优化方法在极大地降低存储复杂度(cycle:64.9%)的同时得到了更高的编码速率(76.6%)，而只有很小的编码效率损失。     

Incremental rate control for H.264 AVC scalable extension

The emerging H.264 Scalable Video Coding (H.264/SVC) requires the rate control algorithm to regulate the output bit rate of all the coarse-grain-scalability, temporal, spatial and combined enhancement layers. In order to address this topic, in this research, we propose an incremental rate control algorithm for H.264/SVC to control each layer’s encoding rate close to the target bit rate. The proposed algorithm introduces a number of efficient methods. First, based on our previous work on H.264/AVC rate control, a Rate-Complexity-Quantization (R-C-Q) model is extended in scalable video coding. Second, a complexity measure for Intra-frames based on their gradient and histogram information is used to precisely determine Quantization Parameters (QPs) for Intra-frames using the R-C-Q model. Third, we adopt an incremental approach to compute QPs of inter-frames. Fourth, a Proportional + Integral + Derivative (PID) buffer controller is presented to provide robust buffer control for each layer of H.264/SVC bitstream. Finally the QPs for hierarchical B-frames are adaptively decided by their neighbor inter-frames. Our extensive simulation results demonstrate that, our algorithm outperforms JVT-W043 rate control algorithm, adopted in the H.264/SVC reference software, by providing more accurate output bit rate for each layer, maintaining stable buffer fullness, reducing frame skipping finally, improving the overall coding quality.     

A fast two-step block type decision algorithm for intra prediction in H.264/AVC high profile

Intra coding in H.264/AVC can significantly improve the compression efficiency but at the cost of high computational complexity. To reduce the complexity, this paper presents an efficient block type decision algorithm for intra prediction. In H.264/AVC high profile, three kinds of block types are supported. This algorithm determines the optimal block type by two steps. The first step is based on the fact that the block type of intra prediction is highly dependent on the smoothness of macroblock. An edge-based feature is introduced to characterize the smoothness, by comparing it with two thresholds impossible block type is firstly filtered out. Then the second step is based on the correlation of block type chosen for different chroma modes. Experimental results show that the proposed fast algorithm can achieve 72.8% time saving on average for encoding the all intra-frame sequence with average 0.75% bit rate increase and 0.05dB PSNR degradation when comparing with the reference software.     

基于可变尺寸块运动矢量恢复的H.264时域差错掩盖算法

针对H.264帧间预测编码的新特点,提出了一种基于可变尺寸块运动矢量恢复的时域差错掩盖算法。该算法首先利用相邻宏块编码模式的相关性,根据周围宏块的编码模式判断受损宏块的编码模式及运动矢量恢复的宏块划分方式,分别对各个划分的子块进行运动矢量的恢复;然后利用相邻块运动矢量参考帧的相关性,根据相邻块运动矢量的参考帧确定匹配使用的参考帧;最后采用边缘失真匹配方法恢复运动矢量。实验结果表明,该算法同传统的差错掩盖算法相比,由于支持不同尺寸块运动矢量的恢复,因此,算法对差错信号能够获得更好的恢复效果。     

Lossless video coding based on pixel-wise prediction

The state-of-the-art H.264/AVC was designed for lossy video coding in the beginning. Recently, the H.264/AVC FRExt was developed by removing transformation and quantization for lossless coding. In this paper, we propose an efficient intra lossless coding method based on a pixel-wise prediction. The proposed algorithm introduces an additional intra prediction mode that employs the LOCO-I predictor of JPEG LS. We found that the proposed lossless coding algorithm achieved approximately 22.0, 2.6, and 10.7% bit saving in terms of compression ratio, compared to the H.264/AVC FRExt, lossless intra 4:4:4, and Takamura’s lossless coding methods, respectively.     

Transport analysis and quality evaluation of MVC video streaming

This paper explores the performance of the emerging H.264/MVC standard for stereo video under various packetization schemes, encoding parameters and network conditions. An experimentation test-bed platform has been developed to support the multi session transmission approach for various video packetization options under various number of NAL units per frame. The paper presents measurements in terms of overhead as well as 3D video quality for sequences with different characteristics in terms of spatial resolution and motion. Extensive test-bed experiments indicate that the fragmentation of frames in more than one NAL units improves the perceived video quality measured objectively in terms of PSNR, VQM, SSIM for both base and non-base view as well as, subjectively in terms of 3D MOS.     

一种密集相机阵列的低复杂度视频压缩方法

为了降低多视点视频压缩的复杂度，根据密集相机阵列系统与Wyner—Ziv编码的特点，提出了基于Wyner—Ziv编码的密集相机阵列低复杂度视频压缩算法。该算法首先在各相机之间相互独立地采用基于感兴趣区提取的低复杂度来进行Wyner—ziv编码，然后在中心解码端利用各视点间的相关性进行联合解码。该算法是通过对DCT量化系数进行相似性判断来提取感兴趣区，以有效地避免对背景和平坦等区域进行编码，从而降低了编码复杂度。实验证明，该算法具有极低的编码复杂度特性和良好的率失真性能，编码复杂度仅为H．264帧间预测编码的1／22。     

An Efficient Mode Decision Algorithm for H.264/AVC Encoding Optimization

The H.264 video coding standard significantly outperforms previous standards in terms of coding efficiency. However, this comes as a cost of extremely high computational complexity due to mode decision where variable block size motion estimation (ME) is employed. In this paper, we propose an efficient algorithm to jointly optimize mode decision and ME. A theoretical analysis is performed to study the sufficient condition to detect all-zero blocks in H.264, and thus adaptive thresholds are derived to early terminate mode decision and ME. Besides the aforementioned early termination technique, the proposed algorithm also introduces temporal-spatial checking, thresholds based prediction and monotonic error surface based prediction methods to skip checking unnecessary modes. Experimental results demonstrate that the proposed algorithm can significantly reduce the computational complexity of H.264 encoding while maintaining almost the same rate distortion (RD) performance as the original encoder     

基于H.264的多视点立体视频解码器优化算法研究*

与平面(单视点)视频相比,多视点立体视频的数据量成倍地增加,对解码速度以及播放的流畅性影响很大,成为限制其广泛应用的重要因素之一。为了提高多视点立体视频的解码速度,基于H.264/MVC标准,根据码字前缀的特点,将原有码表划分为若干区域,精确了查表范围,优化了熵解码中CAVLC的查表过程,并将优化后的解码器移植到播放器中。实验结果表明,提出的优化算法使查表部分的速度提高70%左右,整体解码时间提高了5.9%。最终达到了一定的解码优化效果,并实现了播放器对264格式8视点立体视频文件的解码及播放功能。     

H.264帧内预测模式的快速选择算法

为了降低H.264标准中帧内预测模式选择的复杂度,提出一种快速的帧内预测方法.H.264采用率失真优化(RDO)算法,通过计算所有预测组合模式的率失真代价来确定宏块的最优编码模式,其计算复杂度非常大.提出的帧内预测快速选择方法利用宏块的绝对误差和(SAD)来缩小预测模式的范围,减少帧内预测的计算量,从而提高模式判别的速度.实验结果表明,在图像质量和码率基本保持不变的情况下,该算法使Ⅰ帧的编码速度提高约76%.     

基于H.264的多参考帧运动估计快速算法

H.264/AVC中引入多参考帧运动补偿来提高视频编码性能,由此产生的多参考帧运动估计(MRF-ME)却带来了巨大的运算代价。为提高编码速度,降低计算复杂度,提出一种基于空间域相关性的运动估计算法——缩小的菱形算法(DDS)。先运用前向主矢量选择法不断修正预测运动矢量,再根据最佳参考帧位置的统计特性对不同参考帧使用不用模板进行搜索。实验结果表明,与H.264参考模型JM10.2相比,该算法保持了较好的图像质量且码率变化很小,运动搜索点数平均减少接近80%,并能有效地降低编码器复杂度。     

H.264/SVC mode decision based on mode correlation and desired mode list

Design of video encoders involves implementation of fast mode decision (FMD) algorithm to reduce computation complexity while maintaining the performance of the coding. Although H.264/scalable video coding (SVC) achieves high scalability and coding efficiency, it also has high complexity in implementing its exhaustive computation. In this paper, a novel algorithm is proposed to reduce the redundant candidate modes by making use of the correlation among layers. A desired mode list is created based on the probability to be the best mode for each block in base layer and a candidate mode selection in the enhancement layer by the correlations of modes among reference frame and current frame. Our algorithm is implemented in joint scalable video model (JSVM) 9.19.15 reference software and the performance is evaluated based on the average encoding time, peak signal to noise ration (PSNR) and bit rate. The experimental results show 41.89% improvement in encoding time with minimal loss of 0.02 dB in PSNR and 0.05% increase in bit rate.     

低复杂度的H.264帧间宏块编码模式选择算法

为了减少H．264／AVC帧间编码模式选择的计算复杂度，利用不同编码模式在实际视频序列中的利用率信息及空时域相邻块之间的相关性，提出了一个低复杂度的快速帧间编码模式选择算法。模拟结果表明，该算法在保持率失真性能的前提下可以大幅度减少模式选择的计算复杂度，有利于H．264的实时应用。     

基于纹理估计的H.264帧内预测快速算法

帧内预测是H.264取得高编码效率的关键技术之一,但其计算复杂度是H.264帧内编码中的瓶颈问题。结合H.264帧内预测特点,提出一种基于纹理估计的帧内预测快速算法。首先通过计算相邻宏块的边界像素差值,估计图像的纹理方向,再根据此方向选择相应的帧内预测模式,减小候选模式数量,简化模式选择过程,降低了帧内预测的计算复杂度。实验结果表明,在保证图像质量和编码码率的前提下,本算法能有效提高H.264的编码速度,有利于实时应用。     

基于TMDXEVM6446的网络视频监控系统

网络视频监控系统是集视频编解码和流媒体传输技术为一体的综合系统,提供了实时快捷的监控服务,近年来得到越来越广泛的应用。本文详细介绍了H.264/AVC视频编码新标准在TMDXEVM6446平台上的移植和优化,并完成了基于H.264编解码的网络视频监控系统完整的设计与实现。     

A first approach to speeding-up the inter mode selection in MPEG-2/H.264 transcoders using machine learning

The H.264 standard achieves much higher coding efficiency than the MPEG-2 standard, due to its improved inter and intra prediction modes which come with a cost of higher computation complexity. Transcoding MPEG-2 video to H.264 is important to enable gradual migration to H.264. However, given the significant differences between the MPEG-2 and the H.264 coding algorithms, transcoding is much more complex and new approaches to transcoding are necessary. In this paper, we introduce and evaluate a low complexity macroblock partition mode decision algorithm, to be used as part of a high-efficient inter-frame prediction in MPEG-2 to H.264 transcoder. The proposed tools are used to compute an optimal MB coding mode decision with significantly reduced computational complexity. Specifically, we achieve the computational savings by using the following MB information coming from MPEG-2: the MB coding modes, the coded block pattern (CBPC) in MPEG-2, and the mean and variance of the 16 4 × 4 sub blocks of the MPEG-2 residual MBs. We use data mining algorithms to develop a decision tree for H.264 coding mode decisions. The decision trees are built using RD optimized mode decisions and result in highly efficient mode decisions, with significantly reduced computational complexity. The proposed transcoder is 35% faster than the RD optimized H.264 reference transcoder without a significant PSNR degradation (0.05 dB on average). The proposed transcoder performs over 0.4 dB better on average than the SAE cost based H.264 transcoding.