New rate-distortion modeling and efficient rate control for H.264/AVC video coding

Rate control (RC) is crucial in controlling compression bit rates and qualities for networked video applications. In this paper, we propose a new rate-distortion (R-D) model and an efficient rate control scheme for H.264/AVC video coding, which elegantly resolve the inter-dependency problem between rate-distortion optimization and rate control by eliminating the need of coding complexity prediction for an inter-frame. The objective is to achieve accurate bit rate, obtain optimal video quality while reducing quality variations and simultaneously handling buffer fullness effectively. The proposed algorithm encapsulates a number of new features, including a coding complexity measure for intra-frames, a rate-distortion model, an accurate quantization parameter (QP) estimation for intra-frames, an incremental quantization parameter calculation method for inter-frames, a proportional+integral+derivative (PID) buffer controller, and an intelligent bit-allocation-balancing technique. Our experimental results demonstrate that the proposed scheme outperforms the JVT-G012 solution by providing accurate rate regulation, effectively reducing frame skipping, and finally improving coding quality by up to 1.80 dB.     

基于Weibull率失真简化模型的帧比特分配算法

为在确保视频压缩码流平稳且带宽受限的情况下提升重建视频质量,本文针对使用Weibull密度分布对压缩视频序列率失真性能分析的方法,对其模型进行数学简化,并以帧层编码速率控制的缓冲器充盈度和重建视频质量为目标,提出了一种新的H.264压缩视频速率控制方法——帧比特分配算法。该算法以H.264的JM16.1为视频压缩编码平台,将简化率失真模型嵌入速率控制算法中,以一个GOP为控制单元对其内部各图像帧进行比特分配与调整,同时以帧为周期进行算法模型参数更新。实验结果表明,本文提出的算法要比JVT-H017的算法在重建视频客观质量（PSNR）方面平均有0.30dB的改善,并能够得到更加平稳质量的视频输出。在实际输出码率方面,本文算法比JVT-H017的算法更低,并且编码缓冲器充盈度较JVT-H017平稳且没有上下溢的情况出现。      

MPEG-4 and rate-distortion-based shape-coding techniques

We address the problem of the efficient encoding of object boundaries. This problem is becoming increasingly important in applications such as content-based storage and retrieval, studio and television postproduction, and mobile multimedia applications. The MPEG-4 visual standard will allow the transmission of arbitrarily shaped video objects. The techniques developed for shape coding within the MPEG-4 standardization effort are described and compared first. A framework for the representation of shapes using their contours is presented next. Such representations are achieved using curves of various orders, and they are optimal in the rate-distortion sense. Finally, conclusions are drawn     

Joint source-channel coding for wireless object-based video communications utilizing data hiding.

In recent years, joint source-channel coding for multimedia communications has gained increased popularity. However, very limited work has been conducted to address the problem of joint source-channel coding for object-based video. In this paper, we propose a data hiding scheme that improves the error resilience of object-based video by adaptively embedding the shape and motion information into the texture data. Within a rate-distortion theoretical framework, the source coding, channel coding, data embedding, and decoder error concealment are jointly optimized based on knowledge of the transmission channel conditions. Our goal is to achieve the best video quality as expressed by the minimum total expected distortion. The optimization problem is solved using Lagrangian relaxation and dynamic programming. The performance of the proposed scheme is tested using simulations of a Rayleigh-fading wireless channel, and the algorithm is implemented based on the MPEG-4 verification model. Experimental results indicate that the proposed hybrid source-channel coding scheme significantly outperforms methods without data hiding or unequal error protection.     

H.264低码率视频应用的率失真模型及码率控制

提出了一种通用的率失真(RD,rate distortion)模型,进而提出纹理复杂度(TC,texture-complexity)和图像块头用字节自适应线性预测模型及宏块(组)比特分配模型。利用以上模型,构建了一种面向低码率视频应用的码率控制方案。大量仿真实验结果表明,利用新提出的码率控制方法,测试序列的峰值信噪比(PSNR)均有不同程度提高,其码流曲线和PSNR曲线更平滑平稳,目标码率控制更准确。     

Constant quality video coding using video content analysis

In the literature, several rate control techniques have been proposed to aim at the optimal quality of digitally encoded video under given bit budget, channel rate and buffer size constraints. Typically, these approaches are group-of-picture (GOP) based. For longer, heterogeneous sequences, they become unacceptably complex or struggle with model mismatches. In this paper, an off-line segment-based rate control approach is proposed for controlling the distortion variation across successive shots of a video sequence when encoding with single-layer (MPEG-4 baseline, MPEG-4 AVC) and scalable (wavelet) video codecs. Consistent quality is achieved by optimally distributing the available bits among the different segments, based on efficient rate-distortion (R-D) modelling of each segment. The individual segments are defined based on shot segmentation and activity analysis techniques. The algorithm is formulated for three different distribution models: download, progressive download and streaming. The results indicate that the proposed technique improves the quality consistency significantly, while the processing overhead compared to classical two-pass variable bit-rate (VBR) encoding is limited.     

Joint video coding of MPEG-2 video programs for digitalbroadcasting services

In digital broadcasting services such as digital satellite TV, cable TV, and digital terrestrial TV, several video programs are compressed by MPEG-2 and then simultaneously transmitted over a conventional CBR (constant bit rate) broadcasting channel. In this environment, the picture quality of the aggregated video programs should be kept as equal as possible to provide fair video services for all the viewers. We propose a joint video coding scheme for ensuring that the picture quality of all the programs are nearly the same. This objective is achieved by simultaneously controlling the video encoders to generate the VBR (variable bit rate) compressed video streams. This paper contributes in two ways. First, we propose a rate-distortion estimation method for MPEG-2 video, which enables us to predict the amount of bits and the distortion generated from an encoded picture at a given quantization step size and vice versa. The most attractive features of the proposed estimation method are its accuracy and a computational complexity low enough to be applied to real-time video coding applications. Second, this paper presents an efficient and accurate joint video coding scheme using the rate-distortion estimation results. The experimental results show that our coding scheme gives a higher and more stable picture quality and a more efficient channel utilization than an independent coding scheme that encodes each program independently     

MPEG-4 video object-based rate allocation with variable temporalrates

In object-based coding, bit allocation is performed at the object level and temporal rates of different objects may vary. The proposed algorithm deals with these two issues when coding multiple video objects (MVOs). The proposed algorithm is able to successfully achieve the target bit rate, effectively code arbitrarily shaped MVOs with different temporal rates, and maintain a stable buffer level     

Rate control of MPEG video for consistent picture quality

We propose a rate control scheme using a rate-distortion (R-D) estimation model, which produces a consistent picture quality between consecutive frames. Our R-D estimation method offers a closed-form mathematical model that enables us to predict the bits and the distortion generated from a frame encoded at a given quantization parameter (QP) and vice versa. Its most attractive feature is its low computational complexity. Furthermore, it is accurate enough to be applied to practical video coding. In our simulation, the estimation errors for rate and distortion are less than 2.5% and 1.5%, respectively. Therefore, the proposed rate control scheme is appropriate for applications requiring low delay, low complexity, and the ability to control output bit-rate and quality accurately. Our scheme ensures that the video buffers do not underflow or overflow by satisfying the buffer constraint, and it also prevents quality difference between consecutive frames from exceeding a certain demanded level by adopting a distortion constraint. In addition, a consistent picture quality is maintained within a frame, and error propagation, caused by quality degradation of anchor frames, is reduced by differentiating the control procedure for anchor frames from that for nonanchor frames. Simulation results show that our control scheme achieves 0.52-1.84 dB peak signal-to-noise ratio (PSNR) gain over MPEG-2 Test Model 5 (TM5) rate control and maintains very consistent quality within a frame as well as between frames.     

A unified rate-distortion analysis framework for transform coding: a summary

In our previous work, we have developed a rate-distortion (R-D) modeling framework H.263 video coding by introducing the new concepts of characteristic rate curves and rate curve decomposition. In this paper, we further show it is a unified R-D analysis framework for all typical image/video transform coding systems, such as EZW, SPIHT and JPEG image coding; MPEG-2, H.263, and MPEG-4 video coding. Based on this framework, a unified R-D estimation and control algorithm is proposed for all typical transform coding systems. We have also provided a theoretical justification for the unique properties of the characteristic rate curves. A linear rate regulation scheme is designed to further improve the estimation accuracy and robustness, as well as to reduce the computational complexity of the R-D estimation algorithm. Our extensive experimental results show that with the proposed algorithm, we can accurately estimate the R-D functions and robustly control the output bit rate or picture quality of the image/video encoder.     

Adaptive bit allocation scheme for rate control in high efficiency video coding with initial quantization parameter determination

One of the challenges in rate control (RC) lies in how to efficiently determine a target bit rate that will be used for the quantization parameter (Q_p) calculation process during video coding. In this paper, we investigate the issues over the existing bit allocation algorithms for the RC process in High Efficiency Video Coding (HEVC) and propose an complexity-based bit allocation scheme to improve the encoding performance. First, we model the relationship between encoding bit rate and texture complexity by a linear rate function. Second, compared with traditional complexity estimation methods, a more accurate model is proposed to measure the texture complexity considering the spatial–temporal correlations. Third, based on the proposed rate function and texture complexity measurement model, we develop an adaptive bit allocation scheme for RC in HEVC. At the same time, depending on the encoder buffer status, an adaptive Q_p clip range determination algorithm is also developed to achieve the encoding quality smoothness while keeping the bit rate fluctuation at an acceptable level. Then, we exploit to determine the initial Q_p efficiently and adaptively according to video contents. Experimental results demonstrate that the proposed RC algorithm can achieve better rate-distortion (R–D) and rate-control performance than that of the state-of-the-art RC scheme implemented in the HEVC reference software HM11.0.     

Low complexity shape-adaptive DCT for coding of arbitrarily shaped image segments

A low complexity shape-adaptive DCT transform algorithm for coding pels in arbitrarily shaped image segments is presented. The proposed algorithm is compared to the well established generalized shape-adaptive transform method introduced by Gilge et al. in terms of transform efficiency and computational complexity. Results obtained under both theoretical and experimental conditions show that the new algorithm achieves a transform efficiency close to that of the Gilge method with considerably reduced computational complexity. The proposed shape-adaptive DCT algorithm was implemented into a standard MPEG-1 coder to provide object or segment based coding of images and video with additional content-based functionality. The extended MPEG-1 object based coding scheme can handle generic input sequences and can readily provide MPEG-1 backward compatibility if no contour data is transmitted for a given video sequence. Results for INTRA coding of images indicate that the algorithm allows efficient coding over a wide range of coding parameters — thus providing means for generic coding of segmented video between very high and very low bit rates. It is further shown that some of the content-based based functionalities currently discussed in MPEG-4 can be provided efficiently using the proposed object based coding scheme.     

全I帧编码中的TM5码率控制策略的改进

TM5码率控制策略作为一种非常有效的控制策略而被MPEG-2编码器所广泛采用，但它仍存在诸多的不足。本文针对全I帧编码下的TM5码率控制策略，提出了TM5码率控制策略的改进方案，这包括利用宏块的DCT系数来实现宏块空间活动性的快速计算，以及使用新的缓冲器充溢度调整方法。实验表明：与采用TM5码率控制策略的全I帧图像编码相比，本文提出的改进方案的效果非常显著。     

基于感兴趣区的MPEG-4 FGS增强层码率分配算法

该文提出了一种基于感兴趣区的MPEG-4 FGS增强层码率分配算法。该算法在建立一种针对感兴趣区的率失真模型的基础上,在等质量的约束条件下,可以实现选择性增强后FGS增强层码率的优化分配。实验结果表明,与平均码率分配算法相比,该算法可以显著降低视频图像中人眼感兴趣区域重建质量的波动。同时,该算法的计算复杂度低,完全能满足视频服务器实时码率分配的要求。     

Histogram-based rate-distortion estimation for MPEG-2 video

A rate-distortion estimation method for MPEG-2 video that enables one to predict the number of bits and the distortion to be generated from an encoded picture at a given quantisation step size, and vice versa is proposed. The estimation method has some outstanding advantages: first, the computational complexity is small because its major operation is just to obtain a histogram or weighted histogram of the DCT coefficients from an input picture, and the final form of the proposed estimation model is simple. Secondly, its results are accurate enough to be applied to practical video coding applications. Simulation results show that the estimation errors for the rate and for the distortion do not exceed 2.5% and 1%, respectively     

基于水印技术的MPEG-4形状错误隐藏

MPEG-4编码是一种基于对象内容的第二代视频编码方案,将视频根据内容分割成前景对象和背景。视频对象的信息分为形状信息、纹理信息和运动信息,而形状信息是正确解码视频对象的基础。本文就是针对MPEG-4编码标准中的I-VOP的形状信息的错误进行的错误隐藏。采用的方法有别于传统的曲线插值方法和马尔可夫域最大后验估计方法,首次采用基于鲁棒盲水印的算法,主要是将形状信息或变化作为水印信息嵌入到背景对象中。针对前人提出的方法只能修补小部分的损失,本文对于形状信息严重丢失的修复效果很好。     

A novel rate control algorithm for video coding based on fuzzy-PID controller

Rate control algorithms (RCAs) aim to achieve the best visual quality under the minimum bit rate and the limited buffer size. A self-parameter-tuning fuzzy-PID controller is proposed to reduce the deviation between the target buffer level and the current buffer fullness. Fuzzy logic is used to tune each parameter of the proportional-integral-derivative controller by selecting appropriate fuzzy rules through simulation in H.264/advanced video coding (AVC). To control the quality fluctuation between consecutive frames, a quality controller is adopted. The proposed RCA has been implemented in an H.264/AVC video codec, and our experimental results show that the proposed algorithm achieves smooth target bits while enabling better buffer control and visual quality.     

Quality control for VBR video over ATM networks

Uncontrolled variable-bit-rate (VBR) coded video yields consistent picture quality, but the traffic stream is very bursty. When sent over ATM networks, cell losses may be incurred due to limited buffer capacity at the switches; this could cause severe picture quality degradation. Source rate control can be implemented to generate a controlled VBR bit stream which conforms to specified bit rate bounds and buffer constraints. However, source rate control could result in picture quality degradation too. Hence, for real-time video services, an important issue to address is whether the picture quality degradation incurred by source rate control is within acceptable levels or how to choose the appropriate coding parameters to make it so. We establish quantitatively the relationship between picture quality and source rate control for the case of guaranteed service with different combinations of allocated bandwidth, buffer size, and other key video-coding parameters of MPEG-2. In addition, quality control in the context of two-layered scalable video service (basic and enhanced quality) is also considered. Our study reveals that, in order to maximize both the basic and the enhanced quality, source rate control should be implemented on both layers. The relationships between the two types of quality and different combinations of allocated bandwidths, buffer sizes, and some key coding parameters are also established quantitatively for MPEG-2 SNR scalability     

Rate-distortion analysis of nonlinear quantisers for MPEG videocoders: sigmoidal and unimodal quantiser control functions

Quantisation is employed in MPEG video coders as a video rate control scheme to regulate the data rate of the compressed video bit stream entering the transmission buffer. For constant bit rate applications, the quantiser has a crucial effect on the video data rate and video quality. It has been a challenging task to optimise the quantiser step size for both bit rate and quality since they are mutually exclusive parameters, as defined by rate-distortion theory. The quantiser step size is generally determined by a linear relationship with respect to the buffer occupancy. Two nonlinear quantiser control functions are investigated, sigmoidal and unimodal, which achieve superior video rate control performance while maintaining similar video quality to the linear one. These two functions are analysed in the framework of rate-distortion theory. Their performance for video rate fluctuation has also been analysed. Encoding results for the two functions are compared to the MPEG2 TM5 evaluation model     

A rate-control algorithm using inter-layer information for H.264/SVC for low-delay applications

This paper proposes a novel frame-level rate-control scheme for H.264/SVC for low-delay applications. The trend of the Mean Absolute Difference (MAD) (after motion compensation) of the reference layer is used as the inter-layer information for Inter-layer MAD prediction, which is combined with Intra-layer MAD prediction to predict the MAD of the enhancement layers (EL) more accurately. By considering the influence from both the texture and nontexture information, the varying picture complexity and feedback information from the actual encoding results are combined to achieve an accurate bit-allocation. A coarse-to-fine initial quantization parameter (QP) selection method is proposed to refine the initial QP of the EL according to the channel condition and the video sequence characteristics. Experimental results demonstrate that the proposed scheme can obtain high and smooth PSNR, and the output bit-rate is close to the target bit-rate. Also, the proposed scheme can avoid serious buffer fullness fluctuation and reduce skipped frames in the video coding.