精细的可伸缩性视频编码中容错技术的研究

 精细的可伸缩性视频编码生成的增强层码流在有误码的信道中传输时,正确解码的比特数由信道误码率决定,而不是由信道带宽决定,这将严重影响图像质量.本文提出了一种新的分级的增强层码流结构,在这种新的增强层码流中加入各种同步符,将码流分为许多不同的段.当码流在传输过程中出现错误时,只有发生错误的那段码流不能解码,从而有效地减少了传输错误的影响.在MPEG-4的FGS上的实验结果表明我们提出的增强层码流结构比原来的FGS增强层码流结构有更好的鲁棒性.     

基于H.26L的精细度可伸缩视频编码

提出了一种基于H．26L精细度可伸缩(fine granularity scalability)视频编码方案，称为EFGS-H．26L。在该方案中，以MPEG-4的FGS为基础构造了一种新的可伸缩结构(EFGS，enhanced fine granularity scalability)，在EFGS结构中，基本层采用H．26L编码，增强层采用类似于JPEG2000的基于上下文的位平面编码。由于H．26L优良的编码性能，使得基本层的编码效率大大提高，为了提高增强层的编码效率，首先把残余图像按子带的顺序重新排列，这样就可以利用子带系数的相关性来实现冗余信息消除。JPEG2000标准中的EBCOT算法已经被证明是非常高效的位平面编码方法，所以对重排后的DCT系数采用一种类似于JPEG2000的基于上下文的位平面编码方法。实验结果证明，在高比特率时，本文提出的精细度可伸缩编码方案编码效率比MPEG-4中的FGS提高3．0dB左右。     

基于感兴趣区的MPEG-4 FGS增强层码率分配算法

该文提出了一种基于感兴趣区的MPEG-4 FGS增强层码率分配算法。该算法在建立一种针对感兴趣区的率失真模型的基础上,在等质量的约束条件下,可以实现选择性增强后FGS增强层码率的优化分配。实验结果表明,与平均码率分配算法相比,该算法可以显著降低视频图像中人眼感兴趣区域重建质量的波动。同时,该算法的计算复杂度低,完全能满足视频服务器实时码率分配的要求。     

基于人脸特征的自适应选择增强FGS视频编码

提出了基于肤色的人脸区域FGS视频编码方法和基于宏块分割的人脸区域FGS视频编码方法.两种方法都具有复杂度低、运算量小的特点,能够自适应达到选择增强的目的.     

基于帧内区域的细粒度可扩展视频编码最优码率分配算法

MPEG-4 FGS是MPEG-4中精细可扩展性编码方法,由于采用帧8*8交织的位平面编码结构,无法支持帧内区域级的动态码率分配,不适合基于内容的增强和流化传输,针对MPEG-4 FGS这编码限制,本文根据MPEG-7的内容描述标准,提出了一种基于帧内区域的细粒度可扩展A-FGS编码,实现了实时的帧内区域流化编码,并就该编码提出了一种最优码率分配算法.利用帧内区域8*8宏块高位平面非零系数很少的特点,提出了动态码率分配算法,使在中等码率范围内编码效率提高了0.5dB左右.     

一种信道自适应的无线视频流差错控制机制

提出了一种自适应的无线视频流差错保护方法。该方法充分考虑MPEG-4FGS码流细粒度可扩展的特性,根据码流的重要性程度采用不等的保护措施,同时能够自适应地根据无线信道的具体状况,将信道带宽在MPEG-4FGS信源编码速率和信道编码速率之间进行最优化分配,使得接收端能获得最佳的重建视频质量。实验结果表明,在各种不同信道状况下,与均等错误保护和固定的不等错误保护方法相比,该方法均可获得更好的性能。     

一种改进的MPEG-4精细可伸缩编码方法

提出了一种改进的MPEG-4精细可伸缩编码方法(巧GS)。在增强层编码中，IFGS增加一个高质量的参考来作为预测补偿，然后利用DCT残差系数的相关性来消除数据冗余。试验结果表明本文提出的改进方法比原来的FGS编码方法有更高的效率。     

适用于3G无线网络的精细可分级编码技术

本文介绍了MPEG-4的一种可分级视频编码方案——精细可分级性(FGS)。FGS把视频流编码成两个比特流：一个基本层(BL)和一个增强层(EL)。根据可获的信道带宽或解码器的容量。一部分的EL作为BL的补充被传输，从而使无线信道上传输的视频质量得到优化。同时还介绍了FGS的两种先进机制：频率权重和选择增强。     

基于H.264的自适应选择增强FGS视频编码

提出了一种新的选择增强FGS编码方法,基本层仍采用H.264编码方式,增强层直接利用基本层的模式判决结果对不同运动分割宏块进行不等程度的增强.H.264采用了树型结构运动补偿,较大的宏块分割尺寸适用于平坦区,而较小的宏块分割尺寸可以刻画精细的运动细节;分析表明,对于特定类型的图像序列,精细的运动细节又较为集中于视觉感兴趣区(ROI).本文利用这一特点,对较小分割尺寸的宏块进行位平面提升以保证精细运动细节区的优先编码,使它们更容易被包括进截断码流,从而在不必预先确定ROI位置的条件下仍能有效提高ROI的重建质量.     

基于三维小波变换嵌入式视频压缩算法的研究

本文把二维图像的等级树集分割编码方法(SPIHT)推广应用于三维的视频编码中,提出了一种用于三维视频序列图像的扩展等级树集分割编码方法.此方法所编码码流是嵌入式码流,在解码端可随意截取一段码流解码以达到所要求的码率和视频质量.另外此方法无需进行运动补偿,降低了算法的复杂度.通过理论分析和仿真实验得出,此方法有很好的编码效率,但对于帧内图像较复杂的序列,编码效率有所下降.     

Layered Wyner-Ziv video coding.

Following recent theoretical works on successive Wyner-Ziv coding (WZC), we propose a practical layered Wyner-Ziv video coder using the DCT, nested scalar quantization, and irregular LDPC code based Slepian-Wolf coding (or lossless source coding with side information at the decoder). Our main novelty is to use the base layer of a standard scalable video coder (e.g., MPEG-4/H.26L FGS or H.263+) as the decoder side information and perform layered WZC for quality enhancement. Similar to FGS coding, there is no performance difference between layered and monolithic WZC when the enhancement bitstream is generated in our proposed coder. Using an H.26L coded version as the base layer, experiments indicate that WZC gives slightly worse performance than FGS coding when the channel (for both the base and enhancement layers) is noiseless. However, when the channel is noisy, extensive simulations of video transmission over wireless networks conforming to the CDMA2000 1X standard show that H.26L base layer coding plus Wyner-Ziv enhancement layer coding are more robust against channel errors than H.26L FGS coding. These results demonstrate that layered Wyner-Ziv video coding is a promising new technique for video streaming over wireless networks.     

Layered Wyner–Ziv Video Coding

Following recent theoretical works on successive Wyner-Ziv coding (WZC), we propose a practical layered Wyner-Ziv video coder using the DCT, nested scalar quantization, and irregular LDPC code based Slepian-Wolf coding (or lossless source coding with side information at the decoder). Our main novelty is to use the base layer of a standard scalable video coder (e.g., MPEG-4/H.26L FGS or H.263+) as the decoder side information and perform layered WZC for quality enhancement. Similar to FGS coding, there is no performance difference between layered and monolithic WZC when the enhancement bitstream is generated in our proposed coder. Using an H.26L coded version as the base layer, experiments indicate that WZC gives slightly worse performance than FGS coding when the channel (for both the base and enhancement layers) is noiseless. However, when the channel is noisy, extensive simulations of video transmission over wireless networks conforming to the CDMA2000 1X standard show that H.26L base layer coding plus Wyner-Ziv enhancement layer coding are more robust against channel errors than H.26L FGS coding. These results demonstrate that layered Wyner-Ziv video coding is a promising new technique for video streaming over wireless networks     

Efficient fine granularity scalability using adaptive leaky factor

Fine Granularity Scalability (FGS) video coding has been adopted by the MPEG-4 standard for video streaming applications. In this paper, we propose a novel FGS coding scheme, which applied adaptive leaky factors for the enhancement layer prediction to further improve the coding efficiency of FGS. A flexible method that can dynamically determine the leaky factors according to the network conditions is also presented. With the proposed method, a better trade-off between the coding efficiency and drifting reduction can be achieved, and the coding performance is further improved compared with using a fixed leaky factor. Experimental results show that the proposed method can further improve the coding efficiency over a wide range of bitrate and packet loss ratio, and still keep the original characteristics, such as fine granularity, and bandwidth adaptation.     

A FINE GRANULAR JOINT SOURCE CHANNEL CODING METHOD

An improved FGS (Fine Granular Scalability) coding method is proposed in this letter,which is based on human visual characteristics.This method adjusts FGS coding frame rate according to the evaluation of video sequences so as to improve the coding efficiency and subject perceived quality of reconstructed images.Finally,a fine granular joint source channel coding is proposed based on the source coding method,which not only utilizes the network resources efficiently,but guarantees the reliable transmission of video information.     

WAVELET－BASED FINE GRANULARITY SCALABLE VIDEO CODING

This letter proposes an efficient wavelet-based fine Granularity Scalable(FGS)coding scheme,where the base layer is encoded with a newly designed wavelet-based coder,and the entancement layer is encoded with Progressive Fins Granularity Scalable(PFGS)coding.This algorithm involves multi-frame motion compensationk,rate-distortion optimizing strategy with Lagrangian cost function and context-based adaptive arithmetic coding.In order to improve efficiency of the enhancenent layer coding,an improved motion estimation scheme that uses both information from the base layer and the enhancement layer is also proposed in this letter.The wavelet-based coder significantly improves the coding efficiency of the base layer compared with MPEG-4 ASP(Advanced Simple Profile)and H.26L TML9.The PFGS coding is a significant improvement over MPEG-4 FGS coding at the enhancement layer.Experiments show that single layer coding efficiency gain of the proposed scheme is about 2.0-3.0dB and 0.3-1.0dB higher than that of MPEG-4 ASP and H.26L TML9,respectively.The overall coding efficiency gain of the proposed scheme is about 4.0-5.0dB higher than that of MPEG04 FGS.     

Rate-distortion optimized unequal loss protection for FGS compressed video

Video communication with quality of service (QoS) is an important and challenging task. The transmitted video stream must be able to afford the bandwidth variance and unavoidable packet loss in the Internet. In particular, fine-granular-scalability (FGS) video coding has been adopted by the MPEG-4 standard as the core video-compression method for streaming applications. From this inception, the FGS scalability structure was designed to be packet resilient especially under unequal loss protection (ULP). In this paper, we use ULP to protect FGS compressed video, and under the restriction of the network bandwidth, joint source-channel rate-distortion based optimization is performed in bit allocation to minimize the end-to-end distortion. Simulation results demonstrate effectiveness of our approach.     

Advances in Scalable Video Coding

Scalable video coding is attractive due to the capability of reconstructing lower resolution or lower quality signals from partial bit streams. This allows for simple solutions in adaptation to network and terminal capabilities. Different modalities of scalability are specified by video coding standards like MPEG-2 and MPEG-4. This paper gives a short overview over these techniques and analyzes in more detail the encoder/decoder drift problem, which is the major reason why scalable coding has been significantly less efficient than single-layer coding in most of these implementations. Only recently, new scalable video coding technology has evolved, which seems to close the gap of compression performance compared to state of the art single-layer video coding. New methods of efficient enhancement layer prediction were developed to improve traditional (motion-compensated hybrid) scalable coders, providing more flexible compromises on the drift problem. As a new technology trend, motion-compensated spatiotemporal wavelet coding has matured which entirely discards the drift and allows most flexible combinations of spatial, temporal, and signal-to-noise ratio (SNR) scalability with fine granularity over a broad range of data rates.