分布式视频编码中关键帧丢失错误保护

目的 分布式视频编码较其传统视频编码具有编码简单、误码鲁棒性高等特点,可以很好地满足如无人机航拍、无线监控等新型视频业务的需求。在分布式视频编码中,视频图像被交替分为关键帧和Wyner-Ziv帧,由于受到信道衰落和干扰等因素的影响,采用传统帧内编码方式的关键帧的误码鲁棒性远不如基于信道编码的Wyner-Ziv帧。关键帧能否正确传输和解码对于Wyner-Ziv帧能否正确解码起着决定性的作用,进而影响着整个系统的压缩效率和率失真性能。为此针对关键帧在异构网络中的鲁棒性传输问题,提出一种基于小波域的关键帧质量可分级保护传输方案。方法 在编码端对关键帧同时进行传统的帧内视频编码和基于小波域的Wyner-Ziv编码,解码端将经过错误隐藏后的误码关键帧作为基本层,Wyner-Ziv编码产生的校验信息码流作为增强层。为了提高系统的分层特性以便使系统的码率适应不同的网络条件,进一步将小波分解后图像的各个不同层的低频带和高频带组合成不同的增强层,根据不同信道环境,传输不同层的Wyner-Ziv校验数据。同时对误码情况下关键帧的虚拟噪声模型进行了改进,利用第1个增强层已解码重建的频带与其对应边信息来获得第2个和第3个增强层对应频带的更加符合实际的虚拟信道模型的估计。结果 针对不同的视频序列在关键帧误码率为1%20%时,相比较于传统的帧内错误隐藏算法,所提方案可以提高视频重建图像的主观质量和整体系统的率失真性能。例如在关键帧误码率为5%时,通过传输第1个增强层,不同的视频序列峰值信噪比（PSNR）提升可达25 dB左右;如果继续传输第2个增强层的校验信息,视频图像的PSNR也可以提升0.51.6 dB左右;如果3个增强层的校验信息都传输的话,基本上可以达到无误码情况下关键帧的PSNR。结论 本文所提方案可以很好地解决分布式视频编码系统中的关键帧在实际信道传输过程中可能出现的误码问题,同时采用的分层传输方案可以适应不同网络的信道情况。     

一种抗包丢失的自适应刷新视频编码

包丢失是影响Internet视频通信质量的一个重要问题,为此提出了一种新颖的抗包丢失的自适应刷新方法.该方法是通过估计接收端重建图象的失真,在发送端自适应地确定需要刷新的宏块的位置.模拟实验表明,该方法与已有的顺序刷新和随机刷新等方法相比,不仅峰值信噪比(PSNR)有明显提高(0.3～2.5dB),而且计算复杂度较低,有利于实时实现.     

XOR-based frame loss recovery scheme for video streaming

High coding dependencies among video frames suffer from vulnerability to packet loss, which impacts the playback quality of video streaming. In this paper, according to the characteristics of MPEG4/H.264 encoding methods, we propose a simple and low-complexity XOR-based FEC frame loss recovery scheme. Within an entire Group of Pictures (GOP), the proposed scheme shows the ability to recover simultaneously I-frame loss and one P-frame loss. The high frame loss resilience improves the playback QoS of compressed video streaming. The mathematical analysis reveals that the proposed scheme has 72.7% performance improvement than no frame loss protection in term of full GOP frames successful decoding rate.     

Fuzzy transforms for compression and decompression of color videos

We use fuzzy transforms for coding/decoding color frames of videos and we compare the results with the same frames reconstructed with the standard JPEG method. We classify all the frames in intra-frames and predictive frames by adopting a similarity measure based on the Lukasiewicz t-norm and a pre-processing phase which determines the best similarity threshold value. The compression is made on particular frames, called Δ-frames, obtained from a suitable difference defined on the values of the pixels of an intra-frame and a predictive frame. Under high compression rates, we see that the Peak Signal to Noise Ratio of the frames obtained with the fuzzy transforms is averagely close to the PSNR obtained with the JPEG method. We use the videos at URL sampl.eng.ohiostate.edu/∼sampl/database.htm.     

基于分形维的小波包EBCOT岩心图像压缩

岩心图像作为石油地质分析和地球物理勘探的重要信息来源,数据量巨大、纹理信息丰富且对比度较弱。提出一种基于分形维的小波包EBCOT岩心图像压缩方法。对岩心图像进行完全小波包分解,以分形维作为代价函数,并以差分计盒法计算每个子带节点的分形维数。通过比较父节点和子节点分形维数值实现剪支以获取最优小波包分解,结合EBCOT算法对岩心图像进行压缩处理。实验结果表明,所提算法的重构图像的PSNR与SSIM值均高于基于熵的小波包压缩算法和JPEG2000算法。     

A wavelet packet based block-partitioning image coding algorithm with rate-distortion optimization

As an elegant generalization of wavelet transform, wavelet packet （WP） provides an effective representation tool for adaptive waveform analysis. Recent work shows that image-coding methods based on WP decomposition can achieve significant gain over those based on a usual wavelet transform. However, most of the work adopts a tree-structured quantization scheme, which is a successful technique for wavelet image coding, but not appropriate for WP subbands. This paper presents an image-coding algorithm based on a rate-distortion optimized wavelet packet decomposition and on an intraband block-partitioning scheme. By encoding each WP subband separately with the block-partitioning algorithm and the JPEG2000 context modeling, the proposed algorithm naturally avoids the difficulty in defining parent-offspring relationships for the WP coefficients, which has to be faced when adopting the tree-structured quanUzation scheme. The experimental results show that the proposed algorithm significantly outperforms SPIHT and JPEG2000 schemes and also surpasses state-of-the-art WP image coding algorithms, in terms of both PSNR and visual quality.     

一种自适应的视频流化前向纠错算法

网络视频应用经常会受到数据包丢失或错误以及网络带宽资源不足的干扰.相关研究表明:在多数情况下,动态变化的网络带宽和丢包率是影响视频流化质量的关键因素.因此,为了保证视频质量,可以采用前向纠错(forward error correction,简称FEC)编码来提高视频数据传输的可靠性;同时,为了适应网络状态的变化,发送端可以调节视频数据的发送速率,并在视频源数据与FEC数据之间合理分配网络传输带宽.首先通过对视频流结构的分析,在充分考虑帧之间的依赖关系和帧类型的基础上提出了一种帧的解码模型.在此基础上,建立了用于在视频源数据和FEC数据之间分配网络带宽资源的优化算法.实验表明,该模型可以有效地适应网络状态的变化,并通过优化分配网络带宽资源来使接收端获得最大的可播放帧率.     

RDWT域全相位子带运动补偿视频编码方法

当前小波视频编码技术的一个研究热点是如何提高运动补偿的效率．提出了一种基于RDWT（冗余离散小波变换）域的奎相位子带运动补偿视频编码方法．运动补偿过程在参考帧和当前帧的RDWT域进行，使用提出的RDWT小波块结构，利用RDWT域的全相位子带信息提高运动补偿效率．在RDWT域形成预测数据后变换到空域得到预测帧和残差帧，对残差帕进行DWT变换，SPECK小波系数编码．实验表明提出自寺方法获得了较好的编码效率．     

Analytical model for MPEG video frame loss rates and playback interruptions on packet networks

This paper presents and studies objective video quality evaluation techniques for a network where frame losses can be considered independent, for example a best effort not heavy loaded packet switching network. The total or partial loss of a frame’s information affects the quality of video playback, as the frame cannot be decoded and other frames that depend on it cannot be correctly decoded too. Therefore, during some time the video playback has errors in the image and the user will perceive them as interruptions. In this paper, the total number of decoded frames and the video playback interruptions duration will be considered important parameters to quantify the video quality. The analytical formulation for them will be presented and the importance of considering them together will be highlighted.     

Motion block based video super resolution

This paper presents a new video super resolution technique, based on the motion and static areas of the low resolution video frames. In order to separate the motion and static blocks, a block motion estimation method is performed between a reference and its neighboring frames. Among the motion blocks, the occluded blocks are identified using an adaptive threshold applied on each block individually. Structure-adaptive normalized convolution (SANC) reconstruction method is used to generate the high resolution static and motion blocks where discrete wavelet transform (DWT) based interpolation is used to produce the high resolution occluded blocks. The static and motion blocks are combined into a high resolution frame. Finally, a sharpening process is performed on the high resolution frame in order to generate the super resolved high resolution output frame. The experimental results show that the proposed technique provides significantly better qualitative visual results as well as quantitative higher PSNR than the state of the art video super resolution algorithms.     

Fast extraction of wavelet-based features from JPEG images for joint retrieval with JPEG2000 images

In this paper, some fast feature extraction algorithms are addressed for joint retrieval of images compressed in JPEG and JPEG2000 formats. In order to avoid full decoding, three fast algorithms that convert block-based discrete cosine transform (BDCT) into wavelet transform are developed, so that wavelet-based features can be extracted from JPEG images as in JPEG2000 images. The first algorithm exploits the similarity between the BDCT and the wavelet packet transform. For the second and third algorithms, the first algorithm or an existing algorithm known as multiresolution reordering is first applied to obtain bandpass subbands at fine scales and the lowpass subband. Then for the subbands at the coarse scale, a new filter bank structure is developed to reduce the mismatch in low frequency features. Compared with the extraction based on full decoding, there is more than 72% reduction in computational complexity. Retrieval experiments also show that the three proposed algorithms can achieve higher precision and recall than the multiresolution reordering, especially around the typical range of compression ratio.     

Packet loss in peer-to-peer video streaming over the Internet

Peer-to-peer streaming has recently gained attention as an effective solution to support large scale media streaming applications over the Internet. One of the main challenges of peer-to-peer video streaming is the cumulative impact of the Internet packet loss due to the decoding dependency of the compressed video frames. In this paper we study the impact of the Internet packet loss on the performance of peer-to-peer video streaming systems, and analyze the efficiency of various packet loss recovery policies in such systems. Our analytical and simulation results show how the Internet packet loss can affect the performance of peer- to-peer video streaming systems and how different packet loss recovery policies can be effective for such systems. Our analysis results give us some insights that can be used in designing efficient peer-to-peer video streaming systems.     

Evaluating the significance of error checksums for wireless video streaming

Efficient streaming of bandwidth intensive and delay sensitive multimedia contents over error prone wireless links has proven to be one of the most challenging problems of current era of digital communication. Applying unequal error protection strategies and avoiding unnecessary packet discard at various network levels yield valuable outcomes. In this article, we have proposed the idea of discriminating classified video streaming calls from the data packeting over IEEE WLAN through bit demarcation in network packet headers. Error computation at various network levels are evaluated and disabled in order to attain increased throughput characterized by the higher number of packets available for decoding, enhanced multimedia visual quality due to gap elimination (appears as a consequence of some frame loss), efficient utilization of link bandwidth with no re-transmissions and reduced delays with least error checksum computations and packet re-transmissions. Moreover, collaborative estimation of various layers parameters results in proficient selection of streaming parameters like group of picture structure, inter spacing of anchor frames, constellation coding and signal power. The proposed system will be helpful in future information and communication systems by providing reliable video streaming over wireless.     

Video frame interpolation via optical flow estimation with image inpainting

As we all know, video frame rate determines the quality of the video. The higher the frame rate, the smoother the movements in the picture, the clearer the information expressed, and the better the viewing experience for people. Video interpolation aims to increase the video frame rate by generating a new frame image using the relevant information between two consecutive frames, which is essential in the field of computer vision. The traditional motion compensation interpolation method will cause holes and overlaps in the reconstructed frame, and is easily affected by the quality of optical flow. Therefore, this paper proposes a video frame interpolation method via optical flow estimation with image inpainting. First, the optical flow between the input frames is estimated via combined local and global-total variation (CLG-TV) optical flow estimation model. Then, the intermediate frames are synthesized under the guidance of the optical flow. Finally, the nonlocal self-similarity between the video frames is used to solve the optimization problem, to fix the pixel loss area in the interpolated frame. Quantitative and qualitative experimental results show that this method can effectively improve the quality of optical flow estimation, generate realistic and smooth video frames, and effectively increase the video frame rate.     

基于运动矢量细化的帧率上变换与HEVC结合的视频压缩算法

将帧率变换技术与新型视频压缩编码标准HEVC相结合有利于提升视频的压缩效率。针对直接利用HEVC码流信息中的低帧率视频的运动矢量进行帧率上变换时效果不理想的问题,文中提出了一种基于运动矢量细化的帧率上变换与HEVC结合的视频压缩算法。首先,在编码端对原始视频进行抽帧,降低视频帧率;其次,对低帧率视频进行HEVC编解码;然后,在解码端与从HEVC码流中提取出的运动矢量相结合,利用前向-后向联合运动估计对其进行进一步的细化,使细化后的运动矢量更加接近于对象的真实运动;最后,利用基于运动补偿的帧率上变换技术将视频序列恢复至原始帧率。实验结果表明,与HEVC标准相比,所提算法在同等视频质量下可节省一定的码率。同时,与其他算法相比,在节省码率相同的情况下,所提算法重建视频的PSNR值平均可提升0.5 dB。     

无线Mesh网络中的P2P流媒体性能评估

通过搭建基于无线Mesh网络的P2P流媒体点播测试平台,对影响无线Mesh网络中P2P流媒体性能的流媒体编解码方式、编码速率、数据转发路径的选择和跳数四个因素进行了测试。实验结果表明,采用H.264编解码标准更适合无线Mesh网络中流媒体的传输;编码速率必须不大于网络连接速率才能获得高视频质量;P2P技术可以抵抗10%的丢包对视频质量的影响,比采用非P2P技术在视频的前1 000帧视频质量平均高出3 dB;由于P2P技术带来的流间干扰的影响使得1 000帧以后视频质量下降了6 dB,严重影响了流媒体性能;无线Mesh网络的传输能力随着跳数的增加而减弱,但是流媒体质量并未随着跳数的增加而降低。     

小波包特征熵分解的图像水印算法

提出了一种小波包特征熵分解的自适应图像水印算法。该算法通过对宿主图像进行小波包特征熵分解,在高频系数中选取合适的阈值来区分高频系数中图像的纹理细节信息和噪声信息,将水印信息自适应地嵌入到高频系数当中。实验表明,该水印算法对噪声、JPEG2000压缩、滤波、改变对比度、几何剪切等攻击都具有一定的健壮性。