Statistical, DCT and vector quantisation-based video codec

The authors present a novel hybrid statistical, DCT and vector quantisation-based video-coding technique. In intra mode of operation, an input frame is divided into a number of non-overlapping pixel blocks. A discrete cosine transform then converts the coefficients in each block into the frequency domain. Coefficients with the same frequency index at different blocks are put together generating a number of matrices, where each matrix contains the coefficients of a particular frequency index. The matrix, which contains the DC coefficients, is losslessly coded. Matrices containing high frequency coefficients are coded using a novel statistical encoder. In inter mode of operation, overlapped block motion estimation / compensation is employed to exploit temporal redundancy between successive frames and generates a displaced frame difference (DFD) for each inter-frame. A wavelet transform then decomposes the DFD-frame into its frequency subbands. Coefficients in the detail subbands are vector quantised while coefficients in the baseband are losslessly coded. To evaluate the performance of the codec, the proposed codec and the adaptive subband vector quantisation (ASVQ) video codec, which has been shown to outperform H.263 at all bitrates, were applied to a number of test sequences. Results indicate that the proposed codec outperforms the ASVQ video codec subjectively and objectively at all bitrates.     

基于多变换的细粒度视频编码算法

针对现有细粒度视频编码算法计算复杂度大或视频恢复质量有各种效应的缺点，提出了一种基于联合小波变换和MP变换的细粒度编码算法。该算法在运动估计与补偿的基础上，用小波变换来消除帧间冗余，然后对变换结果根据不同帧的数据特征分别进行二维小波变换或MP变换。算法还提出了新的运动估计和像素调整策略、基于人眼视觉特性的MP原子分配策略和基于能量查找的原子搜索机制。实验表明，该算法可同时兼顾视频恢复质量、计算复杂度和控制粒度。     

RDWT域全相位子带运动补偿视频编码方法

当前小波视频编码技术的一个研究热点是如何提高运动补偿的效率．提出了一种基于RDWT（冗余离散小波变换）域的奎相位子带运动补偿视频编码方法．运动补偿过程在参考帧和当前帧的RDWT域进行，使用提出的RDWT小波块结构，利用RDWT域的全相位子带信息提高运动补偿效率．在RDWT域形成预测数据后变换到空域得到预测帧和残差帧，对残差帕进行DWT变换，SPECK小波系数编码．实验表明提出自寺方法获得了较好的编码效率．     

In‐band scalable video coding with integrated wavelet‐based display driving

Abstract— The increasing demand for multimedia over networks and the heterogeneous nature of today's networks and playback devices impose the stringent need for scalable video coding. In this context, in‐band wavelet‐based video‐coding architectures offer full scalability in terms of quality, resolution, and frame‐rate and provide compression performance competitive with that of state‐of‐the‐art non‐scalable technology. Despite these advances, video streaming over wireless networks to handheld terminals is lagging in popularity due to the high power consumption of the existing portable devices. As a possible approach to alleviate this problem, the integration of wavelet‐based passive‐matrix‐display driving into the inverse discrete wavelet transform (IDWT) block of the in‐band video decoding architecture was investigated. In a nutshell, the IDWT no longer needs to be performed by the decoder, being synthesized instead by the display itself. This integration reduces the number of calculations required to generate the driving waveforms for passive‐matrix displays and inherently leads to reduced power consumption on portable terminals. Moreover, the wavelet transform and the considered video‐codec architecture are both resolution‐scalable. Hence, the resolution‐scalability feature of the video codec, enabling resolution‐scalable display driving, is another means to control the power consumption of the portable device.     

Statistical motion learning for improved transform domain Wyner-Ziv video coding

Wyner-Ziv (WZ) video coding is a particular case of distributed video coding (DVC), the recent video coding paradigm based on the Slepian-Wolf and Wyner-Ziv theorems which exploits the source temporal correlation at the decoder and not at the encoder as in predictive video coding. Although some progress has been made in the last years, WZ video coding is still far from the compression performance of predictive video coding, especially for high and complex motion contents. The WZ video codec adopted in this study is based on a transform domain WZ video coding architecture with feedback channel-driven rate control, whose modules have been improved with some recent coding tools. This study proposes a novel motion learning approach to successively improve the rate-distortion (RD) performance of the WZ video codec as the decoding proceeds, making use of the already decoded transform bands to improve the decoding process for the remaining transform bands. The results obtained reveal gains up to 2.3 dB in the RD curves against the performance for the same codec without the proposed motion learning approach for high motion sequences and long group of pictures (GOP) sizes.     

数据驱动的并行视频编码器的设计和实现(英文)

通用视频编码系统一般基于标准视频压缩算法, 比如 MPEG4 和 H.264。但这些标准算法包括如离散余弦变换和运动估计等高复杂度的计算,所以为了实现实时通信,编码系统通常采用以硬件为基础的实现方法。然而以硬件为基础的视频编码系统具有实施周期长、成本高、灵活性差等不足。文章介绍了一种基于低计算复杂度自适应块截短编码方案的数据驱动并行视频编码系统,实验结果验证了编码系统的有效性。     

频率域Wyner-Ziv视频编码算法的改进

为提高分布式视频编码压缩率,依据无线传感网络终端设备及Wyner-Ziv视频编码特点,针对Bernd Girod的频域Wyner-Ziv视频编码方案提出改进算法。该算法在编码端通过简单DCT运算提出将图像块分为Skip模式、低频模式和全频模式三种可选模式,在解码端根据相应的编码模式分别选择平均插值、自适应搜索运动估计插值和自适应搜索精细运动估计插值的边信息估算方法联合解码。该算法既能通过消除大量的帧间预测与熵编码实现低码率传输,又能以最小的解码代价获得更精确的边信息,从而有效地避免图像解码质量下降。实验结果表明,在相同峰值信噪比情况下,该算法的码率比Bernd Girod提出的频域Wyner-Ziv算法平均下降40%。     

Optimal decoder for block-transform based video coders

In this paper, we introduce a new decoding algorithm for DCT-based video encoders, such as Motion JPEG (M-JPEG), H26x, or MPEG. This algorithm considers not only the compression artifacts but also the ones due to transmission, acquisition or storage of the video. The novelty of our approach is to jointly tackle these two problems, using a variational approach. The resulting decoder is object-based, allowing independent and adaptive processing of objects and backgrounds, and considers available information provided by the bitstream, such as quantization steps, and motion vectors. Several experiments demonstrate the efficiency of the proposed method. Objective and subjective quality assessment methods are used to evaluate the improvement upon standard algorithms, such as the deblocking and deringing filters included in MPEG-4 postprocessing.     

Architecture and implementation of ICs for a DSC-HDTV video decodersystem

The architecture and implementation of the very-large-scale integrated (VLSI) video decoder subsystems in digital spectrum compatible high-definition television (DSC-HDTV) systems are discussed. The CMOS deformatter IC, which converts formatted data back to motion vectors, DCT coefficients, and coding parameters, and the motion compensator and inverse discrete transform IC, which reconstructs frames from the deformatter-decoded coefficients, are described     

残差分布式视频压缩感知*

压缩感知(CS)是一种能同时进行数据采集和压缩的新理论,为简化编码算法提供了依据,同时,分布式视频编码(DVC)为低复杂度的视频编码提供了思路。因此,通过整合DVC和CS各自的特性以构建编码简单的视频编码框架,并采用残差技术来提高系统性能,最终提出了一种残差分布式视频压缩感知(RDCVS)算法:对关键帧进行传统的帧内编、解码;而对非关键帧,编码端采用一种基于残差联合稀疏模型的随机观测,解码端利用边信息和改进的梯度投影重建(GPSR)算法进行优化重构。由于将运动估计和变换编码等复杂度较高的运算转移到解码端进行,因而RDCVS保持了低复杂度的编码特性。实验结果表明,RDCVS算法比参考方案的恢复质量提高了2～3 dB。     

Motion block based video super resolution

This paper presents a new video super resolution technique, based on the motion and static areas of the low resolution video frames. In order to separate the motion and static blocks, a block motion estimation method is performed between a reference and its neighboring frames. Among the motion blocks, the occluded blocks are identified using an adaptive threshold applied on each block individually. Structure-adaptive normalized convolution (SANC) reconstruction method is used to generate the high resolution static and motion blocks where discrete wavelet transform (DWT) based interpolation is used to produce the high resolution occluded blocks. The static and motion blocks are combined into a high resolution frame. Finally, a sharpening process is performed on the high resolution frame in order to generate the super resolved high resolution output frame. The experimental results show that the proposed technique provides significantly better qualitative visual results as well as quantitative higher PSNR than the state of the art video super resolution algorithms.     

分布式视频编码中关键帧丢失错误保护

目的 分布式视频编码较其传统视频编码具有编码简单、误码鲁棒性高等特点,可以很好地满足如无人机航拍、无线监控等新型视频业务的需求。在分布式视频编码中,视频图像被交替分为关键帧和Wyner-Ziv帧,由于受到信道衰落和干扰等因素的影响,采用传统帧内编码方式的关键帧的误码鲁棒性远不如基于信道编码的Wyner-Ziv帧。关键帧能否正确传输和解码对于Wyner-Ziv帧能否正确解码起着决定性的作用,进而影响着整个系统的压缩效率和率失真性能。为此针对关键帧在异构网络中的鲁棒性传输问题,提出一种基于小波域的关键帧质量可分级保护传输方案。方法 在编码端对关键帧同时进行传统的帧内视频编码和基于小波域的Wyner-Ziv编码,解码端将经过错误隐藏后的误码关键帧作为基本层,Wyner-Ziv编码产生的校验信息码流作为增强层。为了提高系统的分层特性以便使系统的码率适应不同的网络条件,进一步将小波分解后图像的各个不同层的低频带和高频带组合成不同的增强层,根据不同信道环境,传输不同层的Wyner-Ziv校验数据。同时对误码情况下关键帧的虚拟噪声模型进行了改进,利用第1个增强层已解码重建的频带与其对应边信息来获得第2个和第3个增强层对应频带的更加符合实际的虚拟信道模型的估计。结果 针对不同的视频序列在关键帧误码率为1%20%时,相比较于传统的帧内错误隐藏算法,所提方案可以提高视频重建图像的主观质量和整体系统的率失真性能。例如在关键帧误码率为5%时,通过传输第1个增强层,不同的视频序列峰值信噪比（PSNR）提升可达25 dB左右;如果继续传输第2个增强层的校验信息,视频图像的PSNR也可以提升0.51.6 dB左右;如果3个增强层的校验信息都传输的话,基本上可以达到无误码情况下关键帧的PSNR。结论 本文所提方案可以很好地解决分布式视频编码系统中的关键帧在实际信道传输过程中可能出现的误码问题,同时采用的分层传输方案可以适应不同网络的信道情况。     

基于小波域的视频压缩编码MRME算法的研究

小波变换将视频帧分解为一系列的不同频带的子图像,在该方法中,高分辨率的运动矢量由低分辨率的运动矢量预测,并且在每一步都要进行矢量修正.为了进一步提高运动补偿的效率,提出了一种只对运动区域进行运动补偿的多分辨率运动补偿(MRME)算法,根据当前帧和参考帧小波系数,运动区域由自适应的运动检测算法得到,实验结果表明,这种方法在运算时间、信噪比和码长度方面都得到了令人满意的结果.     

Transform domain distributed video coding with spatial correlations

Distributed Video Coding is a new coding technique which has been evolving very fast recently. However the rate distortion performances of current solutions are below the expectations especially for high motion sequences even at a group of picture (GOP) size of 2. Main reason of this problem is the temporal prediction of the Wyner-Ziv (WZ) frames at the decoder. In this paper we propose a novel transform domain DVC codec architecture which splits each frame into two sub-frames and they are encoded separately as key sub-frame and WZ sub-frame. Pixel interpolation or median prediction techniques are utilized to generate the side information at the decoder. Simulation results show that a significant rate distortion improvement can be obtained with the proposed algorithm over the current DVC solutions.     

基于JPEG的固定背景视频压缩算法研究

为了对固定背景视频进行压缩并获得较高的压缩比,在JPEG静止图像压缩标准的基础上提出了一种新的应用于固定背景视频压缩的算法.对第一帧图像进行JPEG格式的压缩并保存量化后的离散余弦变换系数,对第一帧后的每一帧图像,在进行离散余弦变换和量化后,先同存储器内的第一帧图像的离散余弦变换系数进行异或运算再进行熵编码.通过使用该算法和H.264视频压缩标准对同一段固定背景视频进行压缩并比较压缩后的数据量,表明了该算法具有较高的压缩比.     

Distributed video coding with adaptive two-step side information generation for smart and interactive media

Conventional video coding standards, such as MPEGx and H.26x, use a hybrid architecture of block-based motion compensation and discrete cosine transform (DCT) within the structure of a complex encoder and a simple decoder. Contrary to conventional video codecs, Wyner-Ziv (WZ) video coding, which is a practical application of distributed video coding (DVC) based on the Slepian-Wolf and WZ theorems, exploits the source correlation at the decoder, thereby allowing for the development of simpler encoders. However, the current WZ video coding algorithms cannot match the coding performance of conventional video coding. In order to improve the coding performance of transform-domain WZ video coding, an adaptive two-step side-information generation method is thus proposed for evaluation and analysis in this study. The proposed method uses decoded WZ frames in the down-sampled spatial resolution along with already decoded coefficients to successively improve rate-distortion (RD) performance as the decoding progresses. The experimental results show that the proposed method, compared to previous WZ video coding method, shows improved coding performance, particularly under critical conditions, such as cases with high motion content.     

基于提升小波变换和DCT的彩色视频水印算法

针对数字视频的版权保护应用,提出了一种混合提升小波变换和DCT的视频水印算法。该算法先对水印进行混沌加密和Arnold置乱处理,借助密钥选取r帧彩色视频并将每帧视频的每一分量进行互不重叠的8×8分块,对选取的分块进行1级提升小波变换,并对低频子带进行DCT变换,以视频帧的纹理和运动特性自适应地确定量化步长的抖动调制方式嵌入水印,水印提取时无须原始视频的参与。实验表明,该算法实现简单,具有良好的透明性和鲁棒性,与其他算法相比,该算法具有更好的性能。     

Adaptive deblocking filter for transform domain Wyner?Ziv video coding

Wyner-Ziv (WZ) video coding is a particular case of distributed video coding, the recent video coding paradigm based on the Slepian-Wolf and Wyner-Ziv theorems that exploits the source correlation at the decoder and not at the encoder as in predictive video coding. Although many improvements have been done over the last years, the performance of the state-of-the-art WZ video codecs still did not reach the performance of state-of-the-art predictive video codecs, especially for high and complex motion video content. This is also true in terms of subjective image quality mainly because of a considerable amount of blocking artefacts present in the decoded WZ video frames. This paper proposes an adaptive deblocking filter to improve both the subjective and objective qualities of the WZ frames in a transform domain WZ video codec. The proposed filter is an adaptation of the advanced deblocking filter defined in the H.264/AVC (advanced video coding) standard to a WZ video codec. The results obtained confirm the subjective quality improvement and objective quality gains that can go up to 0.63 dB in the overall for sequences with high motion content when large group of pictures are used.     

Content-based scalable H.263 video coding for road traffic monitoring

For sending video data through very low bit-rate mobile channels, video codec with high compression rate is the pre-requisite. Although the H.263 video codec is recommended as one of the candidates due to its simplicity and efficiency, it is generally believed that its compression efficiency can be further improved if the content-based scalable video coding technique can be applied. In this paper, we propose a modified H.263 encoder which supports real-time content-based scalable video coding. The proposed technique is applied to real-time video surveillance systems for road traffic monitoring. For the proposed approach, the moving objects, i.e. cars, are first extracted from the steady background. Their activities are then further classified as fast or slow by assessing the regularity of their motion. The information is then passed to a modified H.263 encoder to reduce the temporal and spatial redundancies in the video. As compared with the conventional H.263 encoder using for the same application, the proposed system has a 20% increase in compression rate with negligible visual distortion. The proposed system fully complies with the ITU H.263 standard hence the encoded bit stream is completely comprehensible to the conventional H.263 decoder.     

基于块划分的HEVC运动目标分割方法

针对压缩域视频的运动对象分割在复杂背景下分割精度不高的问题,提出一种基于最新压缩编码HEVC的运动分割方法。首先从HEVC压缩码流中提取块划分和相对应的运动矢量信息,并分别在帧内和帧间对运动矢量进行空域和时域的标签分类,然后利用MRF模型对标签场进行运动一致性估计,得到更精确的运动目标,最后输出MRF分割后形成的掩模信息。通过实验证明,该运动分割方法能够达到有效并可靠的分割效果,尤其对于多目标运动的视频分割效果优于其他比较的方法。