Motion-compensated 3-D subband coding of video

This paper describes a video coding system based on motion-compensated three-dimensional (3-D) subband/wavelet coding (MC-3DSBC), which can overcome the limits of both 3-D SBC and MC prediction-based coding. In this new system, spatio-temporal subbands are generated by MC temporal analysis and a spatial wavelet transform, and then encoded by 3-D subband-finite state scalar quantization (3DSB-FSSQ). The rate allocation from the GOP level to each class of subbands is optimized by utilizing the structural property of MC-3DSBC that additive superposition approximately holds for both rate and distortion. The proposed video coding system is applied to several test video clips. Its performance exceeds that of both a known MPEG-1 implementation and a similar subband MC predictive coder while maintaining modest computational complexity and memory size.     

Efficient Block-Based Frequency Domain Wavelet Transform Implementations

Subband decompositions for image coding have been explored extensively over the last few decades. The condensed wavelet packet (CWP) transform is one such decomposition that was recently shown to have coding performance advantages over conventional decompositions. A special feature of the CWP is that its design and implementation are performed in the cyclic frequency domain. While performance gains have been reported, efficient implementations of the CWP (or more generally, efficient implementations of cyclic filter banks) have not yet been fully explored. In this paper, we present efficient block-based implementations of cyclic filter banks along with an analysis of the arithmetic complexity. Block-based cyclic filter bank implementations of the CWP coder are compared with conventional subband/wavelet image coders whose filter banks are implemented in the time domain. It is shown that block-based cyclic filter bank implementations can result in CWP coding systems that outperform the popular image coding systems both in terms of arithmetic complexity and coding performance.      

A motion compensated subband coder for very low bit-rates

A motion compensated subband coder with block-based processing for very low bit-rate video coding is presented. The motion compensated prediction is realized by using overlapping blocks. A forward analysis is introduced to select the blocks to be updated. In contrast to the conventional subband coding which is applied to the whole image, the subband coding here is applied to selected blocks only. In order to reduce the number of samples to be coded, a symmetric-periodic extension technique is applied in each stage of the subband analysis and synthesis filtering. A psychovisual model of the human visual perception is used to control the bit allocation and the adaptive quantization. Experimental results obtained with the presented coder at transmission bit-rates of 8, 16 and 24 kbit/s are presented. A comparison of the presented coder with ITU-T TMN-3 coder shows, that a PSNR gain of about 2.0 dB is achieved for typical videophone sequences with head and shoulder scenes.     

Construction of optimal subband coders using optimized and optimalquantizers

A method is presented for the optimization of arbitrary quantizers by use of a compensating postfilter. It is shown that the resulting optimized quantizers fit the model of a linear time-invariant filter followed by additive noise uncorrelated with the input which also characterizes the optimal (Lloyd-Max) quantizers. On the basis of this model, an expression for the variance of the error of a subband coder using optimized quantizers is explicitly determined. Given analysis filters which statistically separate the subbands, it is shown that this variance is minimized if these synthesis filters are chosen, which would achieve perfect reconstruction in lossless coding. The globally optimum filter bank, minimizing the coder error variance, is further obtained by proper choice of its analysis filters. A novel method for the determination of optimal bit allocation to subbands of the filter banks with optimized quantizers is also developed. The results are evaluated experimentally by comparison of the optimum uniformly split subband image coding scheme to classical logarithmically-split filter bank (wavelet) coding methods.     

Hybrid picture coding with wavelet transform and overlappedmotion-compensated interframe prediction coding

A novel video coding scheme using an orthonormal wavelet transform is proposed. The wavelet transform is used in a motion compensated interframe coder in which a blockless motion compensation technique is employed to increase efficiency of wavelet transform coding. A new scanning method for wavelet coefficients is also proposed which is rather different from subband coding. Simulation work is carried out to evaluate the proposed coding method. Significant improvement in subjective quality is obtained over that obtained with conventional hybrid coding methods that use blockwise motion compensation and DCT. Some improvement has also been realized in the signal to noise ratio. Although wavelet coding is still in its early stages of development, it appears to hold great promise for motion picture coding     

一种高效的运动补偿三维小波视频编码方案

该文提出了一种高效的运动补偿三维小波视频编码方案。该方案采用运动补偿时域分析技术,以有效去除视频序列中存在的时间冗余。然后,基于视频序列的运动特征,自适应确定帧组结构,在提高编码效率的同时降低内存需求和运算复杂度。最后,根据小波图像系数特性,采用基于四叉树分裂的小波图像编码方法对三维时/空子带进行编码,以获得更高的压缩效率。实验结果表明,与其它运动补偿三维小波视频编码方法相比,该文提出的编码方案能够获得更好的性能。     

The design of 2-D nonseparable directional perfect reconstruction filter banks

In this paper, we develop a directional 2-D nonseparable filter bank that can perfectly reconstruct the downsampled subband signals. The filter bank represents two powerful image and video processing tools: directional subband decomposition and perfect reconstruction. The directional filter banks consist of (1) the input signal and the subband signals modulation, (2) diamond shape prefilter, and (3) four different parallelogram shape prefilters. This paper addresses the design and implementation of a two-band filter bank that is proved to be able to provide perfect reconstruction of the downsampled subband signals. Finally, we use a conventional 1-D half-band filter as a prototype and then apply the McClellan transform for the specific 2-D diamond shape and parallelogram shape subfilters. This method is extremely simple in designing the analysis/synthesis subfilters for the filter bank.     

基于双向运动补偿的三维小波变换方法

提出了基于双向运动补偿的三维小波变换方法,与以往的三维小波变换方法相比较,该方法在三维小波视频编码方法中应用了双向的运动估计/补偿,进而实现了两种时域可扩展方式的组合,提高了视频编码的可扩展性。     

Vector space framework for unification of one- and multidimensionalfilter bank theory

A number of results in filter bank theory can be viewed using vector space notations. This simplifies the proofs of many important results. In this paper, we first introduce the framework of vector space, and then use this framework to derive some known and some new filter bank results as well. For example, the relation among the Hermitian image property, orthonormality, and the perfect reconstruction (PR) property is well-known for the case of one-dimensional (1-D) analysis/synthesis filter banks. We can prove the same result in a more general vector space setting. This vector space framework has the advantage that even the most general filter banks, namely, multidimensional nonuniform filter banks with rational decimation matrices, become a special case. Many results in 1-D filter bank theory are hence extended to the multidimensional case, with some algebraic manipulations of integer matrices. Some examples are: the equivalence of biorthonormality and the PR property, the interchangeability of analysis and synthesis filters, the connection between analysis/synthesis filter banks and synthesis/analysis transmultiplexers, etc. Furthermore, we obtain the subband convolution scheme by starting from the generalized Parseval's relation in vector space. Several theoretical results of wavelet transform can also be derived using this framework. In particular, we derive the wavelet convolution theorem     

一种二维离散子波变换的滤波器结构

子波变换具有良好的时间（空间）频率局部化性能，在图象子带编码中二维离散子波变换是一种接近理想的子带分析／综合子系统．本文提出一种利用一维离散子波变换实现二维有限长离散子波变换的方法，同时给出了二维离散子波正变换（DWT）和反变换（IDWT）的滤波器实现结构．实验结果表明新的方法具有良好的重构性，完全适用于图象压缩编码系统中的分析／综合子系统．     

Subband coding of image sequences at low bit rates

In this paper a low bit rate subband coding scheme for image sequences is described. Typically, the scheme is based on temporal DPCM in combination with an intraframe subband coder. In contrast to previous work, however, the subbands are divided into blocks onto which conditional replenishment is applied, while a bit allocation algorithm divides the bits among the blocks assigned for replenishment. A solution is given for the ‘dirty window’ effect by setting blocks to zero that were assigned to be replenished but received no bits. The effect of motion compensation and the extension to color images are discussed as well. Finally, several image sequence coding results are given for a bit rate of 300 kbit/s.     

Synthesis filter bank optimization in two-dimensional separablesubband coding systems

Subband coding is a popular and well established technique used in visual communications, such as image and video transmission. In the absence of quantization and transmission errors, the analysis and synthesis filters in a subband coding scheme can be designed to obtain perfect reconstruction of the input signal, but this is no longer the optimal solution in the presence of quantization of the subband coefficients. We presuppose the use of a two-dimensional (2-D) separable subband scheme and we address the problem of designing, for a given analysis filter bank and assuming uniform quantization of the subband coefficients, the set of row and column synthesis filters that minimize the mean squared reconstruction error at the output of the subband system. Since the corresponding optimization problem is inherently nonlinear, we propose a suboptimal solution that extends a one-dimensional (l-D) optimal filter design procedure, already presented in the literature, to a 2-D separable synthesis filter bank. The separable 2-D extension is not trivial, since the processing in one direction, e.g., the rows, alters the statistics of the signals for the design of the filters in the other direction, e.g., the columns. To further simplify the filter design, we propose to model the input image as a 2-D separable Markov process plus an additive white component. Several design examples using both synthetic signals and real world images are presented, showing that the filters designed using the proposed technique can give a significant gain with respect to the perfect reconstruction solution, especially when the dither technique is used for quantization. The simulation results also show that the proposed image model can be conveniently used in the synthesis filter design procedure.     

Hierarchical partition priority wavelet image compression

Image compression methods for progressive transmission using optimal hierarchical decomposition, partition priority coding (PPC), and multiple distribution entropy coding (MDEC) are presented. In the proposed coder, a hierarchical subband/wavelet decomposition transforms the original image. The analysis filter banks are selected to maximize the reproduction fidelity in each stage of progressive image transmission. An efficient triple-state differential pulse code modulation (DPCM) method is applied to the smoothed subband coefficients, and the corresponding prediction error is Lloyd-Max quantized. Such a quantizer is also designed to fit the characteristics of the detail transform coefficients in each subband, which are then coded using novel hierarchical PPC (HPPC) and predictive HPPC (PHPPC) algorithms. More specifically, given a suitable partitioning of their absolute range, the quantized detail coefficients are ordered based on both their decomposition level and partition and then are coded along with the corresponding address map. Space filling scanning further reduces the coding cost by providing a highly spatially correlated address map of the coefficients in each PPC partition. Finally, adaptive MDEC is applied to both the DPCM and HPPC/PHPPC outputs by considering a division of the source (quantized coefficients) into multiple subsources and adaptive arithmetic coding based on their corresponding histograms. Experimental results demonstrate the great performance of the proposed compression methods.     

基于块区域子波变换的甚低码率视频编码算法

本文描述了一个有效的视频编码算法，该算法基于视频信号的分数像素精度重叠运动补偿预测和利用双正交滤波器组的区域子波分解，文中给出了采用２４＊２４重叠块的编码器模拟结果。     

Motion Compensated Subband Video Coding with Arbitrarily Shaped Region Adaptivity

The performance of Motion Compensated Discrete Cosine Transform (MC‐DCT) video coding is improved by using the region adaptive subband image coding [18]. On the assumption that the video is acquired from the camera on a moving platform and the distance between the camera and the scene is large enough, both the motion of camera and the motion of moving objects in a frame are compensated. For the compensation of camera motion, a feature matching algorithm is employed. Several feature points extracted using a Sobel operator are used to compensate the camera motion of translation, rotation, and zoom. The illumination change between frames is also compensated. Motion compensated frame differences are divided into three regions called stationary background, moving objects, and newly emerging areas each of which is arbitrarily shaped. Different quantizers are used for different regions. Compared to the conventional MC‐DCT video coding using block matching algorithm, our video coding scheme shows about 1.0‐dB improvements on average for the experimental video samples.     

一种时域质量稳定的三维小波视频编码率控制技术

三维小波视频编码提供了分辨率、时域和质量的可伸缩性。在三维小波编码中，如何调整各小波频带间的码率分配以达到最佳的码率控制至关重要。就小波变换和反变换的结构而言，常规的三维小波视频编码方法会导致解码视频帧沿时间方向播放质量的周期振荡，这种周期的振荡会影响了观看质量。本文研究了重建信号与小波频带间失真分布的关系，提出了一种具有稳定的时域解码质量的率控制方法，实验结果表明该算法在保证播放质量稳定的同时，还具有与常规三维小波视频编码方法近似的平均解码质量。     

Wavelet-based very low bit-rate video coding using image warpingand overlapped block motion compensation

The authors present an algorithm for very low bit-rate video coding that combines new ideas in motion estimation, wavelet filter design, and wavelet-based coding techniques. A new motion compensation technique using image warping and overlapped block motion compensation is proposed to reduce temporal redundancies in a given image sequence. This combined motion model has the advantage of representing more complex motion than simple block matching schemes. To further improve the quality of the temporal prediction, an adaptive grid with variable density according to the varying motion activity of a given scene is generated. An adaptively switched high-quality texture interpolation is employed to cope with the problem of fractional displacements in such a way that both objective and subjective reconstruction quality is improved. Spatial decorrelation of the motion compensated residual images is performed using an one-parametric family of biorthogonal infinite impulse response (IIR) wavelet filters coupled with the highly efficient pre-coding scheme of `partitioning, aggregation and conditional coding' (PACC). Experimental results demonstrate significant improvements in objective quality of 1.0-2.3 dB PSNR in comparison to the H.263+ test model TMN10 using advanced coding options. In addition, the authors' intracoding method provides a performance gain of 0.5 dB PSNR on the average for a test suite of various still images when compared to the emerging still image coding standard JPEG-2000     

Three-dimensional subband coding of video

We describe and show the results of video coding based on a three-dimensional (3-D) spatio-temporal subband decomposition. The results include a 1-Mbps coder based on a new adaptive differential pulse code modulation scheme (ADPCM) and adaptive bit allocation. This rate is useful for video storage on CD-ROM. Coding results are also shown for a 384-kbps rate that are based on ADPCM for the lowest frequency band and a new form of vector quantization (geometric vector quantization (GVQ)) for the data in the higher frequency bands. GVQ takes advantage of the inherent structure and sparseness of the data in the higher bands. Results are also shown for a 128-kbps coder that is based on an unbalanced tree-structured vector quantizer (UTSVQ) for the lowest frequency band and GVQ for the higher frequency bands. The results are competitive with traditional video coding techniques and provide the motivation for investigating the 3-D subband framework for different coding schemes and various applications.     

FIR principal component filter banks

Two-dimensional (2-D) principal component filter banks (PCFBs) of finite impulse response (FIR) are proposed. For 2-D signals, among all uniform paraunitary FIR analysis/synthesis filter banks, the FIR PCFBs have the most energy compaction and maximize the arithmetic mean to geometric mean ratio (AM/GM ratio) of subband variances, which is the theoretic coding gain (TCC) of the systems under proper assumptions. The theoretic proof and design techniques are provided. Several special cases are discussed. Experimental results show the potential power of the FIR PCFBs