Rate-distortion-optimal subband coding withoutperfect-reconstruction constraints

We investigate the design of subband coders without the traditional perfect-reconstruction constraint on the filters. The coder uses scalar quantizers, and its filters and bit allocation are designed to optimize a rate-distortion criterion. Using convexity analysis, we show that optimality can be achieved using filterbanks that are the cascade of a (paraunitary) principal component filterbank for the input spectral process and a set of pre and postfilters surrounding each quantizer. Analytical expressions for the pre and postfilters are then derived. An algorithm for computing the globally optimal filters and bit allocation is given. We also develop closed-form solutions for the special case of two-channel coders under an exponential rate-distortion model. Finally, we investigate a constrained-length version of the filter design problem, which is applicable to practical coding scenarios. While the optimal filterbanks are nearly perfect-reconstruction at high rates, we demonstrate an apparently surprising advantage of optimal FIR filterbanks; they significantly outperform optimal perfect-reconstruction FIR filterbanks at all bit rates     

Theory and design of signal-adapted FIR paraunitary filter banks

We study the design of signal-adapted FIR paraunitary filter banks, using energy compaction as the adaptation criterion. We present some important properties that globally optimal solutions to this optimization problem satisfy. In particular, we show that the optimal filters in the first channel of the filter bank are spectral factors of the solution to a linear semi-infinite programming (SIP) problem. The remaining filters are related to the first through a matrix eigenvector decomposition. We discuss uniqueness and sensitivity issues. The SIP problem is solved using a discretization method and a standard simplex algorithm. We also show how regularity constraints may be incorporated into the design problem to obtain globally optimal (in the energy compaction sense) filter banks with specified regularity. We also consider a problem in which the polyphase matrix implementation of the filter bank is constrained to be DCT based. Such constraints may also be incorporated into our optimization algorithm; therefore, we are able to obtain globally optimal filter banks subject to regularity and/or computational complexity constraints. Numerous experiments are presented to illustrate the main features that distinguish adapted and nonadapted filters, as well as the effects of the various constraints. The conjecture that energy compaction and coding gain optimization are equivalent design criteria is shown not to hold for FIR filter banks     

On factorization of M-channel paraunitary filterbanks

We systematically investigate the factorization of causal finite impulse response (FIR) paraunitary filterbanks with given filter length. Based on the singular value decomposition of the coefficient matrices of the polyphase representation, a fundamental order-one factorization form is first proposed for general paraunitary systems. Then, we develop a new structure for the design and implementation of paraunitary system based on the decomposition of Hermitian unitary matrices. Within this framework, the linear-phase filterbank and pairwise mirror-image symmetry filterbank are revisited. Their structures are special cases of the proposed general structures. Compared with the existing structures, more efficient ones that only use approximately half the number of free parameters are derived. The proposed structures are complete and minimal. Although the factorization theory with or without constraints is discussed in the framework of M-channel filterbanks, the results can be applied to wavelets and multiwavelet systems and could serve as a general theory for paraunitary systems     

Boundary filter optimization for segmentation-based subband coding

This paper presents boundary optimization techniques for the nonexpansive decomposition of arbitrary-length signals with multirate filterbanks. Both biorthogonal and paraunitary filterbanks are considered. The paper shows how matching moments and orthonormality can be imposed as additional conditions during the boundary filter optimization process. It provides direct solutions to the problem of finding good boundary filters for the following cases: (a) biorthogonal boundary filters with exactly matching moments and (b) orthonormal boundary filters with almost matching moments. With the proposed methods, numerical optimization is only needed if orthonormality and exactly matching moments are demanded. The proposed direct solutions are applicable to systems with a large number of subbands and/or very long filter impulse responses. Design examples show that the methods allow the design of boundary filters with good frequency selectivity     

Biorthogonal filterbanks and energy preservation property in imagecompression

The energy preservation property is among the most widely used properties of orthogonal transforms in image compression because the reconstruction error can be computed as the sum of the subband distortions. Thus, this is a key point in the use of efficient bit allocation techniques such as rate-distortion algorithms. Therefore, we study the nonorthogonality of biorthogonal filterbanks with reference to energy preservation from both theoretical and applicative points of view. We calculate the Riesz bounds as energy preservation bounds for filterbanks and discrete wavelet transforms, and then connect these results with the Riesz bounds of the related continuous wavelet transform. The simultaneous use of biorthogonal filterbanks and rate-distortion algorithms is then discussed as the issue of estimating the reconstruction error as an additive function of the subband distortion. We propose a weighted sum of the subband distortions as an estimate, whose accuracy is calculated by a wide range of experiments. This accuracy is shown to be correlated to the Riesz bounds of the filterbanks. We conclude that from this point of view, most of the usual biorthogonal filterbanks may be considered as nearly orthogonal.     

Comparative Analysis of Shift Variance and Cyclostationarity in Multirate Filter Banks

Multirate filter banks introduce periodic time-varying phenomena into their subband signals. The nature of these effects depends on whether the signals are regarded as deterministic or as random signals. We analyze the behavior of deterministic and wide-sense stationary (WSS) random signals in multirate filter banks in a comparative manner. While aliasing in the decimation stage causes subband energy spectra of deterministic signals to become shift-variant, imaging in the interpolation stage causes WSS random signals to become WS cyclostationary (WSCS). We provide criteria to quantify both shift variance and cyclic nonstationarity. For shift variance, these criteria separately assess the shift dependence of energy and of energy spectra. Similarly for nonstationarity, they separately assess the nonstationary behavior of signal power and of power spectra. We show that, under aliasing cancellation and perfect reconstruction constraints of paraunitary and biorthogonal filter banks, these criteria evaluate the behavior of deterministic and WSS random signals in a consistent, dual way. We apply our criteria to paraunitary and biorthogonal filter banks as well as to orthogonal block transforms, and show that, for critical signals such as lines or edges in image data, the biorthogonal 9/7 filters perform best among these     

Modeling, analysis, and optimum design of quantized M-band filterbanks

This paper provides a rigorous modeling and analysis of quantization effects in M-band subband codecs, followed by optimal filter bank design and compensation. The codec is represented by a polyphase decomposition of the analysis/synthesis filter banks and an embedded nonlinear gain-plus-additive noise model for the pdf-optimized scalar quantizers. We construct an equivalent time-invariant but nonlinear structure operating at the slow clock rate that allows us to compute the exact expression for the mean square quantization error in the reconstructed output. This error is shown to consist of two components: a distortion component and a dominant random noise component uncorrelated with the input signal. We determine the optimal paraunitary and biorthogonal FIR filter coefficients, compensators, and integer bit allocation to minimize this MSE subject to the constraints of filter length, average bit rate, and perfect reconstruction (PR) in the absence of quantizers. The biorthogonal filter bank results in a smaller MSE but the filter coefficients are very sensitive to signal statistics and to average bit constraints. By comparison, the paraunitary structure is much more robust. We also show that the null-compensated design that eliminates the distortion component is more robust than the optimally-compensated case that minimizes the total MSE, but only at nominal conditions. Both modeling and optimal design are validated by simulation in the two-channel case     

Structures, factorizations, and design criteria for oversampledparaunitary filterbanks yielding linear-phase filters

We present here a special class of oversampled filterbanks (FBs), namely, paraunitary FBs with linear-phase filters. We propose some necessary conditions for the existence of such banks, based on the repartition between type I/II and type II/IV linear-phase filters in the bank. For a subset of these FBs, we develop a factorization that leads to a minimal implementation, as well as a direct parameterization of the FBs in terms of elementary rotation angles. This factorization is applied to some design examples, with two different optimization criteria: coding gain and reconstructibility of lost coefficients     

A new class of orthonormal symmetric wavelet bases using a complexallpass filter

This paper considers the design of the whole sample symmetric (WSS) paraunitary filterbanks composed of a single complex allpass filter and gives a new class of real-valued orthonormal symmetric wavelet bases. First, the conditions that the complex allpass filter has to satisfy are derived from the symmetry and orthonormality conditions of wavelets, and its transfer function is given to satisfy these conditions. Second, the paraunitary filter banks are designed by using the derived transfer function from the viewpoints of the regularity and frequency selectivity. A new method for designing the proposed paraunitary filterbanks with a given degrees of flatness is presented. The proposed method is based on the formulation of a generalized eigenvalue problem by using the Remez exchange algorithm. Therefore, the filter coefficients can be easily obtained by solving the eigenvalue problem, and the optimal solution is attained through a few iterations. Furthermore, both the maximally flat and minimax solutions are also included in the proposed method as two specific cases. The maximally flat filters have a closed-form solution without any iteration. Finally, some design examples are presented to demonstrate the effectiveness of the proposed method     

M-band biorthogonal interpolating wavelets via lifting scheme

Recently, the lifting scheme was generalized to the multidimensional and multiband cases and was used to design M-band interpolating scaling filters and their duals. Based on this idea, we develop a new lifting pattern, namely, the progressive lifting pattern. This pattern allows us to pairwise generate M-band interpolating filterbanks and wavelets by the order from lowpass to highpass filters. A complete lifting procedure is divided into M - 1 simple steps, in each step, a pair of filters (the l'th filter and its dual) are generated. In this way, an M -band biorthogonal interpolating filterbank/wavelet is determined by M(M - 1) lifting filters. The first 2(M 1) lifting filters completely characterize the two scaling filters as well as the vanishing moments of bandpass and highpass filters; the residual (M - 1) (M - 2) lifting filters are used to pairwise optimize the bandpass and highpass filters in terms of the criterion of stopband energy minimization. The obtained M-band biorthogonal interpolating filterbanks and wavelets provide excellent frequency characteristics, in particular, low stopband sidelobes. Furthermore, the pattern is also utilized to design signal-adapted interpolating filterbanks and their rational coefficient counterparts in terms of subband coding gain. The obtained filterbanks achieve large subband coding gains. The rational coefficient filterbanks preserve the biorthogonality and allow wavelet transforms from integers to integers and a unifying lossy/lossless coding framework at the cost of a slight degradation in subband coding gain.     

Uniform FIR filterbank optimization with group delay specifications

We characterize the delay properties of uniformly modulated finite impulse response (FIR) filterbanks. Conditions on the permissable delay are developed for this class of filterbanks when the perfect reconstruction condition is relaxed. Accurate linear approximations for the phase and the group delay of the total filterbank are derived. These approximations allow linear phase or group delay constraints to be introduced in the filter optimization problem. A tractable quadratic optimization problem for the design of optimal analysis and synthesis filter prototypes is proposed. The problem involves the minimization of the aliasing distortion while constraining group delay and amplitude distortion. Thus, a new algorithm is presented to solve this optimization problem for the analysis and synthesis filterbanks simultaneously. Numerical examples are presented that confirm the theoretical results and verify that the approximations used are highly accurate.     

Modulated, perfect reconstruction filterbanks with integercoefficients

We present design methods for perfect reconstruction (PR) integer-modulated filterbanks, including biorthogonal (low-delay) filterbanks. Both the prototype filter and the modulation sequences are composed of integers, thus allowing efficient hardware implementations and fast computation. To derive such filterbanks, we first start with the PR conditions known for cosine modulation and extend them to more general, integer modulation schemes. For the design of biorthogonal PR integer prototypes, a lifting strategy is introduced. To find suitable integer modulation schemes, new algebraic methods are presented. We show solutions where the PR conditions on the prototype filters and the modulation matrices are entirely decoupled and where some simple coupling is introduced. Both even and odd numbers of channels are considered. Design examples are presented for both cases     

最小平方误差受限的FIR滤波器设计

在设计FIR滤波器时,往往会指定过渡带大小,但过渡带的引入只是为了便于滤波器的设计,而并不是物理上的需要,所以在设计中仅需指定截至频率。这是第一个设计理念。此外,在FIR滤波器的设计中存在两种准则:一是等波纹设计准则 (即最大误差最小化或者Chebyshev准则 ),另一种是平方误差最小准则。但在现实中两种准则往往要同时兼顾,所以仅基于其中一种准则来设计不能得到最佳结果。这是第二个设计理念。基于上述两种设计理念,提出了一种新的FIR滤波器设计算法。该算法采用最陡梯度下降法来对平方误差最小化下的最佳滤波器系数进行迭代修正,得到最佳结果。     

Biorthogonal Butterworth wavelets derived from discreteinterpolatory splines

We present a new family of biorthogonal wavelet transforms and a related library of biorthogonal periodic symmetric waveforms. For the construction, we used the interpolatory discrete splines, which enabled us to design a library of perfect reconstruction filterbanks. These filterbanks are related to Butterworth filters. The construction is performed in a “lifting” manner. The difference from the conventional lifting scheme is that all the transforms are implemented in the frequency domain with the use of the fast Fourier transform (FFT). Two ways to choose the control filters are suggested. The proposed scheme is based on interpolation, and as such, it involves only samples of signals, and it does not require any use of quadrature formulas. These filters have a linear-phase property, and the basic waveforms are symmetric. In addition, these filters yield refined frequency resolution     

Optimization of filter banks using cyclostationary spectralanalysis

This paper proposes a design method of optimal biorthogonal FIR filter banks that minimize the time-averaged mean squared error (TAMSE) when the high-frequency subband signal is dropped. To study filter banks from a statistical point of view, cyclostationary spectral analysis is used since the output of the filter bank for a wide-sense stationary input is cyclostationary. First, the cyclic spectral density of the output signal is derived, and an expression for the TAMSE is presented. Then, optimal filter banks are given by minimizing the TAMSE with respect to the coefficients of the filters under the biorthogonality condition. By imposing the additional constraints on the coefficients, the optimal biorthogonal linear phase filter bank can be obtained     

Three-band biorthogonal interpolating complex wavelets with stopband suppression via lifting scheme

Wavelet research has primarily focused on real-valued wavelet bases. However, the complex filterbanks provide much convenience for complex signal processing. For example, in radar and sonar signal processing, the complex signals from the I/Q receiver can be efficiently processed with complex filterbanks rather than real filterbanks. Specifically, the positive and negative Doppler frequencies imply different physical content in the moving target detector (MTD) and moving target identification (MTI); therefore, it is significant to design complex multiband filterbanks that can partition positive and negative frequencies into different subbands. We design two novel families of three-band biorthogonal interpolating complex filterbanks and wavelets by using the three-band lifting scheme. Unlike the traditional three-band filterbanks, the novel complex filterbank is composed of three channels, including the lowpass channel, the positive highpass channel whose passband distributes in the positive frequency region, and the negative highpass channel in the negative frequency region. Such a filterbank/wavelet naturally provides the ability to extract positive frequency components and negative frequency components from complex signals. Moreover, a novel set of design constraints are introduced to manipulate the stopband characteristic of highpass filters and are referred to as stopband suppression, which strengthens the traditional constraints of vanishing moments. Finally, a numerical method is given to further lower stopband sidelobes.     

三带自适应提升双正交滤波器组

该文研究了利用三带提升方法设计三带自适应双正交的滤波器组。在设计中,用子带编码增益作为设计准则,从任意一个滤波器组(标准正交或双正交)开始。通过有序自适应提升方法来设计三带双正交滤波器组。最后。给出例子说明。当选择一个合适初始滤波器组时,子带码增益可以得到较大提高。     

Redundant filterbank precoders and equalizers. I. Unification andoptimal designs

Transmitter redundancy introduced using filterbank precoders generalizes existing modulations including OFDM, DMT, TDMA, and CDMA schemes encountered with single- and multiuser communications. Sufficient conditions are derived to guarantee that with FIR filterbank precoders FIR channels are equalized perfectly in the absence of noise by FIR zero-forcing equalizer filterbanks, irrespective of the channel zero locations. Multicarrier transmissions through frequency-selective channels can thus be recovered even when deep fades are present. Jointly optimal transmitter-receiver filterbank designs are also developed, based on maximum output SNR and minimum mean-square error criteria under zero-forcing and fixed transmitted power constraints. Analytical performance results are presented for the zero-forcing filterbanks and are compared with mean-square error and ideal designs using simulations     

Smooth wavelets, transform coding, and Markov-1 processes

This paper compares the energy compacting properties of unitary transforms from transform coders and two-band paraunitary filter banks from subband coders using a cost criterion that is proposed. Stationary processes for which paraunitary filters have better energy compaction than unitary filters are denoted as subband optimal, and all subband optimal processes are analytically characterized for the case of length-4 filters. It is shown analytically for length-4 filters and empirically for longer-length filters that Markov-1 processes are subband optimal and that the Daubechies (1988) maximally smooth wavelet sequences achieve better energy compaction than the best unitary filters for Markov-1 inputs     

A general-purpose optimization approach for designing two-channel FIR filterbanks

An efficient general-purpose optimization approach is proposed for designing two-channel finite impulse response (FIR) filterbanks. This technique can be used for optimizing two-channel FIR filterbanks in all alias-free cases proposed in the literature. The generalized problem is to minimize the maximum of the stopband energies of the two analysis filters subject to the given passband and transition band constraints and the given allowable reconstruction error. Therefore, in addition to the perfect-reconstruction filterbanks, nearly perfect-reconstruction banks can be optimized in a controlled manner. The optimization is carried out in two steps. In the first step, for the selected type of the filterbank, a good starting-point filterbank for further optimization is generated using an existing design scheme. The second step involves optimizing the filterbank with the aid of a modified Dutta-Vidyasagar (1977) algorithm. Several examples are included, illustrating the efficiency and the flexibility of the proposed approach.