Blind and complete modeling of linear systems using third order cumulants

This paper presents a novel approach to structure determination of linear systems along with the choice of system orders and parameters.AutoRegressive (AR),Moving Average (MA) or AutoRegressive-Moving Average (ARMA) model structure can be extracted blindly from the Third Order Cumulants (TOC) of the system output measurements,where the unknown system is driven by an unobservable stationary independent identically distributed (i.i.d.) non-Gaussian signal.By means of the system order recursion,whether the system has an AR structure or has AR part of an ARMA structure is firstly investigated.MA features in the TOC domain is then applied as a threshold to decide if the system is an MA model or has MA part of an ARMA model.Numerical simulations illustrate the generality of the proposed blind structure identification methodology that may serve as a guideline for blind linear system modeling.     

Semiblind identification of nonminimum-phase ARMA models via orderrecursion with higher order cumulants

This paper develops a novel identification methodology for nonminimum-phase autoregressive moving average (ARMA) models of which the models' orders are not given. It is based on the third-order statistics of the given noisy output observations and assumed input random sequences. The semiblind identification approach is thereby named. By the order-recursive technique, the model orders and parameters can be determined simultaneously by minimizing well-defined cost functions. At each updated order, the AR and MA parameters are estimated without computing the residual time series (RTS), with the result of decreasing the computational complexity and memory consumption. Effects of the AR estimation error on the MA parameters estimation are also reduced. Theoretical statements and simulations results, together with practical application to the train vibration signals' modeling, illustrate that the method provides accurate estimates of unknown linear models, despite the output measurements being corrupted by arbitrary Gaussian noises of unknown pdf     

Bispectrum Reconstruction Method of UWB Echoes

Estimation of transient signal in additive noise is very important in radar object detection and recognition. This paper presents a new method for transient signal reconstruction based on bispectrum estimation techniques. The third-order cumulants of the received noisy ultra-wide band echoes are acquired first and an ARMA model is then fitted. The bispectrum of the output signal of the ARMA model will be used to reconstruct the transient signal. Simulation results show that the effect is very good even in lower signal-to-noise (SNR) situation.     

A Novel Technique for the Identification of ARMA Systems Under Very Low Levels of SNR

In this paper, a novel technique for the identification of minimum-phase autoregressive moving average (ARMA) systems from the output observations in the presence of heavy noise is presented. First, starting from the conventional correlation estimator, a simple and accurate ARMA correlation (ARMAC) model in terms of the poles of the ARMA system is presented in a unified manner for white noise and impulse-train excitations. The AR parameters of the ARMA system are then obtained from the noisy observations by developing and using a residue-based least-squares correlation-fitting optimization technique that employs the proposed ARMAC model. As for the estimation of the MA parameters, it is preceded by the application of a new technique intended to reduce the noise present in the residual signal that is obtained by filtering the noisy ARMA signal via the estimated AR parameters. A scheme is then devised whereby the task of MA parameter estimation is transformed into a problem of correlation-fitting of the inverse autocorrelation function corresponding to the noise-compensated residual signal. In order to demonstrate the effectiveness of the proposed method, extensive simulations are performed by considering synthetic ARMA systems of different orders in the presence of additive white noise and the results are compared with those of some of the existing methods. It is shown that the proposed method is capable of estimating the ARMA parameters accurately and consistently with guaranteed stability for signal-to-noise ratio (SNR) levels as low as $-{5}~{hbox {dB}}$ . Simulation results are also provided for the identification of a human vocal-tract system using natural speech signals showing a superior performance of the proposed technique in terms of the power spectral density of the synthesized speech signal.      

Analysis of UWB Echoes Using Bispectrum Model

According to the features of the echoes of the ultra-wide band radar, this paper analyses the estimating effects of choosing the AR model, MA model and ARMA model based on bispectrum. It shows that ARMA model is much better than others. Simulations verify this result, also demonstrate the estimation precision has been improved. ARMA model parametric bispectrum estimation is very efficient to echoes of ultra-wide band radar.     

Modeling arbitrary polynomial bispectra in one and two dimensions

The authors propose a novel model, called a system with multiplicity (SWM), which is a refinement of the model proposed by Sakaguchi and Sakai (1989), to represent arbitrary polynomial bispectra. It is shown that an arbitrary polynomial bispectrum of a 1-D signal can always be realized using an SWM with FIR (finite impulse response) components. An algorithm is then developed for the identification of SWM that will match a given polynomial bispectrum. The authors address the problem of simultaneously matching an arbitrary polynomial bispectrum and a rational power spectrum function using an SWM. It is shown that this can always be accomplished by including another LSI component that is driven by a Gaussian input to the system. Experimental results for matching an estimated bispectrum as well as simultaneously matching a polynomial bispectrum and a power spectrum of some 1-D signals are presented. It is shown that in two dimensions an arbitrary polynomial bispectrum cannot always be uniquely modeled using an SWM with 2-D FIR components having different extents     

New approaches without postprocessing to FIR system identificationusing selected order cumulants

In this paper, we address the problem of identifying the parameters of the nonminimum-phase FIR system from the cumulants of noisy output samples. The system is driven by an unobservable, zero-mean, independent and identically distributed (i.i.d) non-Gaussian signal. The measurement noise may be white Gaussian, colored MA, ARMA Gaussian processes, or even real. For this problem, two novel methods are proposed. The methods are designed by using higher order cumulants with the following advantages. (i) Flexibility: method 1 employs two arbitrary adjacent order cumulants of output, whereas method 2 uses three cumulants of output: two cumulants with arbitrary orders and the other one with an order equal to the summation of the two orders minus one. Because of this flexibility, we can select cumulants with appropriate orders to accommodate different applications. (ii) Linearity: both the formulations in method 1 and method 2 are linear with respect to the unknowns, unlike the existing cumulant-based algorithms. The post-processing is thus avoided. Extensive experiments with ARMA Gaussian and three real noises show that the new algorithms, especially algorithm 1, perform the FIR system identification with higher efficiency and better accuracy as compared with the related algorithms in the literature     

Multichannel ARMA modeling by least squares circular latticefiltering

The paper makes an attempt to develop least squares lattice algorithms for the ARMA modeling of a linear, slowly time-varying, multichannel system employing scalar computations only. Using an equivalent scalar, periodic ARMA model and a circular delay operator, the signal set for each channel is defined in terms of circularly delayed input and output vectors corresponding to that channel. The orthogonal projection of each current output vector on the subspace spanned by the corresponding signal set is then computed in a manner that allows independent AR and MA order recursions. The resulting lattice algorithm can be implemented in a parallel architecture employing one processor per channel with the data flowing amongst them in a circular manner. The evaluation of the ARMA parameters from the lattice coefficients follows the usual step-up algorithmic approach but requires, in addition, the circulation of certain variables across the processors since the signal sets become linearly dependent beyond certain stages. The proposed algorithm can also be used to estimate a process from two correlated, multichannel processes adaptively allowing the filter orders for both the processes to be chosen independently of each other. This feature is further exploited for ARMA modeling a given multichannel time series with unknown, white input     

Autocorrelation model-based identification method for ARMA systems in noise

A novel method for parameter estimation of minimum-phase autoregressive moving average (ARMA) systems in noise is presented. The ARMA parameters are estimated using a damped sinusoidal model representation of the autocorrelation function of the noise-free ARMA signal. The AR parameters are obtained directly from the estimates of the damped sinusoidal model parameters with guaranteed stability. The MA parameters are estimated using a correlation matching technique. Simulation results show that the proposed method can estimate the ARMA parameters with better accuracy as compared to other reported methods, in particular for low SNRs.     

Time-Frequency ARMA Models and Parameter Estimators for Underspread Nonstationary Random Processes

Parsimonious parametric models for nonstationary random processes are useful in many applications. Here, we consider a nonstationary extension of the classical autoregressive moving-average (ARMA) model that we term the time-frequency autoregressive moving-average (TFARMA) model. This model uses frequency shifts in addition to time shifts (delays) for modeling nonstationary process dynamics. The TFARMA model and its special cases, the TFAR and TFMA models, are shown to be specific types of time-varying ARMA (AR, MA) models. They are attractive because of their parsimony for underspread processes, that is, nonstationary processes with a limited time-frequency correlation structure. We develop computationally efficient order-recursive estimators for the TFARMA, TFAR, and TFMA model parameters which are based on linear time-frequency Yule-Walker equations or on a new time-frequency cepstrum. Simulation results demonstrate that the proposed parameter estimators outperform existing estimators for time-varying ARMA (AR, MA) models with respect to accuracy and/or numerical efficiency. An application to the time-varying spectral analysis of a natural signal is also discussed.     

基于输出累积量的 ARMA(AR)系统的一致性阶次递推辩识(英文)

本文提出了一种根据系统输出的观测数据对ARMA（AR）系统进行盲识别的新算法。该模型由独立同分布非高斯随机序列驱动，其输出序列中含方差未知的加性高斯噪声。通过求解基于三阶累积量谱的代价函数，该算法以模型阶次递推形式同时辩识ARMA的系统阶次和估计出系统参数。文章给出了该算法一致收敛性的证明，并对两类不同阶次的最小及非最小相位ARMA系统的AR参数及阶次辩识进行了数字仿真，结果令人满意。     

Order-recursive blind identification of linear models using mixedcumulants

The problem of determining the AR order and parameters of a nonminimum phase ARMA model from observations of the system output is considered. The model is driven by a sequence of random variables which is assumed unobservable. A novel identification algorithm based on the second- and third-order cumulants of the output sequences is introduced. It performs order-recursively by minimising a well defined cost function. Strong convergence and consistency of the algorithm are proved and the weight of the cost function is balanced between the second-order and the third-order cumulants of output sequences. The influence of the weight on the estimation accuracy is also evaluated. Theoretical analyses and numerical simulations show that the proposed algorithm is satisfactory for both order and parameter identification of an AR model which is subordinate to a nonminimum phase ARMA model     

A Least-Squares-Based Algorithm for Identification of Non-Gaussian ARMA Models

A new recursive method for estimating the parameters of autoregressive moving average (ARMA) models is presented in this paper. The recursive linear identification method is developed using higher-order statistics of the observed output data and is based on a least-squares solution. Namely, a matrix consisting of third-order statistics (or cumulants) of the observed output data is constructed so that it almost possesses a full rank structure. The signal is embedded in a Gaussian noise that may be colored. The system is driven by a zero-mean independent and identically distributed non-Gaussian process. The excitation signal is unobserved. Simulation results are given to illustrate the performance of the proposed algorithm with respect to existing well-known methods.     

Higher order cumulants-based least squares for nonminimum-phasesystems identification

A third-order cumulants based adaptive recursive least-squares (CRLS) algorithm for the identification of time-invariant nonminimum phase systems, as well as time-variant nonminimum phase systems, has been successfully developed. As higher order cumulants preserve both the magnitude and the phase information of received signals, they have been considered as powerful signal processing tools for nonminimum phase systems. In this paper, the development of the CRLS algorithm is described and examined. A cost function based on the third-order cumulant and the third-order cross cumulant is defined for the development of the CRLS system identification algorithm. The CRLS algorithm is then applied to different moving average (MA) and autoregressive moving average (ARMA) models. In the case of identifying the parameters of an MA model, a direct application of the CRLS algorithm is adequate. When dealing with an ARMA model, the poles and the zeros are estimated separately. In estimating the zeros of the ARMA model, the construction of a residual time-series sequence for the MA part is required. Simulation results indicate that the CRLS algorithm is capable of identifying nonminimum phase and time-varying systems. In addition, because of the third-order cumulant properties, the CRLS algorithm can suppress Gaussian noise and is capable of providing an unbiased estimate in a noisy environment     

ARMA-cepstrum Recursion Algorithm for the Estimation of the MA Parameters of 2-D ARMA Models

This paper considers the problem of estimating the moving average (MA) parameters of a two-dimensional autoregressive moving average (2-D ARMA) model. To solve this problem, a new algorithm that is based on a recursion relating the ARMA parameters and cepstral coefficients of a 2-D ARMA process is proposed. On the basis of this recursion, a recursive equation is derived to estimate the MA parameters from the cepstral coefficients and the autoregressive (AR) parameters of a 2-D ARMA process. The cepstral coefficients are computed benefiting from the 2-D FFT technique. Estimation of the AR parameters is performed by the 2-D modified Yule–Walker (MYW) equation approach. The development presented here includes the formulation for real-valued homogeneous quarter-plane (QP) 2-D ARMA random fields, where data are propagated using only the past values. The proposed algorithm is computationally efficient especially for the higher-order 2-D ARMA models, and has the advantage that it does not require any matrix inversion for the calculation of the MA parameters. The performance of the new algorithm is illustrated by some numerical examples, and is compared with another existing 2-D MA parameter estimation procedure, according to three performance criteria. As a result of these comparisons, it is observed that the MA parameters and the 2-D ARMA power spectra estimated by using the proposed algorithm are converged to the original ones     

Modeling (almost) periodic moving average processes using cyclicstatistics

Estimating parameters of almost cyclostationary non-Gaussian moving average (MA) processes using noisy output-only data is considered. It is shown that second-order cyclic correlations of the output are generally insufficient in uniquely characterizing almost periodically time-varying MA(q) models, while third-order and higher order cumulants can be used to estimate their model parameters within a scale factor. Both linear and nonlinear identification algorithms for fixed and time-varying order q(t) are presented. Statistical model order determination procedures are also derived. Implementation issues are discussed and resistance to noise is claimed when the signal of interest has cycles distinct from the additive noise. Simulations are performed to verify the theoretical results     

非高斯有色噪声中的正弦信号频率估计

本文研究非高斯ＡＲＭＡ有色噪声中的正弦信号频率估计问题。利用自相关函数和三阶累积量相结合，提出了一种先估计噪声模型ＡＲ参数，然后对观测值进行预滤波，最后估计信号模型参数的新方法，模拟实验结果表明，新方法具有良好的频率估计性能。     

MA parameter estimation and cumulant enhancement

This paper addresses the problem of estimating the parameters of a moving average (MA) model from either only third- or fourth-order cumulants of the noisy observations of the system output. The system is driven by an independent and identically distributed non-Gaussian sequence that is not observed. The unknown model parameters are obtained using a batch least squares method. Recursive methods are also developed and used to claim the uniqueness of the batch least squares solutions. A novel technique for the enhancement of third-order cumulants of MA processes is introduced. This new technique is based on the concept of composite property mappings and helps reduce the variance of the estimates of third- (or fourth)-order cumulants of MA processes. Simulation results are presented that demonstrate the performance of the new methods and compare them with a range of existing techniques     

非高斯ARMA噪声中谐波恢复的杂交ESPRIT方法

本文研究非高斯ARMA噪声中的谐波恢复问题,提出了一种基于二阶和三阶统计量的杂交ESPRIT方法,该方法先估计噪声过程的AR部分参数,然后对观测值进行预滤波,最后估计谐波信号参量。模拟实验还验证了该方法的有效性和高分辨率。     

NEW APPROACH TO HARMONIC RETRIEVAL IN NOISE

This paper addresses the harmonic retrieval problem in non-Gaussian ARMA noise. A hybrid ESPRIT approach using second-and third-order statistics is proposed. First, third-order statistics are used to identify the AR part of the non-Gaussian noise process, then the noisy measurements are filtered by AR polynomial, finally, the harmonic signal parameters are estimated. Simulation examples show the effectiveness and high resolution of the new approach.