Optimal errors-in-variables filtering

This paper deals with optimal (minimal variance) filtering in an errors-in-variables framework. Differently from many other contexts, errors-in-variables models treat all variables in a symmetric way (no partition of the variables into inputs and outputs is required) and assume additive noise on all the variables. The filtering technique described in this paper can be easily implemented in a recursive way and does not require the use of a Riccati equation at every update. The results of Monte Carlo simulations have shown the effectiveness and consistency of the approach.     

Identification of nonlinear errors-in-variables models

The paper is about a generalization of a classical eigenvalue-decomposition method originally developed for errors-in-variables linear system identification to handle an important class of nonlinear problems. A number of examples are presented to call the attention to the most critical part of the procedure turning the identification problem to a generalized eigenvalue–eigenvector calculation problem with symmetrical matrices. The elaborated method generates consistent parameter estimation. Simulation results demonstrate the effectiveness of the proposed algorithm.     

Linear dynamic filtering with noisy input and output

State estimation problems for linear time-invariant systems with noisy inputs and outputs are considered. An efficient recursive algorithm for the smoothing problem is presented. The equivalence between the optimal filter and an appropriately modified Kalman filter is established. The optimal estimate of the input signal is derived from the optimal state estimate. The result shows that the noisy input/output filtering problem is not fundamentally different from the classical Kalman filtering problem.     

Errors-in-variables methods in system identification

The paper gives a survey of errors-in-variables methods in system identification. Background and motivation are given, and examples illustrate why the identification problem can be difficult. Under general weak assumptions, the systems are not identifiable, but can be parameterized using one degree-of-freedom. Examples where identifiability is achieved under additional assumptions are also provided. A number of approaches for parameter estimation of errors-in-variables models are presented. The underlying assumptions and principles for each approach are highlighted.     

Maximum likelihood identification of noisy input-output models

This work deals with the identification of errors-in-variables models corrupted by white and uncorrelated Gaussian noises. By introducing an auxiliary process, it is possible to obtain a maximum likelihood solution of this identification problem, by means of a two-step iterative algorithm. This approach allows also to estimate, as a byproduct, the noise-free input and output sequences. Moreover, an analytic expression of the finite Cràmer-Rao lower bound is derived. The method does not require any particular assumption on the input process, however, the ratio of the noise variances is assumed as known. The effectiveness of the proposed algorithm has been verified by means of Monte Carlo simulations.     

Errors-in-variables identification of dynamic systems excited by arbitrary non-white input

This work deals with the identification of dynamic systems from noisy input–output observations, where the noise-free input is not parameterized. The basic assumptions made are (1) the dynamic system can be modeled by a (discrete- or continuous-time) rational transfer function model, (2) the temporal input–output disturbances are mutually independent, identically distributed noises, and (3) the input power spectrum is non-white (not necessarily rational) and is modeled nonparametrically. The system identifiability is guaranteed by exploiting the non-white spectrum property of the noise-free input. A frequency domain identification strategy is developed to estimate consistently the plant model parameters and the input–output noise variances. The uncertainty bound of the estimates is calculated and compared to the Cramér–Rao lower bound. The efficiency of the proposed algorithm is illustrated on numerical examples.     

Third-order cumulants based methods for continuous-time errors-in-variables model identification

In this paper, the problem of identifying stochastic linear continuous-time systems from noisy input/output data is addressed. The input of the system is assumed to have a skewed probability density function, whereas the noises contaminating the data are assumed to be symmetrically distributed. The third-order cumulants of the input/output data are then (asymptotically) insensitive to the noises, that can be coloured and/or mutually correlated. Using this noise-cancellation property two computationally simple estimators are proposed. The usefulness of the proposed algorithms is assessed through a numerical simulation.     

Accuracy analysis of a covariance matching approach for identifying errors-in-variables systems

A system identification method for errors-in-variables problems based on covariance matching was recently proposed. In the first step, a small amount of covariances of noisy input–output data are computed, and then a parametric model is fitted to these covariances. In this paper, the method is further analyzed and the asymptotic accuracy of the parameter estimates is derived. An explicit algorithm for computing the asymptotic covariance matrix of the parameter estimates is given, and the identification method is shown to be asymptotically statistically efficient assuming that the given information is the computed covariances. As an important byproduct, an efficient algorithm is presented for computing the covariance matrix of the computed input–output covariances.     

Deterministic regression methods for unbiased estimation of time-varying autoregressive parameters from noisy observations

A great deal of interest has been paid to autoregressive parameter estimation in the noise-free case or when the observation data are disturbed by random noise. Tracking time-varying autoregressive (TVAR) parameters has been also discussed, but few papers deal with this issue when there is an additive zero-mean white Gaussian measurement noise. In this paper, one considers deterministic regression methods (or evolutive methods) where the TVAR parameters are assumed to be weighted combinations of basis functions. However, the additive white measurement noise leads to a weight-estimation bias when standard least squares methods are used. Therefore, we propose two alternative blind off-line methods that allow both the variance of the additive noise and the weights to be estimated. The first one is based on the errors-in-variable issue whereas the second consists in viewing the estimation issue as a generalized eigenvalue problem. A comparative study with other existing methods confirms the effectiveness of the proposed methods.