A new information fusion white noise deconvolution estimator

The white noise deconvolution or input white noise estimation problem has important applications in oil seismic exploration, communication and signal processing. By the modern time series analysis method, based on the autoregressive moving average （ARMA） innovation model, a new information fusion white noise deconvolution estimator is presented for the general multisensor systems with different local dynamic models and correlated noises. It can handle the input white noise fused filtering, prediction and smoothing problems, and it is applicable to systems with colored measurement noises. It is locally optimal, and is globally suboptimal. The accuracy of the fuser is higher than that of each local white noise estimator. In order to compute the optimal weights, the formula computing the local estimation error cross-covariances is given. A Monte Carlo simulation example for the system with Bernoulli-Gaussian input white noise shows the effectiveness and performances.     

Self-tuning weighted measurement fusion white noise deconvolution estimator and its convergence analysis

White noise deconvolution or input white noise estimation has a wide range of applications including oil seismic exploration, communication, signal processing, and state estimation. For the multisensor linear discrete time-invariant stochastic systems with correlated measurement noises, and with unknown ARMA model parameters and noise statistics, the on-line AR model parameter estimator based on the Recursive Instrumental Variable (RIV) algorithm, the on-line MA model parameter estimator based on Gevers–Wouters algorithm and the on-line noise statistic estimator by using the correlation method are presented. Using the Kalman filtering method, a self-tuning weighted measurement fusion white noise deconvolution estimator is presented based on the self-tuning Riccati equation. It is proved that the self-tuning fusion white noise deconvolution estimator converges to the optimal fusion steady-state white noise deconvolution estimator in a realization by using the dynamic error system analysis (DESA) method, so that it has the asymptotic global optimality. The simulation example for a 3-sensor system with the Bernoulli–Gaussian input white noise shows its effectiveness.     

Signal estimation for second-order vector difference equations

This note considers a linear estimation problem for a stochastic process viewed as the output signal of a linear second-order vector difference equation (VDE) driven by a white-noise input. An innovations approach is applied directly to develop the one-stage prediction estimator and associated error covariances. It is shown that the estimator can be expressed as a second-order recursion that preserves the mathematical structure of the given signal model with innovations feedback loops. It is also shown that the innovations can be computed through a first-order recursion in terms of one-stage prediction estimates and the measurements.     

Linear estimation for random delay systems

This paper is concerned with the linear estimation problems for discrete-time systems with random delayed observations. When the random delay is known online, i.e., time-stamped, the random delayed system is reconstructed as an equivalent delay-free one by using measurement reorganization technique, and then an optimal linear filter is presented based on the Kalman filtering technique. However, the optimal filter is time-varying, stochastic, and does not converge to a steady state in general. Then an alternative suboptimal filter with deterministic gains is developed under a new criteria. The estimator performance in terms of their error covariances is provided, and its mean square stability is established. Finally, a numerical example is presented to illustrate the efficiency of proposed estimators.     

Stochastic optimal control of unknown linear networked control system in the presence of random delays and packet losses

In this paper, the stochastic optimal control of linear networked control system (NCS) with uncertain system dynamics and in the presence of network imperfections such as random delays and packet losses is derived. The proposed stochastic optimal control method uses an adaptive estimator (AE) and ideas from Q-learning to solve the infinite horizon optimal regulation of unknown NCS with time-varying system matrices. Next, a stochastic suboptimal control scheme which uses AE and Q-learning is introduced for the regulation of unknown linear time-invariant NCS that is derived using certainty equivalence property. Update laws for online tuning the unknown parameters of the AE to obtain the Q-function are derived. Lyapunov theory is used to show that all signals are asymptotically stable (AS) and that the estimated control signals converge to optimal or suboptimal control inputs. Simulation results are included to show the effectiveness of the proposed schemes. The result is an optimal control scheme that operates forward-in-time manner for unknown linear systems in contrast with standard Riccati equation-based schemes which function backward-in-time.     

Optimal and suboptimal separate-bias Kalman estimators for astochastic bias

Addresses two issues concerning the separate-bias Kalman estimator. The first of these issues deals with the derivation of the optimal estimator for the general case in which the bias vector is stochastic in nature, and the second issue deals with defining a suitable suboptimal realization of the generalized estimator     

On minimal error entropy stochastic approximation

Information-theoretic concepts are developed and employed to obtain conditions for a minimax error entropy stochastic approximation algorithm to estimate the state of a non-linear discrete time system baaed on noisy linear measurements of the state. Two recursive suboptimal error entropy estimation procedures are presented along with an upper bound formula for the resulting error entropy. A simple example is utilized to compare the optimal and suboptimal error entropy estimators and the minimum mean Square error linear estimator.     

Suboptimal state estimation algorithm for non-linear discrete-time distributed-parameter systems

A non-linear discrete-time distributed-parameter system may be described by stochastic partial differential equations. Some state variables are measured at selected points of the system space. For this system a suboptimal state estimation algorithm is proposed. The error covariance matrix is calculated by an approximate approach. This simplification considerably reduces computer calculations in comparison with an optimal algorithm. Finally, the digital simulation of a non-linear DPS demonstrates the effectiveness of the suboptimal estimator.     

Image estimation using doubly stochastic gaussian random field models

The two-dimensional (2-D) doubly stochastic Gaussian (DSG) model was introduced by one of the authors to provide a complete model for spatial filters which adapt to the local structure in an image signal. Here we present the optimal estimator and 2-D fixed-lag smoother for this DSG model extending earlier work of Ackerson and Fu. As the optimal estimator has an exponentially growing state space, we investigate suboptimal estimators using both a tree and a decision-directed method. Experimental results are presented.     

Extension of minimum variance estimation for systems with unknown inputs

In this paper, we address the problem of minimum variance estimation for discrete-time time-varying stochastic systems with unknown inputs. The objective is to construct an optimal filter in the general case where the unknown inputs affect both the stochastic model and the outputs. It extends the results of Darouach and Zasadzinski (Automatica 33 (1997) 717) where the unknown inputs are only present in the model. The main difficulty in treating this problem lies in the fact that the estimation error is correlated with the systems noises, this fact leads generally to suboptimal filters. Necessary and sufficient conditions for the unbiasedness of this filter are established. Then conditions under which the estimation error and the system noises are uncorrelated are presented, and an optimal estimator and a predictor filters are derived. Sufficient conditions for the existence of these filters are given and sufficient conditions for their stability are obtained for the time-invariant case. A numerical example is given in order to illustrate the proposed method.     

Robust filtering under stochastic parametric uncertainties

This paper is concerned with a polynomial approach to robust deconvolution filtering of linear discrete-time systems with random modeling uncertainties. The modeling errors appear in the coefficients of the numerators and denominators of both the input signal and system transfer function models in the form of random variables with zero means and known upper bounds of the covariances. The robust filtering problem is to find an estimator that minimizes the maximum mean square estimation error over the random parameter uncertainties and input and measurement noises. The key to our solution is to quantify the effect of the random parameter uncertainties by introducing two fictitious noises for which a simple way is given to calculate their covariances. The optimal robust estimator is then computed by solving one spectral factorization and one polynomial equation as in the standard optimal estimator design using a polynomial approach. An example of signal detection in mobile communication is given to illustrate the effectiveness of our approach.     

Multisensor optimal information fusion input white noise deconvolution estimators

The unified multisensor optimal information fusion criterion weighted by matrices is rederived in the linear minimum variance sense, where the assumption of normal distribution is avoided. Based on this fusion criterion, the optimal information fusion input white noise deconvolution estimators are presented for discrete time-varying linear stochastic control system with multiple sensors and correlated noises, which can be applied to seismic data processing in oil exploration. A three-layer fusion structure with fault tolerant property and reliability is given. The first fusion layer and the second fusion layer both have netted parallel structures to determine the first-step prediction error cross-covariance for the state and the estimation error cross-covariance for the input white noise between any two sensors at each time step, respectively. The third fusion layer is the fusion center to determine the optimal matrix weights and obtain the optimal fusion input white noise estimators. The simulation results for Bernoulli-Gaussian input white noise deconvolution estimators show the effectiveness.     

Identifiability of the stochastic semi-blind deconvolution problem for a class of time-invariant linear systems

Semi-blind deconvolution is the process of estimating the unknown input of a linear system, starting from output data, when the kernel of the system contains unknown parameters. In this paper, identifiability issues related to such a problem are investigated. In particular, we consider time-invariant linear models whose impulse response is given by a sum of exponentials and assume that smoothness is the sole available a priori information on the unknown signal. We state the semi-blind deconvolution problem in a Bayesian setting where prior knowledge on the smoothness of the unknown function is mathematically formalized by describing the system input as a Brownian motion. This leads to a Tychonov-type estimator containing unknown smoothness and system parameters which we estimate by maximizing their marginal likelihood/posterior. The mathematical structure of this estimator is studied in the ideal situation of output data noiseless with their number tending to infinity. Simulated case studies are used to illustrate the practical implications of the theoretical findings in system modeling. Finally, we show how semi-blind deconvolution can be improved by proposing a new prior for signals that are initially highly nonstationary but then become, as time progresses, more regular.     

An optimal discrete nonlinear logical-dynamical filter-predictor

To quickly identify the mode of operation and estimate the vector of state of a discrete stochastic logical-dynamical plant from the results of their incomplete or inaccurate measurements, a method for synthesizing the optimal structure of estimator of a small order multiple of the order of the observed plant is proposed. Bayesian criteria with various matrix loss functions are considered. To improve the accuracy at each time step, the equation of state of the estimator is divided into two parts (filtering and predicting), and to synthesize the second part, an additional optimality criterion is introduced. Relationships between the optimal structure functions of such a logical-dynamical filter-predictor and the corresponding posterior probability distributions are established, and the relations for determining those posterior probability distributions are found. The methods for constructing the suboptimal structure of this estimator and the possibility of reducing its order by evaluating only the information portion of the large state vector of the plant are discussed.     

Jump linear quadratic Gaussian control in continuous time

The optimal quadratic control of continuous-time linear systems that possess randomly jumping parameters which can be described by finite-state Markov processes is addressed. The systems are also subject to Gaussian input and measurement noise. The optimal solution for the jump linear-quadratic-Gaussian (JLQC) problem is given. This solution is based on a separation theorem. The optimal state estimator is sample-path dependent. If the plant parameters are constant in each value of the underlying jumping process, then the controller portion of the compensator converges to a time-invariant control law. However, the filter portion of the optimal infinite time horizon JLQC compensator is not time invariant. Thus, a suboptimal filter which does converge to a steady-state solution (under certain conditions) is derived, and a time-invariant compensator is obtained     

Bayes and empirical Bayes semi-blind deconvolution using eigenfunctions of a prior covariance

We consider the semi-blind deconvolution problem; i.e., estimating an unknown input function to a linear dynamical system using a finite set of linearly related measurements where the dynamical system is known up to some system parameters. Without further assumptions, this problem is often ill-posed and ill-conditioned. We overcome this difficulty by modeling the unknown input as a realization of a stochastic process with a covariance that is known up to some finite set of covariance parameters. We first present an empirical Bayes method where the unknown parameters are estimated by maximizing the marginal likelihood/posterior and subsequently the input is reconstructed via a Tikhonov estimator (with the parameters set to their point estimates). Next, we introduce a Bayesian method that recovers the posterior probability distribution, and hence the minimum variance estimates, for both the unknown parameters and the unknown input function. Both of these methods use the eigenfunctions of the random process covariance to obtain an efficient representation of the unknown input function and its probability distributions. Simulated case studies are used to test the two methods and compare their relative performance.     

ANASA-a stochastic reinforcement algorithm for real-valued neuralcomputation

This paper introduces ANASA (adaptive neural algorithm of stochastic activation), a new, efficient, reinforcement learning algorithm for training neural units and networks with continuous output. The proposed method employs concepts, found in self-organizing neural networks theory and in reinforcement estimator learning algorithms, to extract and exploit information relative to previous input pattern presentations. In addition, it uses an adaptive learning rate function and a self-adjusting stochastic activation to accelerate the learning process. A form of optimal performance of the ANASA algorithm is proved (under a set of assumptions) via strong convergence theorems and concepts. Experimentally, the new algorithm yields results, which are superior compared to existing associative reinforcement learning methods in terms of accuracy and convergence rates. The rapid convergence rate of ANASA is demonstrated in a simple learning task, when it is used as a single neural unit, and in mathematical function modeling problems, when it is used to train various multilayered neural networks.     

Robust, reduced-order, nonstrictly proper state estimation via theoptimal projection equations with guaranteed cost bounds

A state estimation design problem involving parametric plant uncertainties is considered. An estimation error bound suggested by multiplicative white-noise modeling is utilized for guaranteeing robust estimation over a specified range of parameter uncertainties. Necessary conditions that generalize the optimal projection equations for reduced-order state estimation are used to characterize the estimator that minimizes the error bound. The design equations thus effectively serve as sufficient conditions for synthesizing robust estimators. Additional features include the presence of a static estimation gain in conjunction with the dynamic (Kalman) estimator to obtain a nonstrictly proper estimator     

Frequency-domain criteria for stability of a class of nonlinear stochastic systems

The problem of finding frequency-domain conditions that are sufficient to ensure asymptotic stability with probability one (ASWP 1) of a Lure-type system with white-noise input disturbance is considered. It is shown that, if the noise is linearly related to the state of the system, a relatively simple frequency-domain inequality that guarantees ASWP 1 of the system exists. The stochastic version of the second method of Lyapunov, along with a Meyer-Kalman-Yakubovich(MKY)-type lemma, is used to derive such a condition, assuming first that only sector information of the nonlinearity is available. A modification of this lemma is subsequently used to derive an improved stability condition, assuming that both sector and slope information of the nonlinearity are available. Finally, the case of a differential system with white-noise parameter perturbation is considered and an illustrative example is presented.     

Robust Control of Nonlinear Jump Parameter Systems Governed by Uncertain Chains

We consider an infinite-horizon minimax optimal control problem for stochastic uncertain systems governed by a discrete-state uncertain continuous-time chain. Using existing risk-sensitive control results, a robust suboptimal absolutely stabilizing guaranteed cost controller is constructed. Conditions are presented under which this suboptimal controller is minimax optimal. We then present a numeric algorithm for calculating a robust (sub)optimal controller using a Markov chain approximation technique.