Identification of Hammerstein nonlinear ARMAX systems

Two identification algorithms, an iterative least-squares and a recursive least-squares, are developed for Hammerstein nonlinear systems with memoryless nonlinear blocks and linear dynamical blocks described by ARMAX/CARMA models. The basic idea is to replace unmeasurable noise terms in the information vectors by their estimates, and to compute the noise estimates based on the obtained parameter estimates. Convergence properties of the recursive algorithm in the stochastic framework show that the parameter estimation error consistently converges to zero under the generalized persistent excitation condition. The simulation results validate the algorithms proposed.     

Parameter estimation for block‐oriented nonlinear systems using the key term separation

This article considers the parameter estimation problems of block‐oriented nonlinear systems. By using the key term separation, the system output is represented as a linear combination of unknown parameters. We give a key term separation auxiliary model gradient‐based iterative (KT‐AM‐GI) identification algorithm and propose a key term separation auxiliary model three‐stage gradient‐based iterative (KT‐AM‐3S‐GI) identification algorithm by using the hierarchical identification principle. Meanwhile, the multiinnovation theory is used to derived the key term separation auxiliary model three‐stage multiinnovation gradient‐based iterative (KT‐AM‐3S‐MIGI) algorithm. The analysis shows that compared with the KT‐AM‐GI algorithm, the KT‐AM‐3S‐GI algorithm can improve the parameter estimation accuracy and reduce the computational burden. In addition, the KT‐AM‐3S‐MIGI can give more accurate parameter estimates than the KT‐AM‐3S‐GI algorithm and can track time‐varying parameters based on the dynamical window data. This work provides a reference for improving the identification performance of multiinput nonlinear output‐error systems or multivariable nonlinear systems. The simulation results confirm the effectiveness of the proposed algorithm.     

Correlation analysis based MIMO neuro-fuzzy Hammerstein model with noises

A novel identification algorithm for neuro-fuzzy based MIMO Hammerstein system with noises by using the correlation analysis method is presented in this paper. A special test signal that contains independent separable signals and uniformly random multi-step signal is adopted to identify the MIMO Hammerstein system, resulting in the identification problem of the linear model separated from that of nonlinear part. As a result, it can circumvent the problem of initialization and convergence of the model parameters encountered by the existing iterative algorithms used for identification of MIMO Hammerstein model. Moreover, least square method based parameter identification algorithms of dynamic linear part and static nonlinear part are proposed to avoid the influence of noise. Examples are used to illustrate the effectiveness of the proposed method.     

基于移动数据窗的传递函数多新息随机梯度辨识方法

一些工业过程可以近似用一个传递函数描述,结合统计辨识方法和非线性优化策略提出传递函数参数辨识方法.该方法采用动态数据方案,使用系统观测数据获得系统更多的模态信息.基于动态观测数据,提出传递函数随机梯度参数辨识方法.为进一步提高辨识精度,利用动态窗数据将随机梯度参数辨识方法中的标量新息扩展为新息向量,提出传递函数多新息随机梯度参数估计方法.最后通过仿真例子对所提出的方法进行了性能分析和模型验证.     

Two‐stage auxiliary model gradient‐based iterative algorithm for the input nonlinear controlled autoregressive system with variable‐gain nonlinearity

This article focuses on the parameter estimation problem of the input nonlinear system where an input variable‐gain nonlinear block is followed by a linear controlled autoregressive subsystem. The variable‐gain nonlinearity is described analytical by using an appropriate switching function. According to the gradient search technique and the auxiliary model identification idea, an auxiliary model‐based stochastic gradient algorithm with a forgetting factor is presented. For the sake of improving the parameter estimation accuracy, an auxiliary model gradient‐based iterative algorithm is proposed by utilizing the iterative identification theory. To further optimize the performance of the algorithm, we decompose the identification model of the system into two submodels and derive a two‐stage auxiliary model gradient‐based iterative (2S‐AM‐GI) algorithm by using the hierarchical identification principle. The simulation results confirm the effectiveness of the proposed algorithms and show that the 2S‐AM‐GI algorithm has higher identification efficiency compared with the other two algorithms.     

基于改进的布谷鸟搜索算法对分数阶生物系统的参数估计

近年来,非线性分数阶系统的参数估计问题已经在许多科学和工程领域特别是计算生物学中,引起了广泛的兴趣.本文针对分数阶生物系统的参数估计问题,将系统参数和分数阶导数同时作为独立的未知参数来进行估计,并提出了一种改进的布谷鸟搜索(improved cuckoo search, ICS)算法来求解该问题.在ICS算法中,通过引入一个自适应参数控制机制,同时结合反向学习方法,从而达到提高算法收敛速度和估计值精度的目的.最后,以三种经典的分数阶生物动力系统模型为例进行了数值仿真,其中还考虑了有测量误差和噪声数据的情形.仿真结果表明ICS算法具有良好的适应性、较高的收敛可靠性及精度,为求解非线性分数阶系统参数估计问题提供了一种有效工具.     

Hierarchical Newton and least squares iterative estimation algorithm for dynamic systems by transfer functions based on the impulse responses

This paper develops a parameter estimation algorithm for linear continuous-time systems based on the hierarchical principle and the parameter decomposition strategy. Although the linear continuous-time system is a linear system, its output response is a highly nonlinear function with respect to the system parameters. In order to propose a direct estimation algorithm, a criterion function is constructed between the response output and the observation output by means of the discrete sampled data. Then a scheme by combining the Newton iteration and the least squares iteration is builded to minimise the criterion function and derive the parameter estimation algorithm. In light of the different features between the system parameters and the output function, two sub-algorithms are derived by using the parameter decomposition. In order to remove the associate terms between the two sub-algorithms, a Newton and least squares iterative algorithm is deduced to identify system parameters. Compared with the Newton iterative estimation algorithm without the parameter decomposition, the complexity of the hierarchical Newton and least squares iterative estimation algorithm is reduced because the dimension of the Hessian matrix is lessened after the parameter decomposition. The experimental results show that the proposed algorithm has good performance.     

Hierarchical gradient-based identification of multivariable discrete-time systems

In this paper, we use a hierarchical identification principle to study identification problems for multivariable discrete-time systems. We propose a hierarchical gradient iterative algorithm and a hierarchical stochastic gradient algorithm and prove that the parameter estimation errors given by the algorithms converge to zero for any initial values under persistent excitation. The proposed algorithms can be applied to identification of systems involving non-stationary signals and have significant computational advantage over existing identification algorithms. Finally, we test the proposed algorithms by simulation and show their effectiveness.     

Least squares based iterative algorithms for identifying Box–Jenkins models with finite measurement data

A least squares based iterative identification algorithm is developed for Box–Jenkins models (or systems). The proposed iterative algorithm can produce highly accurate parameter estimation compared with recursive approaches. The basic idea of the proposed iterative method is to adopt the interactive estimation theory: the parameter estimates relying on unknown variables are computed by using the estimates of these unknown variables which are obtained from the preceding parameter estimates. The numerical example indicates that the proposed iterative algorithm has fast convergence rates compared with the gradient based iterative algorithm.     

Moving data window gradient‐based iterative algorithm of combined parameter and state estimation for bilinear systems

The combined iterative parameter and state estimation problem is considered for bilinear state‐space systems with moving average noise in this paper. There are the product terms of state variables and control variables in bilinear systems, which makes it difficult for the parameter and state estimation. By designing a bilinear state estimator based on the Kalman filtering, the states are estimated using the input‐output data. Furthermore, a moving data window (MDW) is introduced, which can update the dynamical data by removing the oldest data and adding the newest measurement data. A state estimator‐based MDW gradient‐based iterative (MDW‐GI) algorithm is proposed to estimate the unknown states and parameters jointly. Moreover, given the extended gradient‐based iterative (EGI) algorithm as a comparison, the MDW‐GI algorithm can reduce the impact of noise to parameter estimation and improve the parameter estimation accuracy. The numerical simulation examples validate the effectiveness of the proposed algorithm.     

Data Filtering Based Multi-innovation Gradient Identification Methods for Feedback Nonlinear Systems

With the development of industry information technology, many researchers pay attention to the estimation problems of feedback nonlinear systems increasingly. In this paper, a filtering based multi-innovation stochastic gradient algorithm is derived for Hammerstein equation-error autoregressive systems by using the hierarchical technique. The parameter estimates accuracy can be improved with the innovation length increasing. These algorithms are easy to implement on-line. The simulation results verify the effectiveness of the proposed algorithm.     

&thetas;-adaptive neural networks: a new approach to parameterestimation

A novel use of neural networks for parameter estimation in nonlinear systems is proposed. The approximating ability of the neural network is used to identify the relation between system variables and parameters of a dynamic system. Two different algorithms, a block estimation method and a recursive estimation method, are proposed. The block estimation method consists of the training of a neural network to approximate the mapping between the system response and the system parameters which in turn is used to identify the parameters of the nonlinear system. In the second method, the neural network is used to determine a recursive algorithm to update the parameter estimate. Both methods are useful for parameter estimation in systems where either the structure of the nonlinearities present are unknown or when the parameters occur nonlinearly. Analytical conditions under which successful estimation can be carried but and several illustrative examples verifying the behavior of the algorithms through simulations are presented.     

基于向量图分析的分布参数系统迭代学习控制

针对一类不确定线性分布参数系统的迭代学习控制问题进行了讨论。基于向量图分析方法,提出了分布参数系统的一种新的迭代学习控制算法,该算法与现有算法不同,具有非线性形式。此外,利用 范数对所提新算法进行了完整的收敛性分析。     

Correlation analysis method based SISO neuro-fuzzy Wiener model

A novel identification algorithm for neuro-fuzzy based single-input-single-output (SISO) Wiener model with colored noises is presented in this paper. The separable signal is adopted to identify the Wiener model, leading to the identification problem of the linear part separated from nonlinear counterpart. Then, the correlation analysis method can be employed for identification of linear part. Moreover, in the presence of random signal, the least square method based parameters estimation algorithm of static nonlinear part are proposed to avoid the impact of colored noise. As a result, proposed method can circumvent the problem of initialization and convergence of the model parameters encountered by the existing iterative algorithms used for identification of Wiener model. Examples are used to verify the effectiveness of the proposed method.     

Recursive parameter estimation methods and convergence analysis for a special class of nonlinear systems

This paper is concerned with the joint estimation of states and parameters of a special class of nonlinear systems, ie, bilinear systems. The key is to investigate new estimation methods for interactive state and parameter estimation of the considered system based on the interactive estimation theory. Because the system states are unknown, a bilinear state observer is established based on the Kalman filtering principle. Then, the unavailable states are updated by the state observer outputs recursively. Once the state estimates are obtained, the bilinear state observer–based hierarchical stochastic gradient algorithm is developed by using the gradient search. For the purpose of improving the convergence rate and the parameter estimation accuracy, a bilinear state observer–based hierarchical multi‐innovation stochastic gradient algorithm is proposed by expanding a scalar innovation to an innovation vector. The convergence analysis indicates that the parameter estimates can converge to their true values. The numerical example illustrates the effectiveness of the proposed algorithms.     

Gradient based and least-squares based iterative identification methods for OE and OEMA systems

Gradient based and least-squares based iterative identification algorithms are developed for output error (OE) and output error moving average (OEMA) systems. Compared with recursive approaches, the proposed iterative algorithms use all the measured input–output data at each iterative computation (at each iteration), and thus can produce highly accurate parameter estimation. The basic idea of the iterative methods is to adopt the interactive estimation theory: the parameter estimates relying on unknown variables are computed by using the estimates of these unknown variables which are obtained from the preceding parameter estimates. The simulation results confirm theoretical findings.     

Iterative identification algorithms for input nonlinear output error autoregressive systems

This paper focuses on the parameter estimation problems of input nonlinear output error autoregressive systems. Based on the key variables separation technique and the auxiliary model identification idea, the output of the system is expressed as a linear combination of all the system parameters, the unknown inner variables in the information vector are replaced with the outputs of the auxiliary model and a gradient based and a least squares based iterative identification algorithms are derived. Simulation example is provided to illustrate the effectiveness of the proposed algorithms.     

二值量测误差FIR系统参数迭代辨识

本文考虑了量测数据为二值输出且含量测误差的一类有限脉冲响应(FIR)系统的参数辨识问题, 其中, 量测误差使得二值型量测值有一定概率得到相反的取值. 首先, 对所考虑的 FIR 系统, 给出了参数的极大似然估计(MLE), 证明了在噪声满足一定正则条件下MLE的强收敛性和渐近正态性. 此外, 通过分析似然函数的性质, 给出了一种基于期望最大化(EM)方法的MLE迭代求解算法. 为适应更一般的量测误差情形, 给出了带投影的迭代求解算法, 并从理论上证明了迭代估计序列的有界性. 进一步, 在给定数量的观测下, 得到了似然函数具有唯一最大值点的必要和充分条件, 并在持续激励输入条件下, 证明了迭代估计误差以指数速度收敛到零. 最后, 利用数值模拟结果验证了所提出算法的有效性.     

未知时变时滞非线性参数化系统自适应迭代学习控制

针对含有未知时变参数和时变时滞的非线性参数化系统,提出了一种新的自适应迭代学习控制方法.该方法将参数分离技术与信号置换思想相结合,可以处理含有时变参数和时滞相关不确定性的非线性系统.设计了一种自适应控制策略,使跟踪误差的平方在一个有限区间上的积分渐近收敛于零.通过构造Lyapunov-Krasovskii型复合能量函数,给出了闭环系统收敛的一个充分条件.给出两个仿真例子验证了控制方法的有效性.     

一类非线性系统故障诊断观测器设计

大多故障诊断算法集中在线性系统方面, 在非线性方面只考虑故障对状态起线性影响的那些系统. 本文根据系统的非线性本质特性, 提出了基于模型的一类非线性系统故障诊断观测器设计方法. 应用系统的(B;K; á)实现精确分解后的系统模型, 对它们的状态故障起非线性的影响. 采用干扰解耦技术,获得的残差对未知扰动有很好的鲁棒性. 在Lyapunov意义下, 验证了算法的稳定性. 仿真验证表明, 所提算法具有快速收敛性, 对一类非线性系统诊断效果较好.