Recursive Identification Methods for Multivariate Output-error Moving Average Systems Using the Auxiliary Model

This paper studies the parameter identification problems of multivariate output-error moving average systems. An auxiliary model based extended stochastic gradient algorithm and based recursive extended least squares algorithm are proposed for estimating the parameters of the multivariate output-error moving average systems. By using the multi-innovation identification theory, an auxiliary model based multi-innovation extended stochastic gradient algorithm is derived for improving the parameter estimation accuracy. Finally, the simulation results indicate that the proposed algorithms can work well.     

多新息随机梯度辨识方法

多新息随机梯度辨识方法是系统辨识和参数估计的一种基本方法.该方法由于采用了间断迭代,因此可以克服坏数据对参数估计的影响,且具有较强的鲁棒性,又可以跟踪时变参数.作者从理论上给出了多新息随机梯度辨识方法的推导过程,同时列出多新息随机梯度辨识方法的各种变形.数字仿真实验表明多新息随机梯度辨识方法具有良好的性能.     

Performance analysis of multi-innovation gradient type identification methods

It is well-known that the stochastic gradient (SG) identification algorithm has poor convergence rate. In order to improve the convergence rate, we extend the SG algorithm from the viewpoint of innovation modification and present multi-innovation gradient type identification algorithms, including a multi-innovation stochastic gradient (MISG) algorithm and a multi-innovation forgetting gradient (MIFG) algorithm. Because the multi-innovation gradient type algorithms use not only the current data but also the past data at each iteration, parameter estimation accuracy can be improved. Finally, the performance analysis and simulation results show that the proposed MISG and MIFG algorithms have faster convergence rates and better tracking performance than their corresponding SG algorithms.     

基于数据滤波的随机梯度辨识方法

针对有色噪声干扰下的随机系统,利用数据滤波技术,对输入输出数据进行滤波,将具有滑动平均噪声的原始系统转换为白噪声干扰下的系统,提出有限脉冲响应滑动平均系统的滤波增广随机梯度算法,并对该算法进行收敛性分析.此外,为了提高参数估计的精度和加快算法的收敛速度,使用多新息辨识理论提出滤波多新息增广随机梯度算法,并分析其收敛性.与增广随机梯度算法相比,所提出的滤波增广随机梯度算法和滤波多新息增广随机梯度算法可以得到更高精度的参数估计.最后,通过仿真实例表明了所提出算法的有效性.     

Several multi-innovation identification methods

This paper considers connections between the cost functions of some parameter identification methods for system modelling, including the well known projection algorithm, stochastic gradient (SG) algorithm and recursive least squares (RLS) algorithm, and presents a modified SG algorithm by introducing the convergence index and a multi-innovation projection algorithm, a multi-innovation SG algorithm and a multi-innovation RLS algorithm by introducing the innovation length, aiming at improving the convergence rate of the SG and RLS algorithms. Furthermore, this paper derives an interval-varying multi-innovation SG and an interval-varying multi-innovation RLS algorithm in order to deal with missing data cases.     

基于随机牛顿算法的离散系统自适应参数估计

针对一类离散系统,提出一种基于随机牛顿算法的自适应参数估计新框架,相较于已有的参数估计算法,所提出方法仅要求系统满足有限激励条件,而非传统的持续激励条件.所提出算法的核心思想在于通过对原始代价函数的修正,在使用当前时刻误差信息的基础上融入历史误差信息,进而通过对历史信息和历史激励的复用使得持续激励条件转化为有限激励条件;然后,为了解决传统算法收敛速度慢的问题并避免潜在的病态问题,采用随机牛顿算法推导出参数自适应律,并引入含有历史信息的海森矩阵作为时变学习增益,保证参数估计误差指数收敛;最后,基于李雅普诺夫稳定性理论给出不同激励条件下所提出算法的收敛性结论和证明,并通过对比仿真验证所提出算法的有效性和优越性.     

Decomposition-based recursive least squares identification methods for multivariate pseudo-linear systems using the multi-innovation

This paper studies the parameter estimation algorithms of multivariate pseudo-linear autoregressive systems. A decomposition-based recursive generalised least squares algorithm is deduced for estimating the system parameters by decomposing the multivariate pseudo-linear autoregressive system into two subsystems. In order to further improve the parameter accuracy, a decomposition based multi-innovation recursive generalised least squares algorithm is developed by means of the multi-innovation theory. The simulation results confirm that these two algorithms are effective.     

MISO系统辅助模型多新息增广随机梯度算法

对于有色噪声干扰的输出误差多输入单输出（MISO）系统,常规的递推最小二乘辨识方法给出的参数估计是有偏的。为了提高随机梯度辨识方法的收敛精度和速度,用辅助模型的输出代替辨识模型信息向量中的未知不可测变量,推导出其辅助模型增广随机梯度辨识算法;再引入新息长度扩展标量新息为新息向量,提出了基于辅助模型的MISO系统多新息增广随机梯度辨识算法。所得算法在每一次的迭代中不仅使用了当前数据和新息,而且使用了过去数据和新息,提高了参数估计精度和收敛速度。仿真例子验证了算法的有效性。     

Auxiliary model-based RELS and MI-ELS algorithm for Hammerstein OEMA systems

This paper considers the identification problem for Hammerstein output error moving average (OEMA) systems. An auxiliary model-based recursive extended least-squares (RELS) algorithm and an auxiliary model-based multi-innovation extended least-squares (MI-ELS) algorithm are presented using the multi-innovation identification theory. The basic idea is to express the system output as a linear combination of the parameters by using the key-term separation principle and auxiliary model method. The proposed algorithms can give highly accurate parameter estimates. The simulation results show the effectiveness of the proposed algorithms.     

Auxiliary model-based interval-varying multi-innovation least squares identification for multivariable OE-like systems with scarce measurements

The identification problem of multivariable OE-like systems with scarce measurements is considered in this paper. By replacing the unknown inner variables in the information matrix with the outputs of the auxiliary model and by expanding the scalar innovation to an innovation vector, an auxiliary model-based multi-innovation least squares (AM-MILS) algorithm is proposed. In order to deal with the scarce measurement pattern, the algorithm takes the form of interval-varying recursive computation to skip the unavailable measurements including outliers. The introduction of the multi-innovation concept improves the parameter estimation accuracy and makes the identification algorithm more efficient. The convergence analysis shows that for the proposed algorithm, the parameter estimates can converge to their true values in the scarce output measurement pattern. Illustrative examples are given to demonstrate the effectiveness and accuracy of the proposed method.     

Performance Analysis of The Auxiliary‐Model‐Based Multi‐Innovation Stochastic Newton Recursive Algorithm for Dual‐Rate Systems

The stochastic Newton recursive algorithm is studied for dual‐rate system identification. Owing to a lack of intersample measurements, the single‐rate model cannot be identified directly. The auxiliary model technique is adopted to provide the intersample estimations to guarantee the recursion process continues. Intersample estimations have a great influence on the convergence of parameter estimations, and one‐step innovation may lead to a large fluctuation or even divergence during the recursion. In the meantime, the sample covariance matrix may appear singular. The recursive process would cease for these reasons. In order to guarantee the recursion process and to also improve estimation accuracy, multi‐innovation is utilized for correcting the parameter estimations. Combining the auxiliary model and multi‐innovation theory, the auxiliary‐model‐based multi‐innovation stochastic Newton recursive algorithm is proposed for time‐invariant dual‐rate systems. The consistency of this algorithm is analyzed in detail. The final simulations confirm the effectiveness of the proposed algorithm.     

人口系统迁移过程的参数辨识及其仿真

本文以系统辨识为工具，提出了迁移过程定量研究的一种方法，即运用随机牛顿法于时变系统中以辨识模型迁移表参量，同时结合卡尔曼滤波技术辨识迁移过程中另一参数－总和迁移率，将这两者融为一体，形成了辨识迁移模型参量的递推算法。本文又借助微分方程的稳定性理论讨论了净迁移情形下的辨识算法的收敛性，给出算法收敛的一个充分条件。     

基于系统辨识算法的风力机桨距系统故障诊断

针对风力机桨距系统故障,提出一种基于观测器的多新息随机梯度辨识算法的故障诊断方法．多新息随机梯度辨识算法通过扩展新息长度能够改进随机梯度辨识算法的估计精度,根据系统的规范状态空间模型,结合状态观测器可以实现系统状态和参数的交互估计．将桨距系统模型转换为可辨识的状态空间模型,依据桨距系统故障会引起系统参数变化的特点,采用所提出的算法对系统状态和参数进行估计,将桨距系统故障诊断问题转化为系统状态和参数估计问题．仿真结果表明,所提出的方法能够有效诊断桨距系统故障．     

Joint state and multi-innovation parameter estimation for time-delay linear systems and its convergence based on the Kalman filtering

This paper studies the joint state and parameter estimation problem for a linear state space system with time-delay. A multi-innovation gradient algorithm is developed based on the Kalman filtering principle. To improve the convergence rate, a filtering based multi-innovation gradient algorithm is proposed by using the filtering technique. The analysis indicates that the parameter estimates given by the proposed algorithms converge to their true values under the persistent excitation conditions. A simulation example is given to confirm that the proposed algorithms are effective.     

Correlation Analysis-based Stochastic Gradient and Least Squares Identification Methods for Errors-in-variables Systems Using the Multiinnovation

This paper deals with the identification problem of discrete-time linear time-invariant errors-in-variables systems for the case of the colored output noise. Based on the correlation analysis, the multi-innovation theory is introduced to the errors-in-variables systems where both input and output data are noisy. A correlation analysis-based multi-innovation stochastic gradient algorithm and a correlation analysis-based multi-innovation least squares algorithm are proposed by means of the multi-innovation theory in order to improve the parameter accuracy. The simulation results confirm that these two algorithms are effective.

     

Parameter estimation for nonlinear systems by using the data filtering and the multi-innovation identification theory

For Hammerstein output-error autoregressive systems, a decomposition based multi-innovation stochastic gradient (D-MISG) identification algorithm and a data filtering based multi-innovation stochastic gradient (F-MISG) identification algorithm are derived by means of the key-term separation principle and the multi-innovation identification theory. The D-MISG algorithm uses the decomposition technique to transform a Hammerstein system into two subsystems and requires less computational cost, and the F-MISG algorithm uses a linear filter to filter the input-output data and has a higher estimation accuracy for larger innovation lengths. The simulation results show that the proposed two algorithm can give satisfactory parameter estimates.     

基于辅助模型的量化控制系统辨识方法

针对具有通信约束的量化控制系统模型, 在采用随机重复性试验测量信息的技术上, 提出了基于辅助模型的量化系统参数辨识方法. 首先分析了在随机重复性试验方法下量化系统的模型特征并给出了分两步辨识的策略.分析表明, 在上述模型里系统具有时变的估计误差, 推导了进行参数辨识所满足的持续激励条件, 并给出了基于辅助模型的多新息量化辨识递推算法. 接着研究了所给出辨识算法的收敛性分析, 得到了系统参数估计误差上界的计算式,最后将方法推广到一类Hammerstein非线性系统量化辨识问题上. 数字仿真验证了该算法及结论     

基于移动数据窗的传递函数多新息随机梯度辨识方法

一些工业过程可以近似用一个传递函数描述,结合统计辨识方法和非线性优化策略提出传递函数参数辨识方法.该方法采用动态数据方案,使用系统观测数据获得系统更多的模态信息.基于动态观测数据,提出传递函数随机梯度参数辨识方法.为进一步提高辨识精度,利用动态窗数据将随机梯度参数辨识方法中的标量新息扩展为新息向量,提出传递函数多新息随机梯度参数估计方法.最后通过仿真例子对所提出的方法进行了性能分析和模型验证.     

基于滤波的分段线性Hammerstein系统的递推辨识方法

Hammerstein模型具有结构简单、能很好地反映典型非线性特性等优点, 一直是控制领域的重要研究内容之一. 本文主要研究输出误差自回归Hammerstein系统的辨识问题, 系统的输入非线性部分采用分段线性函数拟合,并引入切换函数和位置函数将其表示为线性参数表达式. 为克服有色噪声的干扰, 本文通过关键项分离和数据滤波技术, 建立系统的滤波辨识模型. 在此基础上, 文中提出了基于滤波的遗忘梯度算法, 基于滤波的递推广义最小二乘算法和基于滤波的多新息遗忘梯度算法估计未知参数. 本文通过仿真实例验证了所提算法的有效性, 证明了多新息理论的应用可以有效地提高递推算法的辨识性能.