多变量输出误差系统的辅助模型随机梯度辨识算法

考虑了多变量输出误差系统的辨识问题. 使用系统可得到的输入输出数据构造一个辅助模型, 用辅助模型的输出代替信息向量中的未知变量, 提出了一个基于辅助模型的随机梯度辨识算法. 使用鞅收敛定理的收敛性分析表明: 提出的算法给出的参数估计收敛于它们的真值. 给出了带遗忘因子的辅助模型随机梯度算法来改进参数估计精度, 仿真结果证实了提出的结论.     

Two‐stage auxiliary model gradient‐based iterative algorithm for the input nonlinear controlled autoregressive system with variable‐gain nonlinearity

This article focuses on the parameter estimation problem of the input nonlinear system where an input variable‐gain nonlinear block is followed by a linear controlled autoregressive subsystem. The variable‐gain nonlinearity is described analytical by using an appropriate switching function. According to the gradient search technique and the auxiliary model identification idea, an auxiliary model‐based stochastic gradient algorithm with a forgetting factor is presented. For the sake of improving the parameter estimation accuracy, an auxiliary model gradient‐based iterative algorithm is proposed by utilizing the iterative identification theory. To further optimize the performance of the algorithm, we decompose the identification model of the system into two submodels and derive a two‐stage auxiliary model gradient‐based iterative (2S‐AM‐GI) algorithm by using the hierarchical identification principle. The simulation results confirm the effectiveness of the proposed algorithms and show that the 2S‐AM‐GI algorithm has higher identification efficiency compared with the other two algorithms.     

Recursive Identification Methods for Multivariate Output-error Moving Average Systems Using the Auxiliary Model

This paper studies the parameter identification problems of multivariate output-error moving average systems. An auxiliary model based extended stochastic gradient algorithm and based recursive extended least squares algorithm are proposed for estimating the parameters of the multivariate output-error moving average systems. By using the multi-innovation identification theory, an auxiliary model based multi-innovation extended stochastic gradient algorithm is derived for improving the parameter estimation accuracy. Finally, the simulation results indicate that the proposed algorithms can work well.     

非均匀采样数据系统的一种辨识方法

阐述了非均匀采样方案,推导了非均匀多率采样系统的状态空间模型,进一步获得了对应的传递函数模型.为解决辨识模型信息向量中存在未知变量的问题,使用辅助模型技术,用辅助模型的输出代替系统的未知变量,进而提出了非均匀采样数据系统的辅助模型随机梯度辨识算法.为了提高算法收敛速度和改善参数估计精度,在算法中引入遗忘因子,给出了相应的辅助模型带遗忘因子随机梯度算法.仿真结果表明,引入遗忘因子后,算法的收敛速度加快,参数估计精度提高.     

Parameter estimation for block‐oriented nonlinear systems using the key term separation

This article considers the parameter estimation problems of block‐oriented nonlinear systems. By using the key term separation, the system output is represented as a linear combination of unknown parameters. We give a key term separation auxiliary model gradient‐based iterative (KT‐AM‐GI) identification algorithm and propose a key term separation auxiliary model three‐stage gradient‐based iterative (KT‐AM‐3S‐GI) identification algorithm by using the hierarchical identification principle. Meanwhile, the multiinnovation theory is used to derived the key term separation auxiliary model three‐stage multiinnovation gradient‐based iterative (KT‐AM‐3S‐MIGI) algorithm. The analysis shows that compared with the KT‐AM‐GI algorithm, the KT‐AM‐3S‐GI algorithm can improve the parameter estimation accuracy and reduce the computational burden. In addition, the KT‐AM‐3S‐MIGI can give more accurate parameter estimates than the KT‐AM‐3S‐GI algorithm and can track time‐varying parameters based on the dynamical window data. This work provides a reference for improving the identification performance of multiinput nonlinear output‐error systems or multivariable nonlinear systems. The simulation results confirm the effectiveness of the proposed algorithm.     

双输入多率系统辅助模型增广随机梯度算法

针对有色噪声干扰的双输入多率系统,为解决辨识模型信息向量中存在未知变量和不可测噪声项的问题,结合辅助模型思想和递推增广随机梯度算法的优点,用辅助模型的输出代替系统的未知变量,用估计残差代替信息向量中的不可测噪声项,进而提出了双输入多率系统的辅助模型增广随机梯度算法。为了提高辨识算法的收敛速度和改善参数估计精度,在算法中引入遗忘因子,得到相应的辅助模型带遗忘因子增广随机梯度算法。仿真实例说明,引入遗忘因子,能加快算法的收敛性,提高参数估计精度。     

Two-stage multi-innovation stochastic gradient algorithm for multivariate output-error ARMA systems based on the auxiliary model

ABSTRACT

This paper investigates the parameter estimation problem for multivariate output-error systems perturbed by autoregressive moving average noises. Since the identification model has two different kinds of parameters, a vector and a matrix, the gradient algorithm cannot be used directly. Therefore, we decompose the original system model into two sub-models and proceed the identification problem by the collaboration between the two sub-models. By employing the gradient search and determining the optimal step-sizes, we present an auxiliary model based two-stage projection algorithm. However, in order to alleviate the sensitivity to the noise, we reselect the step-sizes and derive the auxiliary model based two-stage stochastic gradient (AM-2S-SG) algorithm. Based on the AM-2S-SG algorithm, an auxiliary model based two-stage multi-innovation stochastic gradient algorithm is proposed to generate more accurate estimates. Finally, numerical simulations are provided to demonstrate the effectiveness of the proposed algorithms.     

MISO系统辅助模型多新息增广随机梯度算法

对于有色噪声干扰的输出误差多输入单输出（MISO）系统,常规的递推最小二乘辨识方法给出的参数估计是有偏的。为了提高随机梯度辨识方法的收敛精度和速度,用辅助模型的输出代替辨识模型信息向量中的未知不可测变量,推导出其辅助模型增广随机梯度辨识算法;再引入新息长度扩展标量新息为新息向量,提出了基于辅助模型的MISO系统多新息增广随机梯度辨识算法。所得算法在每一次的迭代中不仅使用了当前数据和新息,而且使用了过去数据和新息,提高了参数估计精度和收敛速度。仿真例子验证了算法的有效性。     

基于辅助模型的多新息广义增广随机梯度算法

将辅助模型辨识思想与多新息辨识理论相结合,利用系统可测信忠建立一个辅助模型.分别用辅助模型输出和噪声估计值代替辨识模型信忠向量中未知真实输出变量和不可测噪声项,并引入新忠长度扩展标量新息为新息向量,提出了Box-lenkins模型的辅助模型多新忠广义增广随机梯度辨识方法.所提出方法重复使用系统数据,能够改善参数估计精度,加快算法的收敛速度.     

Performance analysis of the auxiliary models based multi-innovation stochastic gradient estimation algorithm for output error systems

This paper combines the multi-innovation identification theory and the auxiliary model identification idea and presents an auxiliary model based multi-innovation stochastic gradient algorithm by expanding the scalar innovation to an innovation vector and introducing the innovation length. Convergence analysis in the stochastic framework indicates that the parameter estimates given by the proposed algorithm can fast converge to their true values. Finally, we illustrate and test the proposed algorithm with an example.     

Auxiliary model multiinnovation stochastic gradient parameter estimation methods for nonlinear sandwich systems

This article studies the identification problem of the nonlinear sandwich systems. For the sandwich system, because there are inner variables which cannot be measured in the information vector of the identification models, it is difficult to identify the nonlinear sandwich systems. In order to overcome the difficulty, an auxiliary model is built to predict the estimates of inner variables by means of the output of the auxiliary model. For the purpose of employing the real‐time observed data, a cost function with dynamical data is constructed to capture on‐line information of the nonlinear sandwich system. On this basis, an auxiliary model stochastic gradient identification approach is proposed based on the gradient optimization. Moreover, an auxiliary model multiinnovation stochastic gradient estimation method is developed, which tends to enhance estimation accuracy by introducing more observed data dynamically. The numerical simulation is provided and the simulation results show that the proposed auxiliary model identification method is effective for the nonlinear sandwich systems.     

Hierarchical gradient based iterative parameter estimation algorithm for multivariable output error moving average systems

According to the hierarchical identification principle, a hierarchical gradient based iterative estimation algorithm is derived for multivariable output error moving average systems (i.e., multivariable OEMA-like models) which is different from multivariable CARMA-like models. As there exist unmeasurable noise-free outputs and unknown noise terms in the information vector/matrix of the corresponding identification model, this paper is, by means of the auxiliary model identification idea, to replace the unmeasurable variables in the information vector/matrix with the estimated residuals and the outputs of the auxiliary model. A numerical example is provided.     

输出信号量化的双率采样系统参数辨识方法

针对双率采样和信号量化(signal quantization)[BFQB]的控制系统,采用随机重复性试验测量信息,提出基于辅助模型的双率采样量化控制系统辨识方法.分析了在随机重复试验和放松估计误差方差条件下,双率采样量化系统的模型特征并给出了分两步辨识的策略,推导了进行参数辨识所满足的持续激励条件,并给出了基于辅助模型的双率采样量化控制系统量化辨识递推算法;接着分析了所给出量化辨识递推算法的收敛性,得到了双率采样量化系统参数估计误差上界的计算式,最后数字仿真验证了该算法及结论的有效性.     

基于辅助模型和数据滤波的伪线性回归系统参数估计方法

针对伪线性输出误差回归系统的辨识模型新息信息向量存在不可测变量的问题,首先通过构造一个辅助模型,用辅助模型的输出代替未知中间变量,推导得到的基于辅助模型的递推最小二乘参数估计算法计算量较大,但算法的辨识效果不佳。进一步采用估计的噪声模型对系统观测数据进行滤波,使用滤波后的数据进行参数估计,从而推导提出了基于数据滤波的递推最小二乘参数估计算法。仿真结果表明,所提算法能够有效估计伪线性回归线性输出误差系统的参数。     

基于辅助模型的量化控制系统辨识方法

针对具有通信约束的量化控制系统模型, 在采用随机重复性试验测量信息的技术上, 提出了基于辅助模型的量化系统参数辨识方法. 首先分析了在随机重复性试验方法下量化系统的模型特征并给出了分两步辨识的策略.分析表明, 在上述模型里系统具有时变的估计误差, 推导了进行参数辨识所满足的持续激励条件, 并给出了基于辅助模型的多新息量化辨识递推算法. 接着研究了所给出辨识算法的收敛性分析, 得到了系统参数估计误差上界的计算式,最后将方法推广到一类Hammerstein非线性系统量化辨识问题上. 数字仿真验证了该算法及结论     

基于辅助模型正交匹配追踪的多输入系统迭代辨识算法

针对含有未知时滞的多输入输出误差系统的时滞与参数辨识问题,提出一种基于辅助模型的正交匹配追踪迭代算法.首先,由于各输入通道的时滞未知,通过设定输入回归长度,对系统模型进行过参数化,得到一个高维的辨识模型,且辨识模型中参数向量为稀疏向量;然后,基于辅助模型思想和正交匹配追踪算法,在每次迭代过程中,对参数向量和辅助模型的输出进行交互估计,即利用正交匹配追踪算法获得参数向量的估计,再利用参数估计值计算辅助模型的输出,并用辅助模型的输出值代替信息向量中的不可测信息项以更新参数估计;最后,根据参数向量的稀疏特征,获得系统的时滞估计.所提出算法可以利用少量的采样数据信息同时获得系统参数和时滞的估计值.仿真结果表明了所提出算法的有效性.     

Three‐stage multi‐innovation parameter estimation for an exponential autoregressive time‐series model with moving average noise by using the data filtering technique

This paper studies the data filtering‐based identification algorithms for an exponential autoregressive time‐series model with moving average noise. By means of the data filtering technique and the hierarchical identification principle, the identification model is transformed into three sub‐identification (Sub‐ID) models, and a filtering‐based three‐stage extended stochastic gradient algorithm is derived for identifying these Sub‐ID models. In order to improve the parameter estimation accuracy, a filtering‐based three‐stage multi‐innovation extended stochastic gradient (F‐3S‐MIESG) algorithm is developed by using the multi‐innovation identification theory. The simulation results indicate that the proposed F‐3S‐MIESG algorithm can work well.     

Iterative identification algorithms for input nonlinear output error autoregressive systems

This paper focuses on the parameter estimation problems of input nonlinear output error autoregressive systems. Based on the key variables separation technique and the auxiliary model identification idea, the output of the system is expressed as a linear combination of all the system parameters, the unknown inner variables in the information vector are replaced with the outputs of the auxiliary model and a gradient based and a least squares based iterative identification algorithms are derived. Simulation example is provided to illustrate the effectiveness of the proposed algorithms.     

损失数据线性参数系统的递推最小二乘辨识方法

针对损失数据线性参数系统的参数辨识问题, 借助辅助模型辨识思想推导出其变递推间隔辅助模型递 推最小二乘算法.为了提高该算法的计算效率, 利用分解技术得到变递推间隔分解递推最小二乘算法 估计系统参数.此外, 在变递推间隔分解递推最小二乘算法中引入遗忘因子, 从而提高参数估计精度和收敛速度.仿真结果表明, 所提出的算法能有效估计系统参数.     

Auxiliary model-based least-squares identification methods for Hammerstein output-error systems

The difficulty in identification of a Hammerstein (a linear dynamical block following a memoryless nonlinear block) nonlinear output-error model is that the information vector in the identification model contains unknown variables—the noise-free (true) outputs of the system. In this paper, an auxiliary model-based least-squares identification algorithm is developed. The basic idea is to replace the unknown variables by the output of an auxiliary model. Convergence analysis of the algorithm indicates that the parameter estimation error consistently converges to zero under a generalized persistent excitation condition. The simulation results show the effectiveness of the proposed algorithms.