Decomposition-based recursive least squares identification methods for multivariate pseudo-linear systems using the multi-innovation

This paper studies the parameter estimation algorithms of multivariate pseudo-linear autoregressive systems. A decomposition-based recursive generalised least squares algorithm is deduced for estimating the system parameters by decomposing the multivariate pseudo-linear autoregressive system into two subsystems. In order to further improve the parameter accuracy, a decomposition based multi-innovation recursive generalised least squares algorithm is developed by means of the multi-innovation theory. The simulation results confirm that these two algorithms are effective.     

Maximum likelihood-based recursive least-squares estimation for multivariable systems using the data filtering technique

For multivariable equation-error systems with an autoregressive moving average noise, this paper applies the decomposition technique to transform a multivariable model into several identification sub-models based on the number of the system outputs, and derives a data filtering and maximum likelihood-based recursive least-squares algorithm to reduce the computation complexity and improve the parameter estimation accuracy. A multivariable recursive generalised extended least-squares method and a filtering-based recursive extended least-squares method are presented to show the effectiveness of the proposed algorithm. The simulation results indicate that the proposed method is effective and can produce more accurate parameter estimates than the compared methods.     

Maximum likelihood parameter estimation algorithm for controlled autoregressive autoregressive models

A maximum likelihood parameter estimation algorithm is derived for controlled autoregressive autoregressive (CARAR) models based on the maximum likelihood principle. In this derivation, we use an estimated noise transfer function to filter the input–output data. The simulation results show that the proposed estimation algorithm can effectively estimate the parameters of such class of CARAR systems and give more accurate parameter estimates than the recursive generalized least-squares algorithm.     

Data filtering based least squares iterative algorithm for parameter identification of output error autoregressive systems

This letter derives a data filtering based least squares iterative identification algorithm for output error autoregressive systems. The basic idea is to use the data filtering technique to transform the original identification model to an equation error model and to estimate the parameters of this model. The proposed algorithm is more efficient and can produce more accurate parameter estimation than the existing least squares iterative algorithm.     

Recursive Identification Methods for Multivariate Output-error Moving Average Systems Using the Auxiliary Model

This paper studies the parameter identification problems of multivariate output-error moving average systems. An auxiliary model based extended stochastic gradient algorithm and based recursive extended least squares algorithm are proposed for estimating the parameters of the multivariate output-error moving average systems. By using the multi-innovation identification theory, an auxiliary model based multi-innovation extended stochastic gradient algorithm is derived for improving the parameter estimation accuracy. Finally, the simulation results indicate that the proposed algorithms can work well.     

Recursive least squares parameter identification algorithms for systems with colored noise using the filtering technique and the auxilary model

This paper focuses on the parameter estimation problems of output error autoregressive systems and output error autoregressive moving average systems (i.e., the Box–Jenkins systems). Two recursive least squares parameter estimation algorithms are proposed by using the data filtering technique and the auxiliary model identification idea. The key is to use a linear filter to filter the input–output data. The proposed algorithms can identify the parameters of the system models and the noise models interactively and can generate more accurate parameter estimates than the auxiliary model based recursive least squares algorithms. Two examples are given to test the proposed algorithms.     

差分模型参数递推估计的Householder变换法

本文提出了利用Householder变换进行差分模型参数递推估计的新方法.并由该方法导 出了新的递推最小二乘法、递推增广矩阵法、递推广义最小二乘法、递推极大似然法. 文中分单变量、多变量两种情况重点讨论了新递推最小二乘法及其与传统递推最小二乘 法的比较,并给出了计算实例.     

Data filtering based least squares algorithms for multivariable CARAR-like systems

This paper focuses on the identification problem of multivariable controlled autoregressive autoregressive (CARAR-like) systems. The corresponding identification model contains a parameter vector and a parameter matrix, and thus the conventional least squares methods cannot be applied to directly estimate the parameters of the systems. By using the hierarchical identification principle, this paper presents a hierarchical generalized least squares algorithm and a filtering based hierarchical least squares algorithm for the multivariable CARAR-like systems. The simulation results show that the two hierarchical least squares algorithms are effective.     

Input–output data filtering based recursive least squares identification for CARARMA systems

This paper uses an estimated noise transfer function to filter the input–output data and presents filtering based recursive least squares algorithms (F-RLS) for controlled autoregressive autoregressive moving average (CARARMA) systems. Through the data filtering, we obtain two identification models, one including the parameters of the system model, and the other including the parameters of the noise model. Thus, the recursive least squares method can be used to estimate the parameters of these two identification models, respectively, by replacing the unmeasurable variables in the information vectors with their estimates. The proposed F-RLS algorithm has a high computational efficiency because the dimensions of its covariance matrices become small and can generate more accurate parameter estimation compared with other existing algorithms.     

Identification and frequency domain analysis of non-stationary and nonlinear systems using time-varying NARMAX models

This paper introduces a new approach for nonlinear and non-stationary (time-varying) system identification based on time-varying nonlinear autoregressive moving average with exogenous variable (TV-NARMAX) models. The challenging model structure selection and parameter tracking problems are solved by combining a multiwavelet basis function expansion of the time-varying parameters with an orthogonal least squares algorithm. Numerical examples demonstrate that the proposed approach can track rapid time-varying effects in nonlinear systems more accurately than the standard recursive algorithms. Based on the identified time domain model, a new frequency domain analysis approach is introduced based on a time-varying generalised frequency response function (TV-GFRF) concept, which enables the analysis of nonlinear, non-stationary systems in the frequency domain. Features in the TV-GFRFs which depend on the TV-NARMAX model structure and time-varying parameters are investigated. It is shown that the high-dimensional frequency features can be visualised in a low-dimensional time–frequency space.     

Iterative identification algorithms for input nonlinear output error autoregressive systems

This paper focuses on the parameter estimation problems of input nonlinear output error autoregressive systems. Based on the key variables separation technique and the auxiliary model identification idea, the output of the system is expressed as a linear combination of all the system parameters, the unknown inner variables in the information vector are replaced with the outputs of the auxiliary model and a gradient based and a least squares based iterative identification algorithms are derived. Simulation example is provided to illustrate the effectiveness of the proposed algorithms.     

基于Householder变换的贪婪正交最小二乘辨识算法

针对含有未知时滞的多输入受控自回归系统模型的时滞与参数辨识问题,基于Householder变换探讨一种贪婪正交最小二乘辨识算法.首先,由于各输入通道的时滞未知,通过设置输入数据回归长度对系统模型进行过参数化,得到一个含有稀疏参数向量的高维辨识模型;其次,为了避免最小二乘算法中对高维协方差矩阵的求逆运算,利用Householder变换对信息矩阵进行正交分解,推导基于Householder变换的正交最小二乘算法;然后,为了提高辨识效率,降低辨识成本,推导基于Householder变换的贪婪准则,进而得到基于Householder变换的贪婪正交最小二乘辨识算法,该算法能够在少量采样数据的条件下获得稀疏参数向量的估计值;最后,根据估计的稀疏参数向量的结构得到系统时滞估计.仿真结果表明了所提出算法的有效性.     

An efficient hierarchical identification method for general dual-rate sampled-data systems

For the lifted input–output representation of general dual-rate sampled-data systems, this paper presents a decomposition based recursive least squares (D-LS) identification algorithm using the hierarchical identification principle. Compared with the recursive least squares (RLS) algorithm, the proposed D-LS algorithm does not require computing the covariance matrices with large sizes and matrix inverses in each recursion step, and thus has a higher computational efficiency than the RLS algorithm. The performance analysis of the D-LS algorithm indicates that the parameter estimates can converge to their true values. A simulation example is given to confirm the convergence results.     

基于KRLS的非均匀采样非线性系统辨识

利用提升技术可将非均匀采样非线性系统离散化为一个多输入单输出传递函数模型,从而将系统输出表示为非均匀刷新非线性输入和输出回归项的线性参数模型,进一步基于非线性输入的估计或过参数化方法进行辨识.然而,当非线性环节结构未知或不能被可测非均匀输入参数化表示时,上述辨识方法将不再适用.为了解决这个问题,利用核方法将原始非线性数据投影到高维特征空间中使其线性可分,再对投影后的数据应用递推最小二乘算法进行辨识,提出基于核递推最小二乘的非均匀采样非线性系统辨识方法.此外,针对系统含有有色噪声干扰的情况,参考递推增广最小二乘算法的思想,利用估计残差代替不可测噪声,提出核递推增广最小二乘算法.最后,通过仿真例子验证所提算法的有效性.     

Discrete variable stochastic approximation procedures and recursive autoregressive model identification

Two stochastic approximation procedures are proposed for finding a point attaining the maximum of a regression function defined and observable only at points on a set of discrete variables. The asymptotic convergence property of the procedures is discussed using the theorem of almost supermartingales. The procedures are applied to the recursive identification of autoregressive time series models. The identification procedure consists of a recursive order estimation stage and a recursive autoregressive parameter updating stage, and gives the true autoregressive model or the best autoregressive approximation model.     

Two-stage least squares based iterative identification algorithm for controlled autoregressive moving average (CARMA) systems

A two-stage least squares based iterative (two-stage LSI) identification algorithm is derived for controlled autoregressive moving average (CARMA) systems. The basic idea is to decompose a CARMA system into two subsystems and to identify each subsystem, respectively. Because the dimensions of the involved covariance matrices in each subsystem become small, the proposed algorithm has a high computational efficiency. The simulation results indicate that the proposed algorithm is effective.     

基于辅助模型和数据滤波的伪线性回归系统参数估计方法

针对伪线性输出误差回归系统的辨识模型新息信息向量存在不可测变量的问题,首先通过构造一个辅助模型,用辅助模型的输出代替未知中间变量,推导得到的基于辅助模型的递推最小二乘参数估计算法计算量较大,但算法的辨识效果不佳。进一步采用估计的噪声模型对系统观测数据进行滤波,使用滤波后的数据进行参数估计,从而推导提出了基于数据滤波的递推最小二乘参数估计算法。仿真结果表明,所提算法能够有效估计伪线性回归线性输出误差系统的参数。     

广义输出误差模型的两阶段最小二乘递推辨识

在有色噪声干扰系统中有一类系统, 它具有广义输出误差模型(OEARMA), 本文提出一类广义输出误差模型的 两阶段递推最小二乘参数估计算法. 该算法基本思想是结合辅助模型辨识思想和分解技术, 将系统分解成两个子系统, 每个子系统包含一个参数向量. 借助基于辅助模型和递推最小二乘理论, 用辅助模型的输出代替辨识模型信息向量中未 知中间变量, 用估计残差代替信息向量中不可测噪声项, 从而可以运用递推辨识思想来估计系统所有参数. 该算法具有 较高的计算效率, 仿真例子说明提出算法的有效性.     

基于时变自回归模型的FAJD盲源分离算法

为实现多高斯源和相关源信号的盲分离,在快速近似联合对角化(FAJD)算法的基础上,将故障诊断领域的时变自回归理论成功地应用于相关源信号的盲分离和多高斯源信号的盲分离.首先采用时变自回归模型(TVAR)对源信号建模,并通过白化预处理使得建模后的源信号具有可联合对角化的结构;然后,通过基函数加权和的方法将时变参数近似为已知基函数的加权和的形式,将其变成时不变的参数,再通过递推最小二乘法求解出模型系数矩阵组;最后,将所求出的系数矩阵组作为快速近似联合对角化的目标矩阵组,通过FAJD算法实现混合信号的分离.Matlab仿真实验验证了所提出的算法对于相关源信号和多高斯源信号的分离是行之有效的.由于算法中TVAR模型的优良特性,此算法非常适用于混合通信信号的盲分离.