改进递归最小二乘RBF神经网络溶解氧预测

为提高溶解氧预测的准确性,将基于改进型递归最小二乘算法优化的径向基函数（ RBF）神经网络方法应用于溶解氧预测。利用K均值聚类算法进行隐层单元中心选择;利用改进型递归最小二乘算法优化RBF神经网络隐含层到输出层的权值。仿真结果表明：该方法对溶解氧的预测具有较好的非线性拟合能力,预测精度优于RBF神经网络和递归最小二乘算法优化的RBF神经网络。     

一种改进的RAN学习算法

提出一种资源分配网络(Resource Allocating Network, RAN)的新的学习算法,称为IRAN算法.该算法通过一个包含4部分的新颖性准则来增加网络中的隐层神经元,通过误差下降速率来删除冗余神经元并采用基于GivensQR分解的递归最小二乘算法进行输出层权值的更新.通过函数逼近领域中2个Benchmark问题的仿真结果表明,与RAN,RANEKF,MRAN算法相比,IRAN算法不但学习速度快,而且可以得到更为精简的网络结构.     

基于辅助模型和数据滤波的伪线性回归系统参数估计方法

针对伪线性输出误差回归系统的辨识模型新息信息向量存在不可测变量的问题,首先通过构造一个辅助模型,用辅助模型的输出代替未知中间变量,推导得到的基于辅助模型的递推最小二乘参数估计算法计算量较大,但算法的辨识效果不佳。进一步采用估计的噪声模型对系统观测数据进行滤波,使用滤波后的数据进行参数估计,从而推导提出了基于数据滤波的递推最小二乘参数估计算法。仿真结果表明,所提算法能够有效估计伪线性回归线性输出误差系统的参数。     

基于辅助模型和数据滤波的伪线性回归系统参数估计方法

针对伪线性输出误差回归系统的辨识模型新息信息向量存在不可测变量的问题,首先通过构造一个辅助模型,用辅助模型的输出代替未知中间变量,推导得到的基于辅助模型的递推最小二乘参数估计算法计算量较大,但算法的辨识效果不佳。进一步采用估计的噪声模型对系统观测数据进行滤波,使用滤波后的数据进行参数估计,从而推导提出了基于数据滤波的递推最小二乘参数估计算法。仿真结果表明,所提算法能够有效估计伪线性回归线性输出误差系统的参数。     

基于RBF神经网络混合遗传算法的多用户检测

提出了一种混合递阶遗传算法来同时训练RBF神经网络的结构和参数,引入了改进的染色体编码方案,用基于奇异值分解的最小二乘法计算网络输出层权值,提高了遗传搜索的效率,精简了网络结构.并用变学习速率梯度下降法优化遗传训练出的最优网络,应用到多用户检测中.仿真结果表明,新混合学习算法训练出的网络结构优于其它算法训练的网络结构,并且性能良好.     

网络结构增长的极端学习机算法

针对极端学习机(extreme learning machine,ELM)结构设计问题,基于隐含层激活函数及其导函数提出一种前向神经网络结构增长算法.首先以Sigmoid函数为例给出了一类基函数的派生特性:导函数可以由其原函数表示.其次,利用这种派生特性提出了ELM结构设计方法,该方法自动生成双隐含层前向神经网络,其第1隐含层的结点随机逐一生成.第2隐含层的输出由第1隐含层新添结点的激活函数及其导函数确定,输出层权值由最小二乘法分析获得.最后给出了所提算法收敛性及稳定性的理论证明.对非线性系统辨识及双螺旋分类问题的仿真结果证明了所提算法的有效性.     

利用多尺度小波变换的光度立体快速三维表面重建算法

光度立体三维测量中,需要通过三维重建算法从二维梯度场重建三维表面深度.针对传统的三维重建算法如全局迭代优化算法,在高分辨率情况下耗时较长的问题,提出利用多尺度小波变换的光度立体快速三维表面重建算法.首先利用梯度场代替传统小波通道,实现多尺度Haar小波变换,得到一种改进的多尺度小波变换算法;然后将该算法应用于光度立体三维表面重建中,提高了三维重建的速度.实验结果表明:与传统算法时间复杂度均高于线性阶相比,文中算法的时间复杂度与梯度场分辨率成线性阶关系;该算法适用于从高分辨率梯度场重建三维表面,并具有误差较小、鲁棒性好的优点.     

一种快速逼近的神经网络构造性算法

选取合适的网络结构是前馈网络应用中首先遇到一个十分重要而又困难的问题。文章针对前馈网络的特点,提出了一种网络构造算法。该算法的主要特点是把二层网络的训练问题转化为求解线性方程组的最小二乘解,直接求得使误差最小的权值矩阵,并通过划分样本子集来创建子网,把子网输出映射到输出层,形成三层网络结构。由于避免了传统BP算法的梯度搜索过程,该算法能快速收敛。仿真结果表明,所提出的算法可快速、有效地逼近连续函数。     

基于多输出最小二乘支持向量回归建模的自适应非线性预测控制及应用

提出一种可有效提高常规预测控制方法控制性能与计算效率的数据驱动自适应非线性模型预测控制方法.首先,为了提高多输出非线性系统最小二乘支持向量回归(least squares support vector regression, LS–SVR)建模的精度,考虑各维输出间的耦合关系,采用在目标函数中加入样本整体拟合误差项,实现多输出LS–SVR(multi-output LS–SVR,M–LS–SVR)预测建模,同时采用粒子群算法优化模型参数;其次,针对动态过程建模的模型失配问题以及由于M–LS–SVR模型复杂导致传统智能算法求解预测控制律缓慢的问题,提出自适应非线性模型预测控制策略,包括两个非线性优化层:第1层采用梯度下降算法实时优化模型和实际过程输出的偏差,以自适应调节模型参数;第2层采用具有全局收敛性和超线性收敛速度序列二次规划(sequential quadratic programming, SQP)算法设计非线性预测控制器,以加速预测控制律的求解速度. Benchmark仿真实例及在高炉炼铁过程的数据试验表明:所提基于M–LS–SVR预测建模的自适应非线性模型预测控制具有较快的求解速度、较好的设定值跟踪和干扰抑制性能以及较强的鲁棒性.     

最小二乘分解算法在车型识别中的应用

提出一种最小二乘支持向量机的序贯最小分类分解算法.针对最小二乘支持向量机,通过对核函数的相关变换,将二阶的误差信息归结到优化方程的一阶信息中,从而简化运算过程.采用最优函数梯度二阶信息选择工作集,实现最小二乘支持向量机分解算法,提高了算法的收敛性.采用径向基核函数和交叉验证网格搜索的方法验证算法的分类准确性.实验结果表明,提出的分类算法应用于车型识别中,可以得到比其他分类方法更好的分类准确度.     

基于KRLS的非均匀采样非线性系统辨识

利用提升技术可将非均匀采样非线性系统离散化为一个多输入单输出传递函数模型,从而将系统输出表示为非均匀刷新非线性输入和输出回归项的线性参数模型,进一步基于非线性输入的估计或过参数化方法进行辨识.然而,当非线性环节结构未知或不能被可测非均匀输入参数化表示时,上述辨识方法将不再适用.为了解决这个问题,利用核方法将原始非线性数据投影到高维特征空间中使其线性可分,再对投影后的数据应用递推最小二乘算法进行辨识,提出基于核递推最小二乘的非均匀采样非线性系统辨识方法.此外,针对系统含有有色噪声干扰的情况,参考递推增广最小二乘算法的思想,利用估计残差代替不可测噪声,提出核递推增广最小二乘算法.最后,通过仿真例子验证所提算法的有效性.     

Fast Blind Equalization Using Complex-Valued MLP

The blind equalizers based on complex valued feedforward neural networks, for linear and nonlinear communication channels, yield better performance as compared to linear equalizers. The learning algorithms are, generally, based on stochastic gradient descent, as they are simple to implement. However, these algorithms show a slow convergence rate. In the blind equalization problem, the unavailability of the desired output signal and the presence of nonlinear activation functions make the application of recursive least squares algorithm difficult. In this letter, a new scheme using recursive least squares algorithm is proposed for blind equalization. The learning of weights of the output layer is obtained by using a modified version of constant modulus algorithm cost function. For the learning of weights of hidden layer neuron space adaptation approach is used. The proposed scheme results in faster convergence of the equalizer.     

Recursive least squares parameter identification algorithms for systems with colored noise using the filtering technique and the auxilary model

This paper focuses on the parameter estimation problems of output error autoregressive systems and output error autoregressive moving average systems (i.e., the Box–Jenkins systems). Two recursive least squares parameter estimation algorithms are proposed by using the data filtering technique and the auxiliary model identification idea. The key is to use a linear filter to filter the input–output data. The proposed algorithms can identify the parameters of the system models and the noise models interactively and can generate more accurate parameter estimates than the auxiliary model based recursive least squares algorithms. Two examples are given to test the proposed algorithms.     

Two recursive least squares parameter estimation algorithms for multirate multiple-input systems by using the auxiliary model

This paper considers identification problems of multirate multiple-input output error systems, derives the input-output representations by using the state space models of the multirate systems, and presents two auxiliary model based recursive least squares algorithms for the corresponding output error models with each subsystem having different or same denominator polynomials. The simulation results show the effectiveness of the proposed algorithms.     

Parallel solution of sparse linear least squares problems on distributed-memory multiprocessors

This paper studies the parallel solution of large-scale sparse linear least squares problems on distributed-memory multiprocessors. The key components required for solving a sparse linear least squares problem are sparse QR factorization and sparse triangular solution. A block-oriented parallel algorithm for sparse QR factorization has already been described in the literature. In this paper, new block-oriented parallel algorithms for sparse triangular solution are proposed. The arithmetic and communication complexities of the new algorithms applied to regular grid problems are analyzed. The proposed parallel sparse triangular solution algorithms together with the block-oriented parallel sparse QR factorization algorithm result in a highly efficient approach to the parallel solution of sparse linear least squares problems. Performance results obtained on an IBM Scalable POWERparallel system SP2 are presented. The largest least squares problem solved has over two million rows and more than a quarter million columns. The execution speed for the numerical factorization of this problem achieves over 3.7 gigaflops per second on an IBM SP2 machine with 128 processors.     

TISO-OEAR模型的分解递推最小二乘辨识方法

针对输出误差模型参数估计过程中的计算量较大的问题,提出了基于分解的两输入单输出（TISO）输出误差自回归模型（OEAR）的分解递推最小二乘（DRLS）算法．基本的思想是分解TISO系统为3个子系统,并通过递推最小二乘分别辨识每个子系统．DRLS算法是解决大规模系统的计算量大和复杂辨识模型的辨识难题的一种有效的方法．最后通过仿真实例验证和分析了所提出算法的有效性与优越性,并对两种算法的特点进行了总结．     

协方差重置的两阶段递推贝叶斯参数辨识算法

为了在有色噪声干扰情况下获得无偏估计,基于辅助模型思想和分解技术,提出了一种带协方差重置的两阶段递推贝叶斯辨识算法。该算法首先把待辨识模型分解成两个虚拟子模型,然后分别辨识;同时,把估计到的噪声方差引入算法,并加入了一种新的协方差重置方法。计算量分析表明,与带协方差重置的最小二乘算法相比,所提算法可以减少计算量。仿真结果显示,所提算法的估计误差比传统最小二乘算法要小。实例建模证明了算法的有效性。     

A cumulant based algorithm for the identification of input-output quadratic systems

The identification of a special class of polynomial models is pursued in this paper. In particular a parameter estimation algorithm is developed for the identification of an input-output quadratic model excited by a zero mean white Gaussian input and with the output corrupted by additive measurement noise. Input-output crosscumulants up to the fifth order are employed and the identification problem of the unknown model parameters is reduced to the solution of successive triangular linear systems of equations that are solved at each step of the algorithm. Simulation studies are carried out and the proposed methodology is compared with two least squares type identification algorithms, the output error method and a combination of the instrumental variables and the output error approach. The proposed cumulant based algorithm and the output error method are tested with real data produced by a robotic manipulator.     

Adaptive parameter estimation for a general dynamical system with unknown states

This paper is concerned with the design of a state filter for a time‐delay state‐space system with unknown parameters from noisy observation information. The key is to investigate new identification algorithms for interactive state and parameter estimation of the considered system. Firstly, an observability canonical state‐space model is derived from the original model by linear transformation for the purpose of simplifying the model structure. Secondly, a direct state filter is formulated by minimizing the state estimation error covariance matrix on the basis of the Kalman filtering principle. Thirdly, once the unknown states are estimated, a state filter–based recursive least squares algorithm is proposed for parameter estimation using the least squares principle. Then, a state filter–based hierarchical least squares algorithm is derived by decomposing the original system into several subsystems for improving the computational efficiency. Finally, the numerical examples illustrate the effectiveness and robustness of the proposed algorithms.