基于迭代容积卡尔曼滤波的神经网络训练算法

针对现有应用非线性滤波算法对神经网络进行训练时存在精度不足的问题,提出了一种基于迭代容积卡尔曼滤波的神经网络训练算法。首先,将前馈神经网络各个节点的连接权值和偏置作为状态向量,建立前馈神经网络的状态空间模型。其次,利用Spherical-Radial准则生成容积点,并依据Gauss-Newton迭代策略来优化量测更新过程中获取的状态估计值和状态估计误差协方差,通过容积卡尔曼滤波估计精度的改善,提升神经网络节点的连接权值和偏置的训练效果。理论分析和仿真实验结果验证了所提算法的可行性和有效性。     

基于RSSI混合滤波和最小二乘参数估计的测距算法

针对基于RSSI的无线传感器网络定位测距问题,在对数-常态分布模型下提出了一种混合滤波及最小二乘环境参数动态估计的测距算法。以锚节点作为参考节点,采用基于均值滤波、中值滤波和高斯滤波的混合滤波方法优化RSSI值,运用最小二乘法估计环境参数,再由盲节点与锚节点的RSSI混合滤波优化值计算二者之间的距离。仿真结果表明,混合滤波性能优于其它单一滤波方法,环境参数估计相对误差小于2.5%,空旷环境下100 m范围内测距相对误差小于10%,满足无线传感器网络定位测距要求。     

基于多级金字塔卷积神经网络(MLPCNN)的快速特征表示方法

近年来,在机器视觉中基于卷积神经网络(CNN)的特征提取方法取得了令人惊叹的成果,主要原因是深度学习在多层和低维的特征表示上有着很大的优势。但是由于在大尺度图像中卷积滤波的过程速度过慢,导致CNN参数调节困难、训练时间过长,针对这一问题,本文基于传统卷积神经网络(TCNN, Traditional convolution neural network)提出一种快速有效的多级金字塔卷积神经网络MLPCNN(Multi-level pyramid CNN)。这一网络使用权值共享的方法将低级的滤波权值共享到高级,保证CNN的训练只在较小尺寸的图像块上进行,加快训练速度。实验表明,在特征维数比较低的情况下,MLPCNN提取到的特征比传统的特征提取方法更加有效,在Caltech101数据库上,MLPCNN识别率达到81.32%,而且训练速度较TCNN网络提高了约2.5倍。     

基于参数调整的动态模糊神经网络算法

模糊逻辑与神经网络结合形成的模糊神经网络同时具有易于表达人类知识、存储与学习分布信息的优点,基于此,提出一种基于参数调整的动态模糊神经网络算法。采用扩展卡尔曼滤波器法将全局算法划分为线性和非线性部分,线性参数由最小二乘法和滤波器法决定,非线性参数由训练样本和启发式法直接决定,线性和非线性参数可进行实时更新。仿真结果表明,该算法能保证更简洁的结构和更短的学习时间。     

&thetas;-adaptive neural networks: a new approach to parameterestimation

A novel use of neural networks for parameter estimation in nonlinear systems is proposed. The approximating ability of the neural network is used to identify the relation between system variables and parameters of a dynamic system. Two different algorithms, a block estimation method and a recursive estimation method, are proposed. The block estimation method consists of the training of a neural network to approximate the mapping between the system response and the system parameters which in turn is used to identify the parameters of the nonlinear system. In the second method, the neural network is used to determine a recursive algorithm to update the parameter estimate. Both methods are useful for parameter estimation in systems where either the structure of the nonlinearities present are unknown or when the parameters occur nonlinearly. Analytical conditions under which successful estimation can be carried but and several illustrative examples verifying the behavior of the algorithms through simulations are presented.     

基于轻量级姿态估计的跳绳检测计数算法

针对人体姿态估计算法可实施性低以及基于姿态估计的跳绳计数精度不高的问题, 提出了一种基于轻量级人体姿态估计网络的跳绳计数算法. 该算法首先输入跳绳视频, 接着利用帧间差分法提取关键帧图像并送入人体姿态估计网络进行关节点检测; 同时为了解决轻量级网络检测精度不高的问题, 提出优化的LitePose检测模型, 采用自适应感知解码方法对模型的解码部分进行优化从而减少量化误差; 然后采用卡尔曼滤波对坐标数据进行平滑降噪, 以减小坐标抖动误差; 最终通过关键点坐标变化判断跳绳计数. 实验结果表明, 在相同图像分辨率和环境配置下, 本文提出的算法使用优化的LitePose-S网络模型, 不仅未增加模型参数量和运算复杂度, 同时网络检测精度提高了0.7%, 且优于其他对比网络, 而且本算法在跳绳计数时的平均误差率最低可达1.00%, 可以利用人体姿态估计的结果有效地判断人体起跳和落地情况, 最终得出计数结果.     

Radial basis function neural network for approximation andestimation of nonlinear stochastic dynamic systems

This paper presents a means to approximate the dynamic and static equations of stochastic nonlinear systems and to estimate state variables based on radial basis function neural network (RBFNN). After a nonparametric approximate model of the system is constructed from a priori experiments or simulations, a suboptimal filter is designed based on the upper bound error in approximating the original unknown plant with nonlinear state and output equations. The procedures for both training and state estimation are described along with discussions on approximation error. Nonlinear systems with linear output equations are considered as a special case of the general formulation. Finally, applications of the proposed RBFNN to the state estimation of highly nonlinear systems are presented to demonstrate the performance and effectiveness of the method.     

基于并行学习鲁棒自适应的行驶车辆特性参数估计方法研究

针对车辆行驶过程中的特性参数估计问题,基于并行学习思想提出一种鲁棒自适应参数估计方法.通过低通滤波技术,设计一组系统状态和响应函数的一阶滤波变量.结合并行学习,构建特性参数估计的回归向量,并基于参数估计误差向量,设计鲁棒自适应参数更新律.以某型车辆为例,对该方法的有效性进行仿真验证.仿真结果表明,在无/有扰动情形下,该...     

A mixture-of-experts framework for adaptive Kalman filtering

This paper proposes a modular and flexible approach to adaptive Kalman filtering using the framework of a mixture-of-experts regulated by a gating network. Each expert is a Kalman filter modeled with a different realization of the unknown system parameters such as process and measurement noise. The gating network performs on-line adaptation of the weights given to individual filter estimates based on performance. This scheme compares very favorably with the classical Magill filter bank, which is based on a Bayesian technique, in terms of: estimation accuracy; quicker response to changing environments; and numerical stability and computational demands. The proposed filter bank is further enhanced by periodically using a search algorithm in a feedback loop. Two search algorithms are considered. The first algorithm uses a recursive quadratic programming approach which extremizes a modified maximum likelihood function to update the parameters of the best performing filter in the bank. This particular approach to parameter adaptation allows a real-time implementation. The second algorithm uses a genetic algorithm to search for the parameter vector and is suited for post-processed data type applications. The workings and power of the overall filter bank and the suggested adaptation schemes are illustrated by a number of examples.     

基于参数估计误差的鲁棒自适应律设计及验证

针对传统自适应控制系统设计的自适应律参数收敛慢进而影响控制系统瞬态性能的问题,研究一类新的基于参数估计误差修正的鲁棒自适应律设计.首先引入滤波操作给出参数估计误差的提取方法,构建出含参数估计误差修正项的自适应律,进而将该自适应律用于控制器设计和分析中,可同时实现控制误差和参数估计误差指数收敛.对比分析了几类传统自适应律和所提出自适应律的收敛性和鲁棒性,并给出了保证参数收敛所需持续激励条件的一种直观、简便的在线判别方法.数值仿真及基于自制三自由度直升机系统俯仰轴实验结果表明,基于参数误差修正的自适应律及控制器可得到优于传统自适应方法的跟踪控制和参数估计性能.     

组合导航系统NNM信息融合算法

提出了将神经网络模型（NNM）概念应用于组合导航系统，并给出了基于RBP网的NNM训练过程，基于传统模型的卡尔曼滤波算法与神经网络相结合，有效地解决了GPS信号被屏蔽时的航迹预测问题，最后对GPS/DR组合导航系统进行动态仿真，仿真结果表明，采用该算法的组合导航系统定位精度高、可靠性好。     

无监督的猕猴运动皮层锋电位信号CKF解码

如何通过猕猴运动皮层的神经元锋电位信号估计其手指移动位置是一神经解码问题,现存方法解决该问题大多采用有监督训练,需要通过训练数据得到神经元锋电位信号与手指移动位置的关系,因此其估计性能依赖于训练数据.本文提出了一种无监督解码方法,该方法基于状态空间模型（State space model,SSM）,利用神经网络得到神经元锋电位数与手指移动位置的关系权值,再用逐次状态估计方法去估计手指移动的位置.为减少训练的复杂度和提高估计准确度,采用一种非线性的积分卡尔曼滤波（Cubature Kalman filtering,CKF）来完成神经网络的训练和手指位置的逐次状态估计.与传统方法相比,该方法的最大特点是无监督,可以由神经元锋电位簇向量直接估计手指移动位置,而无需有监督训练.实验结果显示,当采用较少的有监督数据,现存方法与本文方法相比有较大的估计误差;当采用较多的有监督数据,现存方法才具有与本文方法相近似的估计误差.     

On-line training of recurrent neural networks with continuoustopology adaptation

This paper presents an online procedure for training dynamic neural networks with input-output recurrences whose topology is continuously adjusted to the complexity of the target system dynamics. This is accomplished by changing the number of the elements of the network hidden layer whenever the existing topology cannot capture the dynamics presented by the new data. The training mechanism is based on the suitably altered extended Kalman filter (EKF) algorithm which is simultaneously used for the network parameter adjustment and for its state estimation. The network consists of a single hidden layer with Gaussian radial basis functions (GRBF), and a linear output layer. The choice of the GRBF is induced by the requirements of the online learning. The latter implies the network architecture which permits only local influence of the new data point in order not to forget the previously learned dynamics. The continuous topology adaptation is implemented in our algorithm to avoid memory and computational problems of using a regular grid of GRBF'S which covers the network input space. Furthermore, we show that the resulting parameter increase can be handled "smoothly" without interfering with the already acquired information. If the target system dynamics are changing over time, we show that a suitable forgetting factor can be used to "unlearn" the no longer-relevant dynamics. The quality of the recurrent network training algorithm is demonstrated on the identification of nonlinear dynamic systems.     

基于信号质量评估的可穿戴动态心电监护

针对医疗保健领域人体生理监护的需要,提出了一种基于信号质量评估和卡尔曼滤波的可穿戴动态心电监护系统的设计。首先分析了可穿戴动态心电信号的特征,接着给出了基于信号质量评估和卡尔曼滤波的动态心率估计模型,并说明了利用R波检测和加速度计的结果来获得运动状态下心电信号质量指数SQI的方法,然后通过SQI的值对卡尔曼滤波器的参数进行动态调节,以获得最佳的心率估计。最后,通过实际的测试证明了该系统具有较高的可靠性和有效性。     

基于支持向量机的滤波器设计与硬件实现

针对传统有限脉冲响应(FIR)滤波器设计方法和神经网络设计方法的不足,在改进使用支持向量机(SVM)设计FIR滤波器方法的基础上,提出了SVM设计FIR滤波器的硬件实现方法.使用理想滤波器的幅值响应训练SVM,得到训练参数,据此构建基于SVM的FIR滤波器的嵌入式系统.软件实现FIR滤波器的训练部分,硬件实现FIR滤波器的测试部分.单次判定测试向量的时间约为3500 ns,滤波准确率可达到98.41%.设计的滤波器具有良好的幅频特性,边界控制精确,逼近理想滤波器.     

基于神经网络的机械加工工序能耗预测

针对工序级能耗难以用数学方法精确估算的问题,提出了一个基于神经网络的机械加工工序能耗预测方法。给出了输入变量及输出变量的选取及其归一化处理方法,进行了隐含层节点数和传递函数的选取。以各切削用量组合及其对应能源消耗的历史数据作为神经网络训练的样本集,建立切削用量组合方案输入和能源消耗输出间的非线性关系,从而对新的切削用量参数组合进行能耗值的预测。以某企业导叶片的粗铣加工为例,验证了该能耗预测方法的有效性。     

基于递推最小二乘与互补滤波的姿态估计

针对基于微机电系统(MEMS)的惯性导航系统中陀螺噪声较大导致姿态漂移的问题,本文基于递推最小二乘(RLS)与互补滤波器提出一种提高姿态估计精度的方法.该方法从陀螺去噪算法和姿态解算原理两个方面提高姿态估计精度:在陀螺去噪方面,为克服传统递推最小二乘的不足,提出一种随机加权的递推最小二乘法,利用随机加权实现对偏差的估计;在姿态解算方面,在传统互补滤波器的基础上通过自适应调整比例-积分(PI)参数来调整滤波器的交接频率,最终得到陀螺积分值的高通滤波和加速度计的低通滤波的叠加.转台静态和动态实验结果表明,使用本文所提方法后,有效降低了陀螺噪声,姿态估计精度明显提升.     

基于WPEE-RF的模拟电路故障诊断

为实现高效的模拟电路故障诊断,提出了基于小波包能量熵(WPEE)和随机森林(RF)的模拟电路故障诊断方法;选择合适的测试激励信号,监测电路收集数据,对模拟电路监测数据进行5层小波包分解,计算多频带WPEE向量表征故障特征,由RF分类器实现故障诊断;仿真实验结果表明,该方法在双二次滤波电路、Sallen-key滤波电路容差故障诊断以及对数放大器综合故障诊断中体现出良好的性能,故障诊断准确率达99%以上,且该方法具有参数鲁棒性,RF模型训练时间短;较支持向量机和BP网络方法相比,表现出更好的综合性能,更能贴近工程实践应用。     

A recursive algorithm based on the extended Kalman filter for the training of feedforward neural models

The extended Kalman filter (EKF) is a well-known tool for the recursive parameter estimation of static and dynamic nonlinear models. In particular, the EKF has been applied to the estimation of the weights of feedforward and recurrent neural network models, i.e. to their training, and shown to be more efficient than recursive and nonrecursive first-order training algorithms; nevertheless, these first applications to the training of neural networks did not fully exploit the potentials of the EKF. In this paper, we analyze the specific influence of the EKF parameters for modeling problems, and propose a variant of this algorithm for the training of feedforward neural models which proves to be very efficient as compared to nonrecursive second-order algorithms. We test the proposed EKF algorithm on several static and dynamic modeling problems, some of them being benchmark problems, and which bring out the properties of the proposed algorithm.     

Regularization aspects in continuous-time model identification

This paper presents an analysis of some regularization aspects in continuous-time model identification. The study particulary focuses on linear filter methods and shows that filtering the data before estimating their derivatives corresponds to a regularized signal derivative estimation by minimizing a compound criterion whose expression is given explicitly. A new structure based on a null phase filter corresponding to a true regularization filter is proposed and allows to discuss the filter phase effects on parameter estimation by comparing its performances with those of the Poisson filter-based methods. Based on this analysis, a formulation of continuous-time model identification as a joint system input-output signal and model parameter estimation is suggested. In this framework, two linear filter methods are interpreted and a compound criterion is proposed in which the regularization is ensured by a model fitting measure, resulting in a new regularization filter structure for signal estimation.