一种模糊神经网络的快速参数学习算法

提出了一种新的模糊神经网络的快速参数学习算法, 采用一些特殊的处理, 可以用递推最小二乘法(RLS)来调整所有的参数. 以前的学习算法在调整模糊隶属度函数的中心和宽度的时候, 用的是梯度下降法, 具有容易陷入局部最小值点、收敛速度慢等缺点, 而本算法则可以克服这些缺点, 最后通过仿真验证了算法的有效性.     

Evolving fuzzy rules for due-date assignment problem in semiconductor manufacturing factory

This paper presents a fuzzy modeling method proposed by Wang and Mendel for generation of fuzzy rules using data generated from a simulated model that is built from a real factory located in Hsin-Chu science-based park of Taiwan, R.O.C. The fuzzy modeling method is further evolved by a genetic algorithm for due-date assignment problem in manufacturing. By using simulated data, the effectiveness of the proposed method is shown and compared with two other soft computing techniques: multi-layer perceptron neural networks and case-based reasoning. The comparative results indicate that the proposed method is consistently superior to the other two methods.     

分组区间二型模糊神经网络抗噪逼近器的研究

将区间二型模糊系统与神经网络系统相结合,运用分组的思想构造抗噪逼近器,并用提出的抗噪性能评价标准进行抗噪衡量。实验结果表明,该方法具有更好的逼近能力和抗噪能力。     

Adaptive backstepping output feedback control for SISO nonlinear system using fuzzy neural networks

In this paper, a new fuzzy-neural adaptive control approach is developed for a class of single-input and single-output （SISO） nonlinear systems with unmeasured states. Using fuzzy neural networks to approximate the unknown nonlinear functions, a fuzzy- neural adaptive observer is introduced for state estimation as well as system identification. Under the framework of the backstepping design, fuzzy-neural adaptive output feedback control is constructed recursively. It is proven that the proposed fuzzy adaptive control approach guarantees the global boundedness property for all the signals, driving the tracking error to a small neighbordhood of the origin. Simulation example is included to illustrate the effectiveness of the proposed approach.     

Nonlinear dynamic system identification using pipelined functional link artificial recurrent neural network

A computationally efficient pipelined functional link artificial recurrent neural network (PFLARNN) is proposed for nonlinear dynamic system identification using a modification real-time recurrent learning (RTRL) algorithm in this paper. In contrast to a feedforward artificial neural network (such as a functional link artificial neural network (FLANN)), the proposed PFLARNN consists of a number of simple small-scale functional link artificial recurrent neural network (FLARNN) modules. Since those modules of PFLARNN can be performed simultaneously in a pipelined parallelism fashion, this would result in a significant improvement in its total computational efficiency. Moreover, nonlinearity of each module is introduced by enhancing the input pattern with nonlinear functional expansion. Therefore, the performance of the proposed filter can be further improved. Computer simulations demonstrate that with proper choice of functional expansion in the PFLARNN, this filter performs better than the FLANN and multilayer perceptron (MLP) for nonlinear dynamic system identification.     

基于神经网络LMBP算法的正则模糊文法推导

用实时间回馈（RTRL）算法和实编码基因遗传（RCGA）算法训练二阶递归神经网络进行模糊文法推导,表现出了精度高的良好性能,但速度较慢。然而作为目前最快的递归神经网络算法Levenberg-Marquardt（LMBP）算法在模糊文法推导中的应用却很少引起学者们的关注。通过实验对 LMBP算法在正则模糊文法推导中的优势与缺陷等性能进行分析,实验显示了LMBP算法在模糊文法推导中的快速收敛能力。     

模糊神经网络的结构自组织算法及应用

提出了一种新的模糊神经网络自组织算法,该算法能够基于输入输出数据自动进行结构辨识和参数辨识.首先采用一种自组织聚类方法建立起网络的结构和各参数的初值,然后采用监督学习来优化网络参数.通过对非线性函数逼近的分析,明了该自组织算法的有效性,并与其他算法作了比较.最后,以某污水处理厂的实际运行数据为对象,应用该模糊神经网络建立了活性污泥系统出水水质预测模型,仿真结果表明.该模型能够对污水处理系统出水水质进行较好的预测.     

Nonlinear systems identification using dynamic multi-time scale neural networks

In this paper, two Neural Network (NN) identifiers are proposed for nonlinear systems identification via dynamic neural networks with different time scales including both fast and slow phenomena. The first NN identifier uses the output signals from the actual system for the system identification. The on-line update laws for dynamic neural networks have been developed using the Lyapunov function and singularly perturbed techniques. In the second NN identifier, all the output signals from nonlinear system are replaced with the state variables of the neuron networks. The on-line identification algorithm with dead-zone function is proposed to improve nonlinear system identification performance. Compared with other dynamic neural network identification methods, the proposed identification methods exhibit improved identification performance. Three examples are given to demonstrate the effectiveness of the theoretical results.     

基于模糊神经网络的稳定AODV协议改进方案

车载自组网的重要特征之一是节点的高移动性。针对节点的自由移动导致链路频繁断裂这一问题,在路由协议中选择稳定链路进行数据传输尤为重要。提出了一种具有链路稳定性的按需距离矢量路由协议（AODV）改进方案,即GF-AODV（AODV with GASA FNN）。该方案在路由发起和选择阶段,使用模糊神经网络对节点信息进行计算,得到节点稳定度以评估链路质量,并均衡考虑链路稳定性与跳数,选出稳定且跳数较小的路径。在路由维护阶段,针对实际环境使用遗传模拟退火算法对模糊神经网络的参数进行实时优化,以确保计算出的节点稳定度符合实际情况。实验表明,GF-AODV相对于AODV在平均时延、包投递率、路由开销等方面均有所改善。     

An improved gravitational search algorithm for dynamic neural network identification

Gravitational search algorithm (GSA) is a newly developed and promising algorithm based on the law of gravity and interaction between masses. This paper proposes an improved gravitational search algorithm (IGSA) to improve the performance of the GSA, and first applies it to the field of dynamic neural network identification. The IGSA uses trial-and-error method to update the optimal agent during the whole search process. And in the late period of the search, it changes the orbit of the poor agent and searches the optimal agent’s position further using the coordinate descent method. For the experimental verification of the proposed algorithm, both GSA and IGSA are testified on a suite of four well-known benchmark functions and their complexities are compared. It is shown that IGSA has much better efficiency, optimization precision, convergence rate and robustness than GSA. Thereafter, the IGSA is applied to the nonlinear autoregressive exogenous (NARX) recurrent neural network identification for a magnetic levitation system. Compared with the system identification based on gravitational search algorithm neural network (GSANN) and other conventional methods like BPNN and GANN, the proposed algorithm shows the best performance.     

GA-based learning for rule identification in fuzzy neural networks

Employing an effective learning process is a critical topic in designing a fuzzy neural network, especially when expert knowledge is not available. This paper presents a genetic algorithm (GA) based learning approach for a specific type of fuzzy neural network. The proposed learning approach consists of three stages. In the first stage the membership functions of both input and output variables are initialized by determining their centers and widths using a self-organizing algorithm. The second stage employs the proposed GA based learning algorithm to identify the fuzzy rules while the final stage tunes the derived structure and parameters using a back-propagation learning algorithm. The capabilities of the proposed GA-based learning approach are evaluated using a well-examined benchmark example and its effectiveness is analyzed by means of a comparative study with other approaches. The usefulness of the proposed GA-based learning approach is also illustrated in a practical case study where it is used to predict the performance of road traffic control actions. Results from the benchmarking exercise and case study effectively demonstrate the ability of the proposed three stages learning approach to identify relevant fuzzy rules from a training data set with a higher prediction accuracy than alternative approaches.     

动态非线性连续时间系统的小波神经网络辨识

将小波神经网络应用于动态非线性连续时间系统的辨识, 同时为了使神经网络的训练达到全局最优和加速小波神经网络训练的收敛速度, 提出了信赖域算法, 并研究了信赖域算法的收敛性. 随后进行了算例仿真, 证明了所提辨识方法的有效性.     

Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation

In this paper, a continuous time recurrent neural network (CTRNN) is developed to be used in nonlinear model predictive control (NMPC) context. The neural network represented in a general nonlinear state-space form is used to predict the future dynamic behavior of the nonlinear process in real time. An efficient training algorithm for the proposed network is developed using automatic differentiation (AD) techniques. By automatically generating Taylor coefficients, the algorithm not only solves the differentiation equations of the network but also produces the sensitivity for the training problem. The same approach is also used to solve the online optimization problem in the predictive controller. The proposed neural network and the nonlinear predictive controller were tested on an evaporation case study. A good model fitting for the nonlinear plant is obtained using the new method. A comparison with other approaches shows that the new algorithm can considerably reduce network training time and improve solution accuracy. The CTRNN trained is used as an internal model in a predictive controller and results in good performance under different operating conditions.     

连续非线性动态系统建模的模糊神经网络方法

提出一种适合于一般连续非线性动态系统建模的新的Runge-Kutta模糊神经网络(RKFNN)，证明了RKFNN的存在性。采用传统的Runge-Kutta求积公式构造，实现了对系统的状态变化特性进行学习，解决了直接映射方式对系统的动态轨迹进行学习时存在的精度低等问题，并提出了RKFNN的在线递推学习算法。对连续非线性动态系统进行楚模的仿真结果表明，RKFNN方法是一种较好的方法。     

An output error algorithm for piecewise affine system identification

Within Hybrid systems, piecewise affine systems are a common class to be identified from input/output data. In this paper an improved algorithm for identifying piecewise affine systems is developed. The algorithm stems from clustering-based system identification. An affine output error algorithm is used to identify final models. The performance of the new Piecewise Affine Output Error (PWA-OE) algorithm is demonstrated using experimental data from a Radio Frequency MicroElectroMechanical Systems switch. Compared to the existing state-of-the-art, the PWA-OE algorithm generates a potential 62% improvement in model coefficient accuracy. Furthermore the PWA-OE algorithm is less sensitive to two additional input parameter selections.     

Nonlinear system identification using optimized dynamic neural network

In this paper, both off-line architecture optimization and on-line adaptation have been developed for a dynamic neural network (DNN) in nonlinear system identification. In the off-line architecture optimization, a new effective encoding scheme—Direct Matrix Mapping Encoding (DMME) method is proposed to represent the structure of neural network by establishing connection matrices. A series of GA operations are applied to the connection matrices to find the optimal number of neurons on each hidden layer and interconnection between two neighboring layers of DNN. The hybrid training is adopted to evolve the architecture, and to tune the weights and input delays of DNN by combining GA with the modified adaptation laws. The modified adaptation laws are subsequently used to tune the input time delays, weights and linear parameters in the optimized DNN-based model in on-line nonlinear system identification. The effectiveness of the architecture optimization and adaptation is extensively tested by means of two nonlinear system identification examples.     

一种基于改进k-means的RBF神经网络学习方法

针对传统RBF神经网络学习算法构造的网络分类精度不高,传统的k-means算法对初始聚类中心的敏感,聚类结果随不同的初始输入而波动。为了解决以上问题,提出一种基于改进k-means的RBF神经网络学习算法。先用减聚类算法优化k-means算法,消除聚类的敏感性,再用优化后的k-means算法构造RBF神经网络。仿真结果表明了该学习算法的实用性和有效性。     

粒子群优化算法训练神经网络辨识混沌系统

提出利用粒子群优化算法训练神经网络的算法,进行混沌系统辨识,并与神经网络、遗传神经网络对同一混沌系统辨识的结果进行比较。实验表明,利用粒子群优化算法训练神经网络进行混沌系统辨识,在不明显增加执行时间的基础上,寻求最优解的质量有显著提高,并且原理简单,容易实现,可有效用于混沌系统的辨识。     

Nonlinear system identification using memetic differential evolution trained neural networks

Several gradient-based approaches such as back propagation (BP) and Levenberg Marquardt (LM) methods have been developed for training the neural network (NN) based systems. But, for multimodal cost functions these procedures may lead to local minima, therefore, the evolutionary algorithms (EAs) based procedures are considered as promising alternatives. In this paper we focus on a memetic algorithm based approach for training the multilayer perceptron NN applied to nonlinear system identification. The proposed memetic algorithm is an alternative to gradient search methods, such as back-propagation and back-propagation with momentum which has inherent limitations of many local optima. Here we have proposed the identification of a nonlinear system using memetic differential evolution (DE) algorithm and compared the results with other six algorithms such as Back-propagation (BP), Genetic Algorithm (GA), Particle Swarm Optimization (PSO), Differential Evolution (DE), Genetic Algorithm Back-propagation (GABP), Particle Swarm Optimization combined with Back-propagation (PSOBP). In the proposed system identification scheme, we have exploited DE to be hybridized with the back propagation algorithm, i.e. differential evolution back-propagation (DEBP) where the local search BP algorithm is used as an operator to DE. These algorithms have been tested on a standard benchmark problem for nonlinear system identification to prove their efficacy. First examples shows the comparison of different algorithms which proves that the proposed DEBP is having better identification capability in comparison to other. In example 2 good behavior of the identification method is tested on an one degree of freedom (1DOF) experimental aerodynamic test rig, a twin rotor multi-input-multi-output system (TRMS), finally it is applied to Box and Jenkins Gas furnace benchmark identification problem and its efficacy has been tested through correlation analysis.     

电厂水汽循环系统模糊神经网络故障诊断

电厂水汽循环系统是一个由多环节组成的复杂的大型工业生产过程,由于它的参数存在较大的不确定性和模糊性,使得对它的生产过程进行故障诊断十分困难.通过分析这个系统特点,提出了一种智能诊断方法———模糊神经网络对它进行故障诊断,从而解决了参数存在模糊性和不确定性的难题,提高了诊断的可靠性.