基于EKF的模糊神经网络快速自组织学习算法*

为了快速地构造一个有效的模糊神经网络,提出一种基于扩展卡尔曼滤波(EKF)的模糊神经网络自组织学习算法。在本算法中,按照提出的无须经过修剪过程的生长准则增加规则,加速了网络在线学习过程;使用EKF算法更新网络的自由参数,增强了网络的鲁棒性。仿真结果表明,该算法具有快速的学习速度、良好的逼近精度和泛化能力。     

基于UKF的增长型模糊神经网络设计

为了实现模糊神经网络结构和参数的同时调整,提出一种基于无迹卡尔曼滤波(UKF)的增长型模糊神经网络(UKF-GFNN).首先,利用UKF对模糊神经网络的参数进行调整;然后,设计一种基于隐含层神经元输出强度的模糊规则增长机制,实现模糊神经网络的结构增长;最后,将所提出的增长型模糊神经网络应用于非线性系统建模.实验结果显示,基于UKF的增长型模糊神经网络能够实现结构和参数的自校正,并且具有较高的建模精度.     

An adaptive neural fuzzy filter and its applications

A new kind of nonlinear adaptive filter, the adaptive neural fuzzy filter (ANFF), based upon a neural network's learning ability and fuzzy if-then rule structure, is proposed in this paper. The ANFF is inherently a feedforward multilayered connectionist network which can learn by itself according to numerical training data or expert knowledge represented by fuzzy if-then rules. The adaptation here includes the construction of fuzzy if-then rules (structure learning), and the tuning of the free parameters of membership functions (parameter learning). In the structure learning phase, fuzzy rules are found based on the matching of input-output clusters. In the parameter learning phase, a backpropagation-like adaptation algorithm is developed to minimize the output error. There are no hidden nodes (i.e., no membership functions and fuzzy rules) initially, and both the structure learning and parameter learning are performed concurrently as the adaptation proceeds. However, if some linguistic information about the design of the filter is available, such knowledge can be put into the ANFF to form an initial structure with hidden nodes. Two major advantages of the ANFF can thus be seen: 1) a priori knowledge can be incorporated into the ANFF which makes the fusion of numerical data and linguistic information in the filter possible; and 2) no predetermination, like the number of hidden nodes, must be given, since the ANFF can find its optimal structure and parameters automatically     

A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning

This paper proposes a self-evolving interval type-2 fuzzy neural network (SEIT2FNN) with online structure and parameter learning. The antecedent parts in each fuzzy rule of the SEIT2FNN are interval type-2 fuzzy sets and the fuzzy rules are of the Takagi–Sugeno–Kang (TSK) type. The initial rule base in the SEIT2FNN is empty, and the online clustering method is proposed to generate fuzzy rules that flexibly partition the input space. To avoid generating highly overlapping fuzzy sets in each input variable, an efficient fuzzy set reduction method is also proposed. This method independently determines whether a corresponding fuzzy set should be generated in each input variable when a new fuzzy rule is generated. For parameter learning, the consequent part parameters are tuned by the rule-ordered Kalman filter algorithm for high-accuracy learning performance. Detailed learning equations on applying the rule-ordered Kalman filter algorithm to the SEIT2FNN consequent part learning, with rules being generated online, are derived. The antecedent part parameters are learned by gradient descent algorithms. The SEIT2FNN is applied to simulations on nonlinear plant modeling, adaptive noise cancellation, and chaotic signal prediction. Comparisons with other type-1 and type-2 fuzzy systems in these examples verify the performance of the SEIT2FNN.      

自适应模糊神经网络控制系统的研究

自适应模糊神经网络控制器是由模糊控制和神经网络相结合构成,它不依赖被控对象的数学模型,并能自动产生模糊控制规则,又具有良好的自适应性,是目前受人们关注的课题。本文在对其分析的基础上又提出了卡尔曼滤波的学习算法,解决了原BP算法实时性差的问题,通过仿真实验说明了其优越性,并体现了模糊神经网络与最优控制相结合的思想。     

基于Elman神经网络的浓相输送模糊控制系统

由于粉末物料的浓相输送系统存在严重的非线性和时变性,故要想建立其准确数学模型难度非常大,本文提出了使用模糊神经网络控制系统,并对于模糊控制规则由Elman神经网络联想记忆后提取,它不但可以获得最佳控制规则,而且响应速度快并能够进行在线进行规则的修正。经仿真实验,该控制器能够对粉末物料流量在一定范围内进行协调优化时实控制。     

An stable online clustering fuzzy neural network for nonlinear system identification

In this paper, we propose a online clustering fuzzy neural network. The proposed neural fuzzy network uses the online clustering to train the structure, the gradient to train the parameters of the hidden layer, and the Kalman filter algorithm to train the parameters of the output layer. In our algorithm, learning structure and parameter learning are updated at the same time, we do not make difference in structure learning and parameter learning. The center of each rule is updated to obtain the center is near to the incoming data in each iteration. In this way, it does not need to generate a new rule in each iteration, i.e., it neither generates many rules nor need to prune the rules. We prove the stability of the algorithm.     

A neural fuzzy system with linguistic teaching signals

A neural fuzzy system learning with linguistic teaching signals is proposed. This system is able to process and learn numerical information as well as linguistic information. It can be used either as an adaptive fuzzy expert system or as an adaptive fuzzy controller. First, we propose a five-layered neural network for the connectionist realization of a fuzzy inference system. The connectionist structure can house fuzzy logic rules and membership functions for fuzzy inference. We use α-level sets of fuzzy numbers to represent linguistic information. The inputs, outputs, and weights of the proposed network can be fuzzy numbers of any shape. Furthermore, they can be hybrid of fuzzy numbers and numerical numbers through the use of fuzzy singletons. Based on interval arithmetics, two kinds of learning schemes are developed for the proposed system: fuzzy supervised learning and fuzzy reinforcement learning. Simulation results are presented to illustrate the performance and applicability of the proposed system     

An adaptive fusion algorithm based on ANFIS for radar/infrared system

In order to improve tracking ability, an adaptive fusion algorithm based on adaptive neuro-fuzzy inference system (ANFIS) for radar/infrared system is proposed, which combines the merits of fuzzy logic and neural network. Fuzzy adaptive fusion algorithm is a powerful tool to make the actual value of the residual covariance consistent with its theoretical value. To overcome the defect of the dependence on the knowledge of the process and measurement noise statistics of Kalman filter, neural network is introduced, which has the ability to learn from examples and extract the statistical properties of the examples during the training sessions. The fusion system mainly consists of Kalman filters, ANFIS sensor confidence estimators (ASCEs) based on contextual information (CI) theory, knowledge base (KB) and track-to-track fusion algorithms. Experimental data are implemented to train ASCEs to obtain sensor confidence degree. Simulation results show that the algorithm can effectively adjust the system to adapt contextual changes and has strong fusion capability in resisting uncertain information.     

A fuzzy neural network based on fuzzy hierarchy error approach

This paper presents a novel fuzzy neural network which consists of an antecedent network and a consequent network. The antecedent network matches the premises of the fuzzy rules and the consequent network implements the consequences of the rules. In the network learning and training phase, a concise and effective algorithm based on the fuzzy hierarchy error approach is proposed to update the parameters of the network. This algorithm is simple to implement and it does not require as many calculations as some other classic neural network learning algorithms. A model reference adaptive control structure incorporating the proposed fuzzy neural network is studied. Simulation results of a cart-pole balancing system demonstrate the effectiveness of the proposed method     

A Type-2 Self-Organizing Neural Fuzzy System and Its FPGA Implementation

This paper proposes a type-2 self-organizing neural fuzzy system (T2SONFS) and its hardware implementation. The antecedent parts in each T2SONFS fuzzy rule are interval type-2 fuzzy sets, and the consequent part is of Mamdani type. Using interval type-2 fuzzy sets in T2SONFS enables it to be more robust than type-1 fuzzy systems. T2SONFS learning consists of structure and parameter identification. For structure identification, an online clustering algorithm is proposed to generate rules automatically and flexibly distribute them in the input space. For parameter identification, a rule-ordered Kalman filter algorithm is proposed to tune the consequent-part parameters. The learned T2SONFS is hardware implemented, and implementation techniques are proposed to simplify the complex computation process of a type-2 fuzzy system. The T2SONFS is applied to nonlinear system identification and truck backing control problems with clean and noisy training data. Comparisons between type-1 and type-2 neural fuzzy systems verify the learning ability and robustness of the T2SONFS. The learned T2SONFS is hardware implemented in a field-programmable gate array chip to verify functionality of the designed circuits.      

Tracking a maneuvering target using neural fuzzy network

A fast target maneuver detecting and highly accurate tracking technique using a neural fuzzy network based on Kalman filter is proposed in this paper. In the automatic target tracking system, there exists an important and difficult problem: how to detect the target maneuvers and fast response to avoid miss-tracking? The traditional maneuver detection algorithms, such as variable dimension filter (VDF) and input estimation (IE) etc., are computation intensive and difficult to implement in real time. To solve this problem, neural network algorithms have been issued recently. However, the normal neural networks such as backpropagation networks usually produce the extra problems of low convergence speed and/or large network size. Furthermore, the way to decide the network structure is heuristic. To overcome these defects and to make use of neural learning ability, a developed standard Kalman filter with a self-constructing neural fuzzy inference network (KF-SONFIN) algorithm for target tracking is presented in this paper. By generating possible target trajectories including maneuver information to train the SONFIN, the trained SONFIN can detect when the maneuver occurred, the magnitude of maneuver values and when the maneuver disappeared. Without having to change the structure of Kalman filter nor modeling the maneuvering target, this new algorithm, SONFIN, can always find itself an economic network size with a fast learning process. Simulation results show that the KF-SONFIN is superior to the traditional IE and VDF methods in estimation accuracy.     

A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks

In this paper, we present a fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks (FAOS-PFNN), where a novel structure learning algorithm incorporating a pruning strategy into new growth criteria is developed. The proposed growing procedure without pruning not only speeds up the online learning process but also facilitates a more parsimonious fuzzy neural network while achieving comparable performance and accuracy by virtue of the growing and pruning strategy. The FAOS-PFNN starts with no hidden neurons and parsimoniously generates new hidden units according to the proposed growth criteria as learning proceeds. In the parameter learning phase, all the free parameters of hidden units, regardless of whether they are newly created or originally existing, are updated by the extended Kalman filter (EKF) method. The effectiveness and superiority of the FAOS-PFNN paradigm is compared with other popular approaches like resource allocation network (RAN), RAN via the extended Kalman filter (RANEKF), minimal resource allocation network (MRAN), adaptive-network-based fuzzy inference system (ANFIS), orthogonal least squares (OLS), RBF-AFS, dynamic fuzzy neural networks (DFNN), generalized DFNN (GDFNN), generalized GAP-RBF (GGAP-RBF), online sequential extreme learning machine (OS-ELM) and self-organizing fuzzy neural network (SOFNN) on various benchmark problems in the areas of function approximation, nonlinear dynamic system identification, chaotic time-series prediction and real-world regression problems. Simulation results demonstrate that the proposed FAOS-PFNN algorithm can achieve faster learning speed and more compact network structure with comparably high accuracy of approximation and generalization.     

Wavenet fuzzy PID controller for nonlinear MIMO systems: Experimental validation on a high-end haptic robotic interface

A novel global PID control scheme for nonlinear MIMO systems is proposed and implemented for a robot as study case, this scheme is called AWFPID from its adaptive wavelet fuzzy PID control structure. Basically, it identifies inverse error dynamics using a radial basis neural network with daughter RASP1 wavelets activation function; its output is in cascaded with an infinite impulse response (IIR) filter to prune irrelevant signals and nodes as well as to recover a canonical form. Then, online adaptive fuzzy tuning of a discrete PID regulator is proposed, whose closed-loop guarantees global regulation for nonlinear dynamical plants. The wavelet network includes a fuzzy inference system for online tuning of learning rates. A real-time experimental study on a three degrees of freedom haptic interface, the PHANToM Premium 1.0A, highlights the regulation with smooth control effort without using the mathematical model of the robot.     

基于自适应直觉模糊推理的数据挖掘方法

针对数据挖掘问题,将直觉模糊集与神经网络理论相结合,提出一种新的方法。用自适应直觉模糊推理的方法来解决数据挖掘问题,该方法可以根据直觉模糊神经网络本身的自适应学习能力来调节网络参数,自动生成规则库。最后通过一个仿真实例证明了该方法的有效性。     

基于模糊分类的模糊神经网络辨识方法及应用

基于改进的T-S模型，提出一种自适应模糊神经网络模型(AFNN)，给出了网络的连接结构和学习算法。基于竞争学习算法的模糊分类器确定系统的模糊空间和模糊规则数，并得出每个样本对每条规则的适用程度。利用卡尔曼滤波算法在线辨识删的后件参数。AFNN结构简洁，逼近能力强，能够显著提高辨识精度，并且在线辨识的模糊模型简单有效。将该AFNN用于非线性系统的模糊辨识和化工过程连续搅拌反应器(CSTR)的建模中，仿真结果验证了该方法的有效性，表明该网络能够实现复杂非线性系统的建模，而且建模精度高、收敛速度快。可当作复杂系统建模的一种有效手段。     

Adaptive fuzzy neural network finite-time command filtered control of n-link robotic systems with actuator saturation

The finite time tracking control of n-link robotic system is studied for model uncertainties and actuator saturation. Firstly, a smooth function and adaptive fuzzy neural network online learning algorithm are designed to address the actuator saturation and dynamic model uncertainties. Secondly, a new finite-time command filtered technique is proposed to filter the virtual control signal. The improved error compensation signal can reduce the impact of filtering errors, and the tracking errors of system quickly converge to a smaller compact set within finite time. Finally, adaptive fuzzy neural network finite-time command filtered control achieves finite-time stability through Lyapunov stability criterion. Simulation results verify the effectiveness of the proposed control.     

Design of an adaptive self-organizing fuzzy neural network controller for uncertain nonlinear chaotic systems

Though the control performances of the fuzzy neural network controller are acceptable in many previous published papers, the applications are only parameter learning in which the parameters of fuzzy rules are adjusted but the number of fuzzy rules should be determined by some trials. In this paper, a Takagi–Sugeno-Kang (TSK)-type self-organizing fuzzy neural network (TSK-SOFNN) is studied. The learning algorithm of the proposed TSK-SOFNN not only automatically generates and prunes the fuzzy rules of TSK-SOFNN but also adjusts the parameters of existing fuzzy rules in TSK-SOFNN. Then, an adaptive self-organizing fuzzy neural network controller (ASOFNNC) system composed of a neural controller and a smooth compensator is proposed. The neural controller using the TSK-SOFNN is designed to approximate an ideal controller, and the smooth compensator is designed to dispel the approximation error between the ideal controller and the neural controller. Moreover, a proportional-integral (PI) type parameter tuning mechanism is derived based on the Lyapunov stability theory, thus not only the system stability can be achieved but also the convergence of tracking error can be speeded up. Finally, the proposed ASOFNNC system is applied to a chaotic system. The simulation results verify the system stabilization, favorable tracking performance, and no chattering phenomena can be achieved using the proposed ASOFNNC system.     

Logical radial basis function networks a hybrid intelligent model for function approximation

The aim of this article is to introduce a new approach for fuzzy neural network models which can be used effectively in function approximation problems. The proposed model is introduced as an adaptive two-level fuzzy inference system. The architecture of the model is basically a two-layer network of new types of fuzzy-neurons which act as fuzzy IF–THEN rules. The model can be considered as a logical version of the Radial Basis Function networks (RBF). Genetic Algorithms have been adopted as the learning mechanism of the proposed model. Simulations show both highly nonlinear mapping and reasoning capabilities together with simpler structure and better performance when compared with classical neural networks.     

基于进化式模糊神经网络的时间序列预测系统

文章介绍了一种基于进化式模糊神经网络时间预测系统，它是一种快速自适应的局部学习模型；进化式模糊神经网络是一个特殊类型的神经网络，它能通过进化其结构和参数来容纳新的数据。文章重点介绍了网络结构、学习方法及创建、修剪、聚合规则节点的算法；实验结果表明：模糊隶属函数的个数，规则的修剪和聚合等训练参数，与网络的行为和预测结果有很重要的关系。