Neuro-f uzzy system modeling based on automatic f uzzy clustering

A neuro-fuzzy system model based on automatic fuzzy clustering is proposed. A hybrid model identification algorithm is also developed to decide the model structure and model parameters. The algorithm mainly includes three parts :1) Automatic fuzzy C-means (AFCM) , which is applied to generate fuzzy rules automatically , and then fix on the size of the neuro-fuzzy network , by which the complexity of system design is reducesd greatly at the price of the fitting capability; 2)Recursive least square estimation ( RLSE) . It is used to update the parameters of Takagi-Sugeno model , which is employed to describe the behavior of the system;3) Gradient descent algorithm is also proposed for the fuzzy values according to the back propagation algorithm of neural network. Finally ,modeling the dynamical equation of the two- link manipulator with the proposed approach is illustrated to validate the feasibility of the method.     

An efficient quantum neuro-fuzzy classifier based on fuzzy entropy and compensatory operation

In this paper, a quantum neuro-fuzzy classifier (QNFC) for classification applications is proposed. The proposed QNFC model is a five-layer structure, which combines the compensatory-based fuzzy reasoning method with the traditional Takagi–Sugeno–Kang (TSK) fuzzy model. The compensatory-based fuzzy reasoning method uses adaptive fuzzy operations of neuro-fuzzy systems that can make the fuzzy logic system more adaptive and effective. Layer 2 of the QNFC model contains quantum membership functions, which are multilevel activation functions. Each quantum membership function is composed of the sum of sigmoid functions shifted by quantum intervals. A self-constructing learning algorithm, which consists of the self-clustering algorithm (SCA), quantum fuzzy entropy and the backpropagation algorithm, is also proposed. The proposed SCA method is a fast, one-pass algorithm that dynamically estimates the number of clusters in an input data space. Quantum fuzzy entropy is employed to evaluate the information on pattern distribution in the pattern space. With this information, we can determine the number of quantum levels. The backpropagation algorithm is used to tune the adjustable parameters. The simulation results have shown that (1) the QNFC model converges quickly; (2) the QNFC model has a higher correct classification rate than other models.     

Designing neurofuzzy system based on ICART algorithm and its application for modeling jet fuel endpoint of hydrocracking process

In this paper, a neuro-fuzzy system based on improved CART algorithm (ICART) is presented, in which the ICART algorithm is used to design neuro-fuzzy system. It is worth noting that ICART algorithm partitions the input space into tree structure adaptively, which avoids the curse of dimensionality (number of rules goes up exponentially with number of input variables). Moreover, it adopts density function to construct the local model for every node in order to overcome the discontinuous boundaries existed in CART algorithm. In addition, a supervised scheme is used to adjust parameters to minimize the network output error and construct more accurate fuzzy model on the basis of the ICART algorithm. Finally, to illustrate the validity of the proposed method, a simulation research and a practical application are done. The results show that the proposed method can provide optimal model structure and parameters for fuzzy modeling, possesses high learning efficiency, and is smoother than CART algorithm. It can be successfully applied to modeling jet fuel endpoint of hydrocracking processing.     

An efficient compensatory neuro-fuzzy system and its applications

In this study, a compensatory neuro-fuzzy system (CNFS) is proposed. The compensatory fuzzy reasoning method uses adaptive fuzzy operations of a neuro-fuzzy system to make the fuzzy logic system more adaptive and effective. Furthermore, an online learning algorithm that consists of structure learning and parameter learning is proposed to automatically construct the CNFS. The structure learning is based on the fuzzy similarity measure to determine the number of fuzzy rules, and the parameter learning is based on backpropagation algorithm to adjust the parameters. The simulation results have shown that (1) the CNFS model converges quickly and (2) the CNFS model has a lower root mean square (RMS) error than other models.     

ANFIS实现的模糊神经网络在交通信号配时优化中的应用

提出一种使用Matlab中的ANFIS模糊神经网络(FNN)工具箱来对传统的模糊控制器进行参数优化的方法，改善了控制器中的隶属度函数形状及分布，并应用于城市单交叉路口的多相位信号配时上．仿真实验证明所提出的算法可以降低车辆平均延误时间，保证车队更顺畅地通过交叉路口．     

An adaptive wavelet network for function learning

In this article, a wavelet neural network (WNN) model is proposed for approximating arbitrary nonlinear functions. Our WNN model structure comes from the idea of adaptive neuro-fuzzy inference system (ANFIS) which is used for obtaining fuzzy rule base from the input–output data of an unknown function. The WNN model which is called in this study as adaptive wavelet network (AWN) consists of wavelet scaling functions in its processing units whereas in an ANFIS, mostly Gaussian-type membership functions are used for a function approximation. We present to train an AWN by a hybrid-learning method containing least square estimation (LSE) with gradient-based optimization algorithm to obtain the optimal translation and dilation parameters of our AWN for model accuracy. Simulation examples are also given to illustrate the effectiveness of the method.     

基于UKF的自适应模糊推理神经网络

如何生成最优的模糊规则数及模糊规则的自动生成和修剪是模糊神经网络训练算法研究的重点。针对这一问题,本文提出了基于UKF的自适应模糊推理神经网络(UKF-ANFIS)。首先,通过减法聚类确定UKF-ANFIS的模糊规则及其高斯隶属函数的中心和宽度参数;其次,分析了模糊神经网络的非线性动力系统表示,并用LLS和UKF分别学习线性和非线性的参数;然后,用误差下降率方法作为模糊规则修剪的策略,删除作用不大的规则;最后,通过典型的函数逼近和系统辨识实例,表明本文算法得到的模糊神经网络的结构更为紧凑,泛化性能也更佳。     

Function Approximation with Complex Neuro-Fuzzy System Using Complex Fuzzy Sets �C A New Approach

A new neuro-fuzzy computing paradigm using complex fuzzy sets is proposed in this paper. The novel computing paradigm is applied to the problem of function approximation to test its nonlinear mapping ability. A complex fuzzy set (CFS) is an extension of traditional type-1 fuzzy set whose membership is within the unit real-valued interval. For a CFS, the membership is extended to complex-valued state within the unit disc of the complex plane. For self-adaption of the proposed complex neuro-fuzzy system (CNFS), the Particle Swarm Optimization (PSO) algorithm and Recursive Least Squares Estimator (RLSE) algorithm are used in a hybrid way to adjust the free parameters of the CNFS. With the novel PSO-RLSE hybrid learning method, the CNFS parameters can be converged efficiently and quickly. By the PSO-RLSE method for the CNFS, fast learning convergence is observed and great performance in accuracy is shown. In the experimental results, the CNFS shows much better performance than its traditional neuro-fuzzy counterpart and other compared approaches. Excellent performance by the proposed approach has been shown.     

Unsupervised adaptive neural-fuzzy inference system for solving differential equations

There has been a growing interest in combining both neural network and fuzzy system, and as a result, neuro-fuzzy computing techniques have been evolved. ANFIS (adaptive network-based fuzzy inference system) model combined the neural network adaptive capabilities and the fuzzy logic qualitative approach. In this paper, a novel structure of unsupervised ANFIS is presented to solve differential equations. The presented solution of differential equation consists of two parts; the first part satisfies the initial/boundary condition and has no adjustable parameter whereas the second part is an ANFIS which has no effect on initial/boundary conditions and its adjustable parameters are the weights of ANFIS. The algorithm is applied to solve differential equations and the results demonstrate its accuracy and convince us to use ANFIS in solving various differential equations.     

Artificial wavelet neural network and its application in neuro-fuzzy models

In the proposed work, two types of artificial neural networks are proposed by using well-known advantages and valuable features of wavelets and sigmoidal activation functions. Two neurons are derived by adding and multiplying the outputs of the wavelet and the sigmoidal activation functions. These neurons in a feed-forward single hidden layer network result summation wavelet neural network (SWNN) and multiplication wavelet neural network (MWNN). An algorithm is introduced for structure determination of the proposed networks. Approximation properties of SWNN and MWNN have been evaluated with different wavelet functions. The above networks in the consequent part of the neuro-fuzzy model result summation wavelet neuro-fuzzy (SWNF) and multiplication wavelet neuro-fuzzy (MWNF) models. Different types of wavelet function are tested with the proposed networks and fuzzy models on four different dynamical examples. Convergence of the learning process is also guaranteed by adaptive learning rate and performing stability analysis using Lyapunov function.     

基于模糊超球的模糊神经网络初始参数设定

在人们常用到的模糊神经学习算法中很少讨论如何设置并调整初始的权值参数,这样就会影响模糊神经学习算法的准确度,使得目标函数值很大。虽然在改进的模糊神经学习算法中使用模糊C均值聚类方法来确定模糊规则的初始参数,但是这种方法必须已知模式集的数目,这就限制了模糊神经网络的应用范围。因此,将模糊超球神经网络的思想与模糊神经网络有机的结合起来,通过不断调整超球的中心和半径以及超球的数目,优化模式集的边界,来确定权值参数,利用这种方法确定初始参数可以减小误差,提高算法的准确度,使目标函数值减小。     

基于模糊超球的模糊神经网络初始参数设定

在人们常用到的模糊神经学习算法中很少讨论如何设置并调整初始的权值参数，这样就会影响模糊神经学习算法的准确度。使得目标函数值很大。虽然在改进的模糊神经学习算法中使用模糊C均值聚类方法来确定模糊规则的初始参数。但是这种方法必须已知模式集的数目，这就限制了模糊神经网络的应用范围。因此，将模糊超球神经网络的思想与模糊神经网络有机的结合起来，通过不断调整超球的中心和半径以及超球的数目，优化模式集的边界，来确定权值参数，利用这种方法确定初始参数可以减小误差，提高算法的准确度，使目标函数值减小。     

Three new fuzzy neural networks learning algorithms based on clustering, training error and genetic algorithm

Three new learning algorithms for Takagi-Sugeno-Kang fuzzy system based on training error and genetic algorithm are proposed. The first two algorithms are consisted of two phases. In the first phase, the initial structure of neuro-fuzzy network is created by estimating the optimum points of training data in input-output space using KNN (for the first algorithm) and Mean-Shift methods (for the second algorithm) and keeps adding new neurons based on an error-based algorithm. Then in the second phase, redundant neurons are recognized and removed using a genetic algorithm. The third algorithm then builds the network in one phase using a modified version of error algorithm used in the first two methods. The KNN method is shown to be invariant to parameter K in KNN algorithm and in two simulated examples outperforms other neuro-fuzzy approaches in both performance and network compactness.     

An IV-QR Algorithm for Neuro-Fuzzy Multivariable Online Identification

In this paper, a new algorithm for neuro-fuzzy identification of multivariable discrete-time nonlinear dynamic systems, more specifically applied to consequent parameters estimation of the neuro-fuzzy inference system, is proposed based on a decomposed form as a set of coupled multiple input and single output (MISO) Takagi-Sugeno (TS) neuro-fuzzy networks. An on-line scheme is formulated for modeling a nonlinear autoregressive with exogenous input (NARX) recurrent neuro-fuzzy structure from input-output samples of a multivariable nonlinear dynamic system in a noisy environment. The adaptive weighted instrumental variable (WIV) algorithm by QR factorization based on the numerically robust orthogonal Householder transformation is developed to modify the consequent parameters of the TS multivariable neuro-fuzzy network     

A neuro-fuzzy system modeling with self-constructing rule generationand hybrid SVD-based learning

We propose an approach for neuro-fuzzy system modeling. A neuro-fuzzy system for a given set of input-output data is obtained in two steps. First, the data set is partitioned automatically into a set of clusters based on input-similarity and output-similarity tests. Membership functions associated with each cluster are defined according to statistical means and variances of the data points included in the cluster. Then, a fuzzy IF-THEN rule is extracted from each cluster to form a fuzzy rule-base. Second, a fuzzy neural network is constructed accordingly and parameters are refined to increase the precision of the fuzzy rule-base. To decrease the size of the search space and to speed up the convergence, we develop a hybrid learning algorithm which combines a recursive singular value decomposition-based least squares estimator and the gradient descent method. The proposed approach has advantages of determining the number of rules automatically and matching membership functions closely with the real distribution of the training data points. Besides, it learns faster, consumes less memory, and produces lower approximation errors than other methods.     

An investigation of neuro-fuzzy systems in psychosomatic disorders

A neuro-fuzzy model for diagnosis of psychosomatic disorders is proposed in this paper. The symptoms and signs are collected from the patients through oral interview. For the linguistic nature of patient's inputs, an artificial domain is created and fuzzy membership values are defined. The fuzzy values are fed as inputs to feedforward multilayer neural network. The network is trained using Backpropagation training algorithm. The trained model is tested with new patient's symptoms and signs. Further, the performance of the diagnosing capability is compared with medical expert. The performance of the model is also compared with probability model based on Bayesian Belief Network and statistical model using Linear Discriminant analysis     

Artificial wavelet neuro-fuzzy model based on parallel wavelet network and neural network

From the well-known advantages and valuable features of wavelets when used in neural network, two type of networks (i.e., SWNN and MWNN) have been proposed. These networks are single hidden layer network. Each neuron in the hidden layer is comprised of wavelet and sigmoidal activation functions. First model is derived from adding the outputs of wavelet and sigmoidal activation functions, while in the second model outputs of wavelet and sigmoidal activation function are multiplied together. Using these proposed networks in consequent part of the neuro-fuzzy model, which result summation wavelet neuro-fuzzy and multiplication wavelet neuro-fuzzy models, are also proposed. Different types of wavelet function are tested with proposed networks and fuzzy models on four different types of examples. Convergence of the learning process is also guaranteed by performing stability analysis using Lyapunov function.     

混合神经模糊分类器的实现

人工神经网络与模糊系统是计算智能的核心内容,二者的混合系统是近年来的一个研究热点。分类是数据分析中的研究重点,随着数据的复杂化和多样化,对分类的要求越来越高,有时仅凭经验和专业知识难以确切地进行分类,因此研究如何运用神经模糊分类算法进行数据分析具有重要意义与实用价值。鉴于其强大的数据分析功能,研究中采用模糊C均值聚类算法和Gath—Geva聚类算法对数据进行分类,并对测试数据进行仿真试验,其测试结果良好。     

Neuro-fuzzy position control of demining tele-operation system based on RNN modeling

The paper considers the neuro-fuzzy position control of multi-finger robot hand in tele-operation system—an active master–slave hand system (MSHS) for demining. Recently, fuzzy control systems utilizing artificial intelligent techniques are also being actively investigated in robotic area. Neural network with their powerful learning capability are being sought as the basis for many adaptive control systems where on-line adaptation can be implemented. Fuzzy logic on the other hand has been proved to be rather popular in many control system applications providing a rule-base like structure. In this paper, the design and optimization process of fuzzy position controller is supported by learning techniques derived from neural network where a radial basis function (RBF) neural network is implemented to learn fuzzy rules and membership functions with predictor of recurrent neural network (RNN) model. The results of experiment show that based on the predictive capability of RNN model neuro-fuzzy controller with good adaptation and robustness capability can be designed.     

一种基于模糊神经网络的故障分类器及其在多传感器故障诊断中的应用􀀁

提出了一种应用模糊神经网络进行故障诊断新方法．采用模糊神经网络作为故障分类器,离线地自适应从学习样本数据中提取各个用以描述故障状态的模糊参考模型．在诊断时,此模糊神经网络在线地得到当前系统的模糊模型描述,并将与各个参考模型相匹配,从而得出正确的诊断结果．它适用范围广泛,如用于控制系统的过程对象以及传感器、执行器故障的检测与诊断．通过对燃汽轮机控制系统多传感器故障诊断的仿真证明了此法的有效性和优越性．