POPFNN-CRI(S): pseudo outer product based fuzzy neural network using the compositional rule of inference and singleton fuzzifier

A pseudo-outer product based fuzzy neural network using the compositional rule of inference and singleton fuzzifier [POPFNN-CRI(S)] is proposed in this paper. The correspondence of each layer in the proposed POPFNN-CRI(S) to the compositional rule of inference using standard T-norm and fuzzy relation gives it a strong theoretical foundation. The proposed POPFNN-CRI(S) training consists of two phases; namely: the fuzzy membership derivation phase using the novel fuzzy Kohonen partition (FKP) and pseudo Kohonen partition (PFKP) algorithms, and the rule identification phase using the novel one-pass POP learning algorithm. The proposed two-phase learning process effectively constructs the membership functions and identifies the fuzzy rules. Extensive experimental results based on the classification performance of the POPFNN-CRI(S) using the Anderson's Iris data are presented for discussion. Results show that the POPFNN-CRI(S) has taken only 15 training iterations and misclassify only three out of all the 150 patterns in the Anderson's Iris data.     

Rule-based multi-FNN identification with the aid of evolutionary fuzzy granulation

In this paper, we introduce a category of Multi-Fuzzy-Neural Networks (Multi-FNNs) models, analyze the underlying architectures and propose a comprehensive identification framework. The proposed Multi-FNNs are based on a concept of fuzzy rule-based FNNs that use H ard C-M eans (HCM) clustering and evolutionary fuzzy granulation and exploit linear inference being treated as a generic inference mechanism of approximate reasoning. By this nature, this FNN model is geared toward capturing relationships between information granules–fuzzy sets. The form of the information granules themselves (in particular their distribution and a type of membership functions) becomes an important design feature of the FNN model that contributes to its structural and parametric optimization. The genetically guided global optimization is then augmented by more refined gradient-based learning mechanisms such as a standard back-propagation. The HCM algorithm, whose role is to carry out preprocessing of the experimental data, is utilized to determine the structure of Multi-FNNs. The detailed parameters of the Multi-FNN (such as apexes of membership functions, learning rates, and momentum coefficients) are adjusted using genetic algorithms. The proposed aggregate performance index helps achieve a sound balance between approximation and generalization (predictive) abilities of the model. To evaluate an effectiveness of the introduced model, several numeric data sets are experimented with. Those include a time-series data of gas furnace, NOx emission process of gas turbine power plant and some synthetic data.     

Genetic tuning of fuzzy inference within fuzzy classifier systems

Abstract: In generating a suitable fuzzy classifier system, significant effort is often placed on the determination and the fine tuning of the fuzzy sets. However, in such systems little thought is given to the way in which membership functions are combined within the fuzzy rules. Often traditional fuzzy inference strategies are used which consequently provide no control over how strongly or weakly the inference is applied within these rules. Furthermore such strategies will allow no interaction between grades of membership. A number of theoretical fuzzy inference operators have been proposed for both regression and classification problems but they have not been investigated in the context of real-world applications. In this paper we propose a novel genetic algorithm framework for optimizing the strength of fuzzy inference operators concurrently with the tuning of membership functions for a given fuzzy classifier system. Each fuzzy system is generated using two well-established decision tree algorithms: C4.5 and CHAID. This will enable both classification and regression problems to be addressed within the framework. Each solution generated by the genetic algorithm will produce a set of fuzzy membership functions and also determine how strongly the inference will be applied within each fuzzy rule. We investigate several theoretical proven fuzzy inference techniques (T-norms) in the context of both classification and regression problems. The methodology proposed is applied to a number of real-world data sets in order to determine the effects of the simultaneous tuning of membership functions and inference parameters on the accuracy and robustness of fuzzy classifiers.     

A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning

This paper proposes a self-evolving interval type-2 fuzzy neural network (SEIT2FNN) with online structure and parameter learning. The antecedent parts in each fuzzy rule of the SEIT2FNN are interval type-2 fuzzy sets and the fuzzy rules are of the Takagi–Sugeno–Kang (TSK) type. The initial rule base in the SEIT2FNN is empty, and the online clustering method is proposed to generate fuzzy rules that flexibly partition the input space. To avoid generating highly overlapping fuzzy sets in each input variable, an efficient fuzzy set reduction method is also proposed. This method independently determines whether a corresponding fuzzy set should be generated in each input variable when a new fuzzy rule is generated. For parameter learning, the consequent part parameters are tuned by the rule-ordered Kalman filter algorithm for high-accuracy learning performance. Detailed learning equations on applying the rule-ordered Kalman filter algorithm to the SEIT2FNN consequent part learning, with rules being generated online, are derived. The antecedent part parameters are learned by gradient descent algorithms. The SEIT2FNN is applied to simulations on nonlinear plant modeling, adaptive noise cancellation, and chaotic signal prediction. Comparisons with other type-1 and type-2 fuzzy systems in these examples verify the performance of the SEIT2FNN.      

新型模糊神经网络模型

分析了已有模糊神经网络模型结构与学习算法的特点,针对它们收敛速度慢、全局逼近能力差等不足,提出了一种新型的模糊神经网络模型,其在模糊化层实现了隶属函数的合成,且结构简单、推理层只有两个节点。实验结果表明该模型具有收敛速度快、全局逼近能力强的优点,具有一定的实用价值。     

Fuzzy classifications using fuzzy inference networks

In this paper, fuzzy inference models for pattern classifications have been developed and fuzzy inference networks based on these models are proposed. Most of the existing fuzzy rule-based systems have difficulties in deriving inference rules and membership functions directly from training data. Rules and membership functions are obtained from experts. Some approaches use backpropagation (BP) type learning algorithms to learn the parameters of membership functions from training data. However, BP algorithms take a long time to converge and they require an advanced setting of the number of inference rules. The work to determine the number of inference rules demands lots of experiences from the designer. In this paper, self-organizing learning algorithms are proposed for the fuzzy inference networks. In the proposed learning algorithms, the number of inference rules and the membership functions in the inference rules will be automatically determined during the training procedure. The learning speed is fast. The proposed fuzzy inference network (FIN) classifiers possess both the structure and the learning ability of neural networks, and the fuzzy classification ability of fuzzy algorithms. Simulation results on fuzzy classification of two-dimensional data are presented and compared with those of the fuzzy ARTMAP. The proposed fuzzy inference networks perform better than the fuzzy ARTMAP and need less training samples.     

Efficient learning algorithms for three-layer regular feedforward fuzzy neural networks

A key step of using gradient descend methods to develop learning algorithms of a regular feedforward fuzzy neural network (FNN) is to differentiate max-min functions, which contain max(/spl or/) and min(/spl and/) operations. The paper aims at several objectives. First, investigate further the differentiation of /spl or/-/spl and/ functions. Second, employ general fuzzy numbers, which include triangular and trapezoidal fuzzy numbers as special cases to define a three-layer regular FNN. The general fuzzy numbers related can be approximately determined by their corresponding finite level sets. So, we can approximately represent the input-output (I/O) relationship of the regular FNN as functions of the endpoints of all finite level sets. Third, a fuzzy back-propagation algorithm is presented. And to speed up the convergence of the learning algorithm, a fuzzy conjugate gradient algorithm for fuzzy weights and biases is developed, furthermore, the convergence of the algorithm is analyzed, systematically. Finally, some real simulations demonstrate the efficiency of our learning algorithms. The regular FNN is applied to the approximate realization of fuzzy inference rules and fuzzy functions defined on given compact sets.     

基于模糊kohonen聚类网络的改进算法

模糊kohonen聚类神经网络将模糊隶属度概念应用于一般Kohonen聚类网络的学习和更新策略中,改善了Kohonen聚类网络的性能,是一种快速有效的聚类网络.但在死神经元的处理和收敛速度上还有改进的空间.为了能使网络更好应用于海量数据的聚类问题,对模糊Kohonen聚类网络算法在输出神经元的模糊偏置度、侧抑制模糊隶属度和加权系数提出了三方面改进.同时,对改进的模糊Kohonen聚类网络的有效性进行实例仿真,仿真结果体现了改进算法能有效避免死神经元的出现和提高了网络的聚类速度.     

Tuning certainty factor and local weight of fuzzy production rulesby using fuzzy neural network

Approximate reasoning in a fuzzy system is concerned with inferring an approximate conclusion from fuzzy and vague inputs. There are many ways in which different forms of conclusions can be drawn. Fuzzy sets are usually represented by fuzzy membership functions. These membership functions are assumed to have a clearly defined base. For other fuzzy sets such as intelligent, smart, or beautiful, etc., it would be difficult to define clearly its base because its base may consist of several other fuzzy sets or unclear nonfuzzy bases. A method to handle this kind of fuzzy set is proposed. A fuzzy neural network (FNN) is also proposed to tune knowledge representation parameters (KRPs). The contributions are that we are able to handle a broader range of fuzzy sets and build more powerful fuzzy systems so that the conclusions drawn are more meaningful, reliable, and accurate. An experiment is presented to demonstrate how our method works.     

SoHyFIS-Yager: A self-organizing Yager based Hybrid neural Fuzzy Inference System

The Hybrid neural Fuzzy Inference System (HyFIS) is a multilayer adaptive neural fuzzy system for building and optimizing fuzzy models using neural networks. In this paper, the fuzzy Yager inference scheme, which is able to emulate the human deductive reasoning logic, is integrated into the HyFIS model to provide it with a firm and intuitive logical reasoning and decision-making framework. In addition, a self-organizing gaussian Discrete Incremental Clustering (gDIC) technique is implemented in the network to automatically form fuzzy sets in the fuzzification phase. This clustering technique is no longer limited by the need to have prior knowledge about the number of clusters present in each input and output dimensions. The proposed self-organizing Yager based Hybrid neural Fuzzy Inference System (SoHyFIS-Yager) introduces the learning power of neural networks to fuzzy logic systems, while providing linguistic explanations of the fuzzy logic systems to the connectionist networks. Extensive simulations were conducted using the proposed model and its performance demonstrates its superiority as an effective neuro-fuzzy modeling technique.     

FKCN优化的RBF神经网络

ＦＫＣＮ（Ｆｕｚｚｙ Ｋｏｈｏｎｅｎ ｃｌｕｓｔｅｒ ｎｅｔｗ ｏｒｋ）将模糊隶属度的概念用于Ｋｏｈｏｎｅｎ 神经网络的学习和更新策略中,改善了Ｋｏｈｏｎｅｎ 网络的性能,是一种更为快速有效的聚类网络。作者将ＦＫＣＮ用于优化ＲＢＦ（Ｒａｄｉａｌｂａｓｉｃ ｆｕｎｃｔｉｏｎ）神经网络基函数的中心,并将优化后的ＲＢＦ网络用于曲线拟合和非线性时间序列预测,同时与基于Ｃ－ＭＥＡＮＳ的ＲＢＦ网络进行比较。实验结果表明：采用ＦＫＣＮ优化的ＲＢＦ网络具有更好的拟合和预测能力,尤其在曲线拟合实验中,ＦＫＣＮ优化的ＲＢＦ网络可以达到最小学习误差,比Ｃ－ＭＥＡＮＳ的网络小一个数量级,可见用ＦＫＣＮ优化ＲＢＦ神经网络可以较好地提高ＲＢＦ神经网络的性能。     

Fault Diagnosis Based on the Fuzzy‐Recurrent Neural Network

A fuzzy‐recurrent neural network (FRNN) has been constructed by adding some feedback connections to a feedforward fuzzy neural network (FNN). The FRNN expands the modeling ability of a FNN in order to deal with temporal problems. A basic concept of the FRNN is first to use process or expert knowledge, including appropriate fuzzy logic rules and membership functions, to construct an initial structure and to then use parameter‐learning algorithms to fine‐tune the membership functions and other parameters. Its recurrent property makes it suitable for dealing with temporal problems, such as on‐line fault diagnosis. In addition, it also provides human‐understandable meaning to the normal feedforward multilayer neural network, in which the internal units are always opaque to users. In a word, the trained FRNN has good interpreting ability and one‐step‐ahead predicting ability. To demonstrate the performance of the FRNN in diagnosis, a comparison is made with a conventional feedforward network. The efficiency of the FRNN is verified by the results.     

模糊Kohonen网络在烟叶分类中的应用

对于分类问题的处理有很多经典方法，但近年来因为人们对神经网络理论及其应用的重视，使得Kononen网络(KN)趟来越受到普遍关注。该文利用模糊控制策略将模糊。均值算法与经典的Kolloncn算法有机地结合起来，使网络性能到了，很大改善。     

Falcon: neural fuzzy control and decision systems using FKP and PFKP clustering algorithms.

Neural fuzzy networks proposed in the literature can be broadly classified into two groups. The first group is essentially fuzzy systems with self-tuning capabilities and requires an initial rule base to be specified prior to training. The second group of neural fuzzy networks, on the other hand, is able to automatically formulate the fuzzy rules from the numerical training data. Examples are the Falcon-ART, and the POPFNN family of networks. A cluster analysis is first performed on the training data and the fuzzy rules are subsequently derived through the proper connections of these computed clusters. This correspondence proposes two new networks: Falcon-FKP and Falcon-PFKP. They are extensions of the Falcon-ART network, and aimed to overcome the shortcomings faced by the Falcon-ART network itself, i.e., poor classification ability when the classes of input data are very similar to each other, termination of training cycle depends heavily on a preset error parameter, the fuzzy rule base of the Falcon-ART network may not be consistent Nauck, there is no control over the number of fuzzy rules generated, and learning efficiency may deteriorate by using complementarily coded training data. These deficiencies are essentially inherent to the fuzzy ART, clustering technique employed by the Falcon-ART network. Hence, two clustering techniques--Fuzzy Kohonen Partitioning (FKP) and its pseudo variant PFKP, are synthesized with the basic Falcon structure to compute the fuzzy sets and to automatically derive the fuzzy rules from the training data. The resultant neural fuzzy networks are Falcon-FKP and Falcon-PFKP, respectively. These two proposed networks have a lean and efficient training algorithm and consistent fuzzy rule bases. Extensive simulations are conducted using the two networks and their performances are encouraging when benchmarked against other neural and neural fuzzy systems.     

基于快速模糊规则搜索的快速模糊系统建模

本文提出了一种基于快速模糊规则搜索的快速模糊系统建模方法,首先使用本文提出的快速模糊规则搜索方法进行模糊规则的粗略搜索,然后基于所得到的模糊规则集建立模糊神经网络模型,即利用规则前件确定网络结构,规则后件初始化部分网络权值。使用遗传算法对网络模型的权值和阈值进行学习训练。实验结果验证了快速模糊系统建模方法在描述较大规模非线形系统中的实用性和有效性。     

Type-1 and type-2 fuzzy inference systems as integration methods in modular neural networks for multimodal biometry and its optimization with genetic algorithms

We describe in this paper a comparative study between fuzzy inference systems as methods of integration in modular neural networks for multimodal biometry. These methods of integration are based on techniques of type-1 fuzzy logic and type-2 fuzzy logic. Also, the fuzzy systems are optimized with simple genetic algorithms with the goal of having optimized versions of both types of fuzzy systems. First, we considered the use of type-1 fuzzy logic and later the approach with type-2 fuzzy logic. The fuzzy systems were developed using genetic algorithms to handle fuzzy inference systems with different membership functions, like the triangular, trapezoidal and Gaussian; since these algorithms can generate fuzzy systems automatically. Then the response integration of the modular neural network was tested with the optimized fuzzy systems of integration. The comparative study of the type-1 and type-2 fuzzy inference systems was made to observe the behavior of the two different integration methods for modular neural networks for multimodal biometry.     

Support-vector-based fuzzy neural network for pattern classification

Fuzzy neural networks (FNNs) for pattern classification usually use the backpropagation or C-cluster type learning algorithms to learn the parameters of the fuzzy rules and membership functions from the training data. However, such kinds of learning algorithms usually cannot minimize the empirical risk (training error) and expected risk (testing error) simultaneously, and thus cannot reach a good classification performance in the testing phase. To tackle this drawback, a support-vector-based fuzzy neural network (SVFNN) is proposed for pattern classification in this paper. The SVFNN combines the superior classification power of support vector machine (SVM) in high dimensional data spaces and the efficient human-like reasoning of FNN in handling uncertainty information. A learning algorithm consisting of three learning phases is developed to construct the SVFNN and train its parameters. In the first phase, the fuzzy rules and membership functions are automatically determined by the clustering principle. In the second phase, the parameters of FNN are calculated by the SVM with the proposed adaptive fuzzy kernel function. In the third phase, the relevant fuzzy rules are selected by the proposed reducing fuzzy rule method. To investigate the effectiveness of the proposed SVFNN classification, it is applied to the Iris, Vehicle, Dna, Satimage, Ijcnn1 datasets from the UCI Repository, Statlog collection and IJCNN challenge 2001, respectively. Experimental results show that the proposed SVFNN for pattern classification can achieve good classification performance with drastically reduced number of fuzzy kernel functions.     

A general model for statistical analysis using fuzzy sets: Sufficient conditions for identifiability and statistical properties

Fuzzy sets and fuzzy state modeling require modifications of fundamental principles of statistical estimation and inference. These modifications trade increased computational effort for greater generality of data representation. For example, multivariate discrete response data of high (but finite) dimensionality present the problem of analyzing large numbers of cells with low event counts due to finite sample size. It would be useful to have a model based on an invariant metric to represent such data parsimoniously with a latent “smoothed” or low dimensional parametric structure. Determining the parameterization of such a model is difficult since multivariate normality (i.e., that all significant information is represented in the second order moments matrix), an assumption often used in fitting the most common types of latent variable models, is not appropriate. We present a fuzzy set model to analyze high dimensional categorical data where a metric for grades of membership in fuzzy sets is determined by latent convex sets, within which moments up to order J of a discrete distribution can be represented. The model, based on a fuzzy set parameterization, can be shown, using theorems on convex polytopes [1], to be dependent on only the enclosing linear space of the convex set. It is otherwise measure invariant. We discuss the geometry of the model's parameter space, the relation of the convex structure of model parameters to the dual nature of the case and variable spaces, how that duality relates to describing fuzzy set spaces, and modified principles of estimation.     

Discrete Interval Type 2 Fuzzy System Models Using Uncertainty in Learning Parameters

Fuzzy system modeling (FSM) is one of the most prominent tools that can be used to identify the behavior of highly nonlinear systems with uncertainty. Conventional FSM techniques utilize type 1 fuzzy sets in order to capture the uncertainty in the system. However, since type 1 fuzzy sets express the belongingness of a crisp value x' of a base variable x in a fuzzy set A by a crisp membership value mu_A(x'), they cannot fully capture the uncertainties due to imprecision in identifying membership functions. Higher types of fuzzy sets can be a remedy to address this issue. Since, the computational complexity of operations on fuzzy sets are increasing with the increasing type of the fuzzy set, the use of type 2 fuzzy sets and linguistic logical connectives drew a considerable amount of attention in the realm of fuzzy system modeling in the last two decades. In this paper, we propose a black-box methodology that can identify robust type 2 Takagi-Sugeno, Mizumoto and Linguistic fuzzy system models with high predictive power. One of the essential problems of type 2 fuzzy system models is computational complexity. In order to remedy this problem, discrete interval valued type 2 fuzzy system models are proposed with type reduction. In the proposed fuzzy system modeling methods, fuzzy C-means (FCM) clustering algorithm is used in order to identify the system structure. The proposed discrete interval valued type 2 fuzzy system models are generated by a learning parameter of FCM, known as the level of membership, and its variation over a specific set of values which generate the uncertainty associated with the system structure