Integrated feature analysis and fuzzy rule-based systemidentification in a neuro-fuzzy paradigm

Most methods of fuzzy rule-based system identification (SI) either ignore feature analysis or do it in a separate phase. This paper proposes a novel neuro-fuzzy system that can simultaneously do feature analysis and SI in an integrated manner. It is a five-layered feed-forward network for realizing a fuzzy rule-based system. The second layer of the net is the most important one, which along with fuzzification of the input also learns a modulator function for each input feature. This enables online selection of important features by the network. The system is so designed that learning maintains the nonnegative characteristic of certainty factors of rules. The proposed network is tested on both synthetic and real data sets and the performance is found to be quite satisfactory. To get an "optimal" network architecture and to eliminate conflicting rules, nodes and links are pruned and then the structure is retrained. The pruned network retains almost the same level of performance as that of the original one.     

Genetic-fuzzy rule mining approach and evaluation of feature selection techniques for anomaly intrusion detection

Classification of intrusion attacks and normal network traffic is a challenging and critical problem in pattern recognition and network security. In this paper, we present a novel intrusion detection approach to extract both accurate and interpretable fuzzy IF-THEN rules from network traffic data for classification. The proposed fuzzy rule-based system is evolved from an agent-based evolutionary framework and multi-objective optimization. In addition, the proposed system can also act as a genetic feature selection wrapper to search for an optimal feature subset for dimensionality reduction. To evaluate the classification and feature selection performance of our approach, it is compared with some well-known classifiers as well as feature selection filters and wrappers. The extensive experimental results on the KDD-Cup99 intrusion detection benchmark data set demonstrate that the proposed approach produces interpretable fuzzy systems, and outperforms other classifiers and wrappers by providing the highest detection accuracy for intrusion attacks and low false alarm rate for normal network traffic with minimized number of features.     

Fuzzy rule weight modification with particle swarm optimisation

The most challenging problem in developing fuzzy rule-based classification systems is the construction of a fuzzy rule base for the target problem. In many practical applications, fuzzy sets that are of particular linguistic meanings, are often predefined by domain experts and required to be maintained in order to ensure interpretability of any subsequent inference results. However, learning fuzzy rules using fixed fuzzy quantity space without any qualification will restrict the accuracy of the resulting rules. Fortunately, adjusting the weights of fuzzy rules can help improve classification accuracy without degrading the interpretability. There have been different proposals for fuzzy rule weight tuning through the use of various heuristics with limited success. This paper proposes an alternative approach using Particle Swarm Optimisation in the search of a set of optimal rule weights, entailing high classification accuracy. Systematic experimental studies are carried out using common benchmark data sets, in comparison to popular rule based learning classifiers. The results demonstrate that the proposed approach can boost classification performance, especially when the size of the initially built rule base is relatively small, and is competitive to popular rule-based learning classifiers.     

Identification of evolving fuzzy rule-based models

An approach to identification of evolving fuzzy rule-based (eR) models is proposed. eR models implement a method for the noniterative update of both the rule-base structure and parameters by incremental unsupervised learning. The rule-base evolves by adding more informative rules than those that previously formed the model. In addition, existing rules can be replaced with new rules based on ranking using the informative potential of the data. In this way, the rule-base structure is inherited and updated when new informative data become available, rather than being completely retrained. The adaptive nature of these evolving rule-based models, in combination with the highly transparent and compact form of fuzzy rules, makes them a promising candidate for modeling and control of complex processes, competitive to neural networks. The approach has been tested on a benchmark problem and on an air-conditioning component modeling application using data from an installation serving a real building. The results illustrate the viability and efficiency of the approach.     

A new method for constructing membership functions and fuzzy rulesfrom training examples

To extract knowledge from a set of numerical data and build up a rule-based system is an important research topic in knowledge acquisition and expert systems. In recent years, many fuzzy systems that automatically generate fuzzy rules from numerical data have been proposed. In this paper, we propose a new fuzzy learning algorithm based on the alpha-cuts of equivalence relations and the alpha-cuts of fuzzy sets to construct the membership functions of the input variables and the output variables of fuzzy rules and to induce the fuzzy rules from the numerical training data set. Based on the proposed fuzzy learning algorithm, we also implemented a program on a Pentium PC using the MATLAB development tool to deal with the Iris data classification problem. The experimental results show that the proposed fuzzy learning algorithm has a higher average classification ratio and can generate fewer rules than the existing algorithm.     

Application of evolving Takagi–Sugeno fuzzy model to nonlinear system identification

In this paper, a new encoding scheme is presented for learning the Takagi–Sugeno (T–S) fuzzy model from data by genetic algorithms (GAs). In the proposed encoding scheme, the rule structure (selection of rules and number of rules), the input structure (selection of inputs and number of inputs), and the antecedent membership function (MF) parameters of the T–S fuzzy model are all represented in one chromosome and evolved together such that the optimisation of rule structure, input structure, and MF parameters can be achieved simultaneously. The performance of the developed evolving T–S fuzzy model is first validated by studying the benchmark Box–Jenkins nonlinear system identification problem and nonlinear plant modelling problem, and comparing the obtained results with other existing results. Then, it is applied to approximate the forward and inverse dynamic behaviours of a magneto-rheological (MR) damper of which identification problem is significantly difficult due to its inherently hysteretic and highly nonlinear dynamics. It is shown by the validation applications that the developed evolving T–S fuzzy model can identify the nonlinear system satisfactorily with acceptable number of rules and appropriate inputs.     

Support vector learning mechanism for fuzzy rule-based modeling: a new approach

This paper describes a fuzzy modeling framework based on support vector machine, a rule-based framework that explicitly characterizes the representation in fuzzy inference procedure. The support vector learning mechanism provides an architecture to extract support vectors for generating fuzzy IF-THEN rules from the training data set, and a method to describe the fuzzy system in terms of kernel functions. Thus, it has the inherent advantage that the model does not have to determine the number of rules in advance, and the overall fuzzy inference system can be represented as series expansion of fuzzy basis functions. The performance of the proposed approach is compared to other fuzzy rule-based modeling methods using four data sets.     

Fuzzy rule generation for adaptive scheduling in a dynamic manufacturing environment

This paper proposes a fuzzy rule-based system for an adaptive scheduling, which dynamically selects and applies the most suitable strategy according to the current state of the scheduling environment. The adaptive scheduling problem is generally considered as a classification task since the performance of the adaptive scheduling system depends on the effectiveness of the mapping knowledge between system states and the best rules for the states. A rule base for this mapping is built and evolved by the proposed fuzzy dynamic learning classifier based on the training data cumulated by a simulation method. Distributed fuzzy sets approach, which uses multiple fuzzy numbers simultaneously, is adopted to recognize the system states. The developed fuzzy rules may readily be interpreted, adopted and, when necessary, modified by human experts. An application of the proposed method to a job-dispatching problem in a hypothetical flexible manufacturing system (FMS) shows that the method can develop more effective and robust rules than the traditional job-dispatching rules and a neural network approach.     

A two-stage evolutionary process for designing TSK fuzzy rule-basedsystems

Nowadays, fuzzy rule-based systems are successfully applied to many different real-world problems. Unfortunately, relatively few well-structured methodologies exist for designing and, in many cases, human experts are not able to express the knowledge needed to solve the problem in the form of fuzzy rules. Takagi-Sugeno-Kang (TSK) fuzzy rule-based systems were enunciated in order to solve this design problem because they are usually identified using numerical data. In this paper we present a two-stage evolutionary process for designing TSK fuzzy rule-based systems from examples combining a generation stage based on a (mu, lambda)-evolution strategy, in which the fuzzy rules with different consequents compete among themselves to form part of a preliminary knowledge base, and a refinement stage in which both the antecedent and consequent parts of the fuzzy rules in this previous knowledge base are adapted by a hybrid evolutionary process composed of a genetic algorithm and an evolution strategy to obtain the final Knowledge base whose rules cooperate in the best possible way. Some aspects make this process different from others proposed until now: the design problem is addressed in two different stages, the use of an angular coding of the consequent parameters that allows us to search across the whole space of possible solutions, and the use of the available knowledge about the system under identification to generate the initial populations of the Evolutionary Algorithms that causes the search process to obtain good solutions more quickly. The performance of the method proposed is shown by solving two different problems: the fuzzy modeling of some three-dimensional surfaces and the computing of the maintenance costs of electrical medium line in Spanish towns. Results obtained are compared with other kind of techniques, evolutionary learning processes to design TSK and Mamdani-type fuzzy rule-based systems in the first case, and classical regression and neural modeling in the second.     

A calibration approach based on Takagi–Sugeno fuzzy inference system for digital electronic compasses

Recently, the development of industrial processes brought on the outbreak of technologically complex systems. This development generated the necessity of research relative to the mathematical techniques that have the capacity to deal with project complexities and validation. Fuzzy models have been receiving particular attention in the area of nonlinear systems identification and analysis due to it is capacity to approximate nonlinear behavior and deal with uncertainty. A fuzzy rule-based model suitable for the approximation of many systems and functions is the Takagi–Sugeno (TS) fuzzy model. TS fuzzy models are nonlinear systems described by a set of if then rules which gives local linear representations of an underlying system. Such models can approximate a wide class of nonlinear systems. In this paper a performance analysis of a system based on TS fuzzy inference system for the calibration of electronic compass devices is considered. The contribution of the evaluated TS fuzzy inference system is to reduce the error obtained in data acquisition from a digital electronic compass. For the reliable operation of the TS fuzzy inference system, adequate error measurements must be taken. The error noise must be filtered before the application of the TS fuzzy inference system. The proposed method demonstrated an effectiveness of 57% at reducing the total error based on considered tests.     

Fuzzy identification using fuzzy neural networks with stable learning algorithms

In general, fuzzy neural networks cannot match nonlinear systems exactly. Unmodeled dynamic leads parameters drift and even instability problem. According to system identification theory, robust modification terms must be included in order to guarantee Lyapunov stability. This paper suggests new learning laws for Mamdani and Takagi-Sugeno-Kang type fuzzy neural networks based on input-to-state stability approach. The new learning schemes employ a time-varying learning rate that is determined from input-output data and model structure. Stable learning algorithms for the premise and the consequence parts of fuzzy rules are proposed. The calculation of the learning rate does not need any prior information such as estimation of the modeling error bounds. This offer an advantage compared to other techniques using robust modification.     

Online adaptive fuzzy neural identification and control of a class of MIMO nonlinear systems

This paper presents a robust adaptive fuzzy neural controller (AFNC) suitable for identification and control of a class of uncertain multiple-input-multiple-output (MIMO) nonlinear systems. The proposed controller has the following salient features: 1) self-organizing fuzzy neural structure, i.e., fuzzy control rules can be generated or deleted automatically; 2) online learning ability of uncertain MIMO nonlinear systems; 3) fast learning speed; 4) fast convergence of tracking errors; 5) adaptive control, where structure and parameters of the AFNC can be self-adaptive in the presence of disturbances to maintain high control performance; 6) robust control, where global stability of the system is established using the Lyapunov approach. Simulation studies on an inverted pendulum and a two-link robot manipulator show that the performance of the proposed controller is superior.     

Weighted Fuzzy Interpolative Reasoning Based on Weighted Increment Transformation and Weighted Ratio Transformation Techniques

In this paper, we present a new weighted fuzzy interpolative reasoning method for sparse fuzzy rule-based systems. The proposed method uses weighted increment transformation and weighted ratio transformation techniques to handle weighted fuzzy interpolative reasoning in sparse fuzzy rule-based systems. It allows each variable that appears in the antecedent parts of fuzzy rules to associate with a weight between zero and one. Moreover, we also propose an algorithm that automatically tunes the optimal weights of the antecedent variables appearing in the antecedent parts of fuzzy rules. We also apply the proposed weighted fuzzy interpolative reasoning method to handle the truck backer-upper control problem. The proposed weighted fuzzy interpolative reasoning method performs better than the ones obtained by the traditional fuzzy inference system (2000), Huang and Shen's method (2008), and Chen and Ko's method (2008). The proposed method provides us with a useful way to deal with weighted fuzzy interpolative reasoning in sparse fuzzy rule-based systems.      

Cascade ARTMAP: integrating neural computation and symbolic knowledge processing

This paper introduces a hybrid system termed cascade adaptive resonance theory mapping (ARTMAP) that incorporates symbolic knowledge into neural-network learning and recognition. Cascade ARTMAP, a generalization of fuzzy ARTMAP, represents intermediate attributes and rule cascades of rule-based knowledge explicitly and performs multistep inferencing. A rule insertion algorithm translates if-then symbolic rules into cascade ARTMAP architecture. Besides that initializing networks with prior knowledge can improve predictive accuracy and learning efficiency, the inserted symbolic knowledge can be refined and enhanced by the cascade ARTMAP learning algorithm. By preserving symbolic rule form during learning, the rules extracted from cascade ARTMAP can be compared directly with the originally inserted rules. Simulations on an animal identification problem indicate that a priori symbolic knowledge always improves system performance, especially with a small training set. Benchmark study on a DNA promoter recognition problem shows that with the added advantage of fast learning, cascade ARTMAP rule insertion and refinement algorithms produce performance superior to those of other machine learning systems and an alternative hybrid system known as knowledge-based artificial neural network (KBANN). Also, the rules extracted from cascade ARTMAP are more accurate and much cleaner than the NofM rules extracted from KBANN.     

A GA-based method for constructing fuzzy systems directly from numerical data

A method based on the concepts of genetic algorithm (GA) and recursive least-squares method is proposed to construct a fuzzy system directly from some gathered input-output data of the discussed problem. The proposed method can find an appropriate fuzzy system with a low number of rules to approach an identified system under the condition that the constructed fuzzy system must satisfy a predetermined acceptable performance. In this method, each individual in the population is constructed to determine the number of fuzzy rules and the premise part of the fuzzy system, and the recursive least-squares method is used to determine the consequent part of the constructed fuzzy system described by this individual. Finally, three identification problems of nonlinear systems are utilized to illustrate the effectiveness of the proposed method.     

Matrix formulation of fuzzy rule-based systems

In this paper, a matrix formulation of fuzzy rule based systems is introduced. A gradient descent training algorithm for the determination of the unknown parameters can also be expressed in a matrix form for various adaptive fuzzy networks. When converting a rule-based system to the proposed matrix formulation, only three sets of linear/nonlinear equations are required instead of set of rules and an inference mechanism. There are a number of advantages which the matrix formulation has compared with the linguistic approach. Firstly, it obviates the differences among the various architectures; and secondly, it is much easier to organize data in the implementation or simulation of the fuzzy system. The formulation will be illustrated by a number of examples.     

Rule-based modeling: fast construction and optimal manipulation

This paper considers the problem of modeling an unknown system by a rule-based model constructed from measured data. In particular, we address two fundamental issues associated with the rule-based modeling: rule-base construction and rule-base manipulation. A two-step approach consisting of a principal and a refining algorithm has been suggested to extract rules from the available data set. Starting from the notion of product space clustering, we have developed three principal algorithms in which fuzzy concepts and competitive learning are utilized. A particular attention is paid to enabling the algorithms to have self-organizing capability and real-time applicability. Two algorithms have been presented for manipulating the obtained rule-base with novel data, one being a direct application of a fuzzy control algorithm and the other being an optimal algorithm in the sense of least square error with respect to an appropriately chosen cost function. Simulation results on three examples taken from function approximation, time-series prediction, and nonlinear dynamical modeling are given     

A fuzzy Petri net-based expert system and its application to damageassessment of bridges

In this paper, a fuzzy Petri net approach to modeling fuzzy rule-based reasoning is proposed to bring together the possibilistic entailment and the fuzzy reasoning to handle uncertain and imprecise information. The three key components in our fuzzy rule-based reasoning-fuzzy propositions, truth-qualified fuzzy rules, and truth-qualified fuzzy facts-can be formulated as fuzzy places, uncertain transitions, and uncertain fuzzy tokens, respectively. Four types of uncertain transitions-inference, aggregation, duplication, and aggregation-duplication transitions-are introduced to fulfil the mechanism of fuzzy rule-based reasoning. A framework of integrated expert systems based on our fuzzy Petri net, called fuzzy Petri net-based expert system (FPNES), is implemented in Java. Major features of FPNES include knowledge representation through the use of hierarchical fuzzy Petri nets, a reasoning mechanism based on fuzzy Petri nets, and transformation of modularized fuzzy rule bases into hierarchical fuzzy Petri nets. An application to the damage assessment of the Da-Shi bridge in Taiwan is used as an illustrative example of FPNES.