Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms

A novel hybrid learning algorithm based on a genetic algorithm to design a growing fuzzy neural network, named self-organizing fuzzy neural network based on genetic algorithms (SOFNNGA), to implement Takagi-Sugeno (TS) type fuzzy models is proposed in this paper. A new adding method based on geometric growing criterion and the epsiv-completeness of fuzzy rules is first used to generate the initial structure. Then a hybrid algorithm based on genetic algorithms, backpropagation, and recursive least squares estimation is used to adjust all parameters including the number of fuzzy rules. This has two steps: First, the linear parameter matrix is adjusted, and second, the centers and widths of all membership functions are modified. The GA is introduced to identify the least important neurons, i.e., the least important fuzzy rules. Simulations are presented to illustrate the performance of the proposed algorithm     

Learning polynomial feedforward neural networks by genetic programming and backpropagation

This paper presents an approach to learning polynomial feedforward neural networks (PFNNs). The approach suggests, first, finding the polynomial network structure by means of a population-based search technique relying on the genetic programming paradigm, and second, further adjustment of the best discovered network weights by an especially derived backpropagation algorithm for higher order networks with polynomial activation functions. These two stages of the PFNN learning process enable us to identify networks with good training as well as generalization performance. Empirical results show that this approach finds PFNN which outperform considerably some previous constructive polynomial network algorithms on processing benchmark time series.     

Various hybrid methods based on genetic algorithm with fuzzy logic controller

In this paper we propose several efficient hybrid methods based on genetic algorithms and fuzzy logic. The proposed hybridization methods combine a rough search technique, a fuzzy logic controller, and a local search technique. The rough search technique is used to initialize the population of the genetic algorithm (GA), its strategy is to make large jumps in the search space in order to avoid being trapped in local optima. The fuzzy logic controller is applied to dynamically regulate the fine-tuning structure of the genetic algorithm parameters (crossover ratio and mutation ratio). The local search technique is applied to find a better solution in the convergence region after the GA loop or within the GA loop. Five algorithms including one plain GA and four hybrid GAs along with some conventional heuristics are applied to three complex optimization problems. The results are analyzed and the best hybrid algorithm is recommended.     

嵌套式模糊自适应遗传算法

针对简单遗传算法(SGA)收敛速度慢和早熟收敛现象,将模糊逻辑理论应用于遗传算法,并采用两级嵌套的遗传算法,随主遗传算法GA1求解优化问题的进化进程用模糊控制的方法自适应地调整遗传算法的交叉概率和变异概率;利用另一个遗传算法GA2优化模糊规则库,实现了一种嵌套式模糊自适应遗传算法(NFAGA)。仿真结果表明,这种算法的全局搜索收敛速度和解的质量明显优于SGA和一般的自适应遗传算法(AGA)。     

Fuzzy multiple objective optimal system design by hybrid genetic algorithm

In this paper, we propose a method for solving fuzzy multiple objective optimal system design problems with GUB structure by hybridized genetic algorithms (HGA). This approach enables the flexible optimal system design by applying fuzzy goals and fuzzy constraints. In this genetic algorithm (GA), we propose the new chromosomes representation that represents the GUB structure simply and effectively at the same time. Also, by introducing the HGA that combine the proposed heuristic algorithm that makes use of the peculiarity of GUB structure to GA, the proposed approach is efficient than the previous method in finding solution.     

Algorithms and networks for accelerated convergence of adaptive LDA

We introduce and discuss new accelerated algorithms for linear discriminant analysis (LDA) in unimodal multiclass Gaussian data. These algorithms use a variable step size, optimally computed in each iteration using (i) the steepest descent, (ii) conjugate direction, and (iii) Newton-Raphson methods in order to accelerate the convergence of the algorithm. Current adaptive methods based on the gradient descent optimization technique use a fixed or a monotonically decreasing step size in each iteration, which results in a slow convergence rate. Furthermore, the convergence of these algorithms depends on appropriate choices of the step sizes. The new algorithms have the advantage of automatic optimal selection of the step size using the current data samples. Based on the new adaptive algorithms, we present self-organizing neural networks for adaptive computation of Σ^-1/2 and use them in cascaded form with a PCA network for LDA. Experimental results demonstrate fast convergence and robustness of the new algorithms and justify their advantages for on-line pattern recognition applications with stationary and non-stationary multidimensional input data.     

在线知识获得智能模糊控制器研究

对一些复杂的系统。传统PID或模糊控制很难得到满意控制效果，本文提出采用基于RBF神经网络和遗传算法的自适应模糊控制器来进行控制。由遗传算法在线优化模糊控制器的比例因子、模糊推理规则和隶属函数。并由RBF网络辨识被控对象的动态特性，以评价模糊控制器控制性能。仿真实验表明。优化后的Fuzzy控制器具有较强的学习和自适应控制能力，控制效果优于没有寻优的Fuzzy控制。     

简化的广义多层感知机模型及其学习算法

提出了简化的广义多层感知机模型(SGMLP模型)，并针对SGMLP模型给出了两种学习算法：广义误差反向传播算法(GBP算法)和基于遗传算法(GA)的学习算法。两个典型算例的实验结果表明，该模型及其学习算法是可行和有效的。     

模糊逻辑系统的GA+BP混合学习算法

提出一种在GA中融入BP算法的混合学习算法以实现模糊逻辑系统的自学习,利用遗传算法的全局最优性在大范围内搜索可能的极值,而用BP算法的误差梯度下降特性在极值点附近的快速搜索,从而达到了全局最优与快速搜索的有机结合,仿真结果表明,这种混合算法的学习效率无论是相对于GA还是BP均有显著提高。     

A polynomial fuzzy neural network for modeling and control

This paper introduces a novel neurofuzzy system based on polynomial fuzzy neural network (PFNN) architecture. A PFNN consists of a set of if-then rules with appropriate membership functions (MFs) whose parameters are optimized via a hybrid genetic algorithm. A polynomial neural network is employed in the defuzzification scheme to improve output performance and to select appropriate rules. A performance criterion for model selection is defined to overcome the overfitting problem in the modeling procedure. For a performance assessment of the PFNN inference system, two well-known problems are employed for a comparison with other methods. The results of these comparisons show that the PFNN inference system out-performs the other methods and exhibits robustness characteristics. This work was presented in part at the Fourth International Symposium on Artificial Life and Robotics, Oita, Japan, January 19–22, 1999     

Combination of online clustering and Q-value based GA for reinforcement fuzzy system design

This paper proposes a combination of online clustering and Q-value based genetic algorithm (GA) learning scheme for fuzzy system design (CQGAF) with reinforcements. The CQGAF fulfills GA-based fuzzy system design under reinforcement learning environment where only weak reinforcement signals such as "success" and "failure" are available. In CQGAF, there are no fuzzy rules initially. They are generated automatically. The precondition part of a fuzzy system is online constructed by an aligned clustering-based approach. By this clustering, a flexible partition is achieved. Then, the consequent part is designed by Q-value based genetic reinforcement learning. Each individual in the GA population encodes the consequent part parameters of a fuzzy system and is associated with a Q-value. The Q-value estimates the discounted cumulative reinforcement information performed by the individual and is used as a fitness value for GA evolution. At each time step, an individual is selected according to the Q-values, and then a corresponding fuzzy system is built and applied to the environment with a critic received. With this critic, Q-learning with eligibility trace is executed. After each trial, GA is performed to search for better consequent parameters based on the learned Q-values. Thus, in CQGAF, evolution is performed immediately after the end of one trial in contrast to general GA where many trials are performed before evolution. The feasibility of CQGAF is demonstrated through simulations in cart-pole balancing, magnetic levitation, and chaotic system control problems with only binary reinforcement signals.     

MAGAD-BFS: A learning method for Beta fuzzy systems based on a multi-agent genetic algorithm

This paper proposes a learning method for Beta fuzzy systems (BFS) based on a multiagent genetic algorithm. This method, called Multi-Agent Genetic Algorithm for the Design of BFS has two advantages. First, thanks to genetic algorithms (GA) efficiency, it allows to design a suitable and precise model for BFS. Second, it improves the GA convergence by reducing rule complexity thanks to the distributed implementation by multi-agent approach. Dynamic agents interact to provide an optimal solution in order to obtain the best BFS reaching the balance interpretability-precision. The performance of the method is tested on a simulated example.     

一种新型的基于遗传算法的进化模糊推理系统

介绍了遗传算法和进化模糊推理系统的融合方式及结构，应用一种新型的基于遗传算法的进化模糊推理系统动态自适应的在线学习和离线学习。使用进化聚类方法，模糊规则在系统执行过程中进行创建和更新，并且采用遗传算法优化进化聚类的结果，修改成员的隶属度函数，通过模糊推理系统计算系统的输出。     

Efficient learning algorithms for three-layer regular feedforward fuzzy neural networks

A key step of using gradient descend methods to develop learning algorithms of a regular feedforward fuzzy neural network (FNN) is to differentiate max-min functions, which contain max(/spl or/) and min(/spl and/) operations. The paper aims at several objectives. First, investigate further the differentiation of /spl or/-/spl and/ functions. Second, employ general fuzzy numbers, which include triangular and trapezoidal fuzzy numbers as special cases to define a three-layer regular FNN. The general fuzzy numbers related can be approximately determined by their corresponding finite level sets. So, we can approximately represent the input-output (I/O) relationship of the regular FNN as functions of the endpoints of all finite level sets. Third, a fuzzy back-propagation algorithm is presented. And to speed up the convergence of the learning algorithm, a fuzzy conjugate gradient algorithm for fuzzy weights and biases is developed, furthermore, the convergence of the algorithm is analyzed, systematically. Finally, some real simulations demonstrate the efficiency of our learning algorithms. The regular FNN is applied to the approximate realization of fuzzy inference rules and fuzzy functions defined on given compact sets.     

AGFS: Adaptive Genetic Fuzzy System for medical data classification

A Genetic Fuzzy System (GFS) is basically a fuzzy system augmented by a learning process based on a genetic algorithm (GA). Fuzzy systems have demonstrated their ability to solve different kinds of problems in various application domains. Currently, there is an increasing interest to augment fuzzy systems with learning and adaptation capabilities. Two of the most successful approaches to hybridize fuzzy systems with learning and adaptation methods have been made in the realm of soft computing. The GA can be merged with Fuzzy system for different purposes like rule selection, membership function optimization, rule generation, co-efficient optimization, for data classification. Here we propose an Adaptive Genetic Fuzzy System (AGFS) for optimizing rules and membership functions for medical data classification process. The primary intension of the research is 1) Generating rules from data as well as for the optimized rules selection, adapting of genetic algorithm is done and to explain the exploration problem in genetic algorithm, introduction of new operator, called systematic addition is done, 2) Proposing a simple technique for scheming of membership function and Discretization, and 3) Designing a fitness function by allowing the frequency of occurrence of the rules in the training data. Finally, to establish the efficiency of the proposed classifier the presentation of the anticipated genetic-fuzzy classifier is evaluated with quantitative, qualitative and comparative analysis. From the outcome, AGFS obtained better accuracy when compared to the existing systems.     

Intelligent-controlled doubly fed induction generator system using PFNN

An intelligent-controlled doubly fed induction generator (DFIG) system using probabilistic fuzzy neural network (PFNN) is proposed in this study. This system can be applied as a stand-alone power supply system or as the emergency power system when the electricity grid fails for all sub-synchronous, synchronous, and super-synchronous conditions. The rotor side converter is controlled using the field-oriented control to produce three-phase stator voltages with constant magnitude and frequency at different rotor speeds. Moreover, the grid side converter, which is also controlled using field-oriented control, is primarily implemented to maintain the magnitude of the DC-link voltage. Furthermore, an intelligent PFNN controller is proposed for both the rotor and grid side converters to improve the transient and steady-state responses of the DFIG system at different operating conditions. The network structure, online learning algorithm, and convergence analyses of the PFNN are introduced in detail. Finally, the feasibility of the proposed control scheme is verified using some experimental results.     

Strategic bidding using fuzzy adaptive gravitational search algorithm in a pool based electricity market

A novel stochastic optimization approach to solve optimal bidding strategy problem in a pool based electricity market using fuzzy adaptive gravitational search algorithm (FAGSA) is presented. Generating companies (suppliers) participate in the bidding process in order to maximize their profits in an electricity market. Each supplier will bid strategically for choosing the bidding coefficients to counter the competitors bidding strategy. The gravitational search algorithm (GSA) is tedious to solve the optimal bidding strategy problem because, the optimum selection of gravitational constant (G). To overcome this problem, FAGSA is applied for the first time to tune the gravitational constant using fuzzy “IF/THEN” rules. The fuzzy rule-based systems are natural candidates to design gravitational constant, because they provide a way to develop decision mechanism based on specific nature of search regions, transitions between their boundaries and completely dependent on the problem. The proposed method is tested on IEEE 30-bus system and 75-bus Indian practical system and compared with GSA, particle swarm optimization (PSO) and genetic algorithm (GA). The results show that, fuzzification of the gravitational constant, improve search behavior, solution quality and reduced computational time compared against standard constant parameter algorithms.     

A genetic approach to modeling fuzzy systems based on information granulation and successive generation-based evolution method

In this paper, we introduce and investigate a new category of fuzzy inference systems based on information granulation and genetic optimization used to system identification. We show the applications of such systems to identification of nonlinear systems. The formal framework of information granulation and resulting information granules themselves become an important design facet of the fuzzy models. By embracing fuzzy sets, the model is geared towards capturing essential relationship between information granules rather than concentrating on plain numeric data. Information granulation realized with the use of the commonly exploited C-Means clustering helps determine the initial values of the parameters of the fuzzy models. This in particular concerns such essential components of the rules as the initial apexes of the membership functions standing in the premise part of the fuzzy rules and the points of the polynomial functions standing in the consequence part. The initial apexes (center points) of the membership functions based on C-Means algorithm are tuned with the aid of the genetic algorithm (GA), while the tuned apexes are also used to adjust the points of the consequent polynomials (conclusions) of the rules. In particular, the initial apexes of the membership functions and the initial points of the consequent polynomials are adjusted and updated every time through successive evolution process. The overall design methodology involves a hybrid structural and parametric optimization. Genetic algorithms and C-Means clustering are used to optimize the model with respect to its structure and parameters. To determine the structure and estimate the values of the parameters of the fuzzy model we consider the successive tuning method with generation-based evolution by means of genetic algorithms. The model is evaluated with the use of numerical experimentation and its quality is compared with respect to some other fuzzy models already encountered in the literature.     

A new and fast rival genetic algorithm for feature selection

Feature selection is one of the significant steps in classification tasks. It is a pre-processing step to select a small subset of significant features that can contribute the most to the classification process. Presently, many metaheuristic optimization algorithms were successfully applied for feature selection. The genetic algorithm (GA) as a fundamental optimization tool has been widely used in feature selection tasks. However, GA suffers from the hyperparameter setting, high computational complexity, and the randomness of selection operation. Therefore, we propose a new rival genetic algorithm, as well as a fast version of rival genetic algorithm, to enhance the performance of GA in feature selection. The proposed approaches utilize the competition strategy that combines the new selection and crossover schemes, which aim to improve the global search capability. Moreover, a dynamic mutation rate is proposed to enhance the search behaviour of the algorithm in the mutation process. The proposed approaches are validated on 23 benchmark datasets collected from the UCI machine learning repository and Arizona State University. In comparison with other competitors, proposed approach can provide highly competing results and overtake other algorithms in feature selection.

     

Genetic algorithm with fuzzy logic controller for preemptive and non-preemptive job-shop scheduling problems

In this paper, we propose a new genetic algorithm (GA) with fuzzy logic controller (FLC) for dealing with preemptive job-shop scheduling problems (p-JSP) and non-preemptive job-shop scheduling problems (np-JSP). The proposed algorithm considers the preemptive cases of activities among jobs under single machine scheduling problems. For these preemptive cases, we first use constraint programming and secondly develop a new gene representation method, a new crossover and mutation operators in the proposed algorithm.However, the proposed algorithm, as conventional GA, also has a weakness that takes so much time for the fine-tuning of genetic parameters. FLC can be used for regulating these parameters.In this paper, FLC is used to adaptively regulate the crossover ratio and the mutation ratio of the proposed algorithm. To prove the performance of the proposed FLC, we divide the proposed algorithm into two cases: the GA with the FLC (pro-fGA) and the GA without the FLC (pro-GA).In numerical examples, we apply the proposed algorithms to several job-shop scheduling problems and the results applied are analyzed and compared. Various experiments show that the results of pro-fGA outperform those of pro-GA.