A fast recursive algorithm based on fuzzy 2-partition entropy approach for threshold selection

The fuzzy c-partition entropy approach for threshold selection is an effective approach for image segmentation. The approach models the image with a fuzzy c-partition, which is obtained using parameterized membership functions. The ideal threshold is determined by searching an optimal parameter combination of the membership functions such that the entropy of the fuzzy c-partition is maximized. It involves large computation when the number of parameters needed to determine the membership function increases. In this paper, a recursive algorithm is proposed for fuzzy 2-partition entropy method, where the membership function is selected as S-function and Z-function with three parameters. The proposed recursive algorithm eliminates many repeated computations, thereby reducing the computation complexity significantly. The proposed method is tested using several real images, and its processing time is compared with those of basic exhaustive algorithm, genetic algorithm (GA), particle swarm optimization (PSO), ant colony optimization (ACO) and simulated annealing (SA). Experimental results show that the proposed method is more effective than basic exhaustive search algorithm, GA, PSO, ACO and SA.     

Robust TSK fuzzy modeling for function approximation with outliers

The Takagi-Sugeno-Kang (TSK) type of fuzzy models has attracted a great attention of the fuzzy modeling community due to their good performance in various applications. Most approaches for modeling TSK fuzzy rules define their fuzzy subspaces based on the idea of training data being close enough instead of having similar functions. Besides, training data sets algorithms often contain outliers, which seriously affect least-square error minimization clustering and learning algorithms. A robust TSK fuzzy modeling approach is presented. In the approach, a clustering algorithm termed as robust fuzzy regression agglomeration (RFRA) is proposed to define fuzzy subspaces in a fuzzy regression manner with robust capability against outliers. To obtain a more precision model, a robust fine-tuning algorithm is then employed. Various examples are used to verify the effectiveness of the proposed approach. From the simulation results, the proposed robust TSK fuzzy modeling indeed showed superior performance over other approaches     

Enhanced Fuzzy System Models With Improved Fuzzy Clustering Algorithm

Although traditional fuzzy models have proven to have high capacity of approximating the real-world systems, they have some challenges, such as computational complexity, optimization problems, subjectivity, etc. In order to solve some of these problems, this paper proposes a new fuzzy system modeling approach based on improved fuzzy functions to model systems with continuous output variable. The new modeling approach introduces three features: i) an improved fuzzy clustering (IFC) algorithm, ii) a new structure identification algorithm, and iii) a nonparametric inference engine. The IFC algorithm yields simultaneous estimates of parameters of c-regression models, together with fuzzy c-partitioning of the data, to calculate improved membership values with a new membership function. The structure identification of the new approach utilizes IFC, instead of standard fuzzy c-means clustering algorithm, to fuzzy partition the data, and it uses improved membership values as additional input variables along with the original scalar input variables for two different choices of regression methods: least squares estimation or support vector regression, to determine ldquofuzzy functionsrdquo for each cluster. With novel IFC, one could learn the system behavior more accurately compared to other FSM models. The nonparametric inference engine is a new approach, which uses the alike -nearest neighbor method for reasoning. Empirical comparisons indicate that the proposed approach yields comparable or better accuracy than fuzzy or neuro-fuzzy models based on fuzzy rules bases, as well as other soft computing methods.     

Online identification of evolving Takagi–Sugeno–Kang fuzzy models for crane systems

This paper suggests new evolving Takagi–Sugeno–Kang (TSK) fuzzy models dedicated to crane systems. A set of evolving TSK fuzzy models with different numbers of inputs are derived by the novel relatively simple and transparent implementation of an online identification algorithm. An input selection algorithm to guide modeling is proposed on the basis of ranking the inputs according to their important factors after the first step of the online identification algorithm. The online identification algorithm offers rule bases and parameters which continuously evolve by adding new rules with more summarization power and by modifying existing rules and parameters. The potentials of new data points are used with this regard. The algorithm is applied in the framework of the pendulum–crane system laboratory equipment. The evolving TSK fuzzy models are tested against the experimental data and a comparison with other TSK fuzzy models and modeling approaches is carried out. The comparison points out that the proposed evolving TSK fuzzy models are simple and consistent with both training data and testing data and that these models outperform other TSK fuzzy models.     

Hybrid robust approach for TSK fuzzy modeling with outliers

This study proposes a hybrid robust approach for constructing Takagi–Sugeno–Kang (TSK) fuzzy models with outliers. The approach consists of a robust fuzzy C-regression model (RFCRM) clustering algorithm in the coarse-tuning phase and an annealing robust back-propagation (ARBP) learning algorithm in the fine-tuning phase. The RFCRM clustering algorithm is modified from the fuzzy C-regression models (FCRM) clustering algorithm by incorporating a robust mechanism and considering input data distribution and robust similarity measure into the FCRM clustering algorithm. Due to the use of robust mechanisms and the consideration of input data distribution, the fuzzy subspaces and the parameters of functions in the consequent parts are simultaneously identified by the proposed RFCRM clustering algorithm and the obtained model will not be significantly affected by outliers. Furthermore, the robust similarity measure is used in the clustering process to reduce the redundant clusters. Consequently, the RFCRM clustering algorithm can generate a better initialization for the TSK fuzzy models in the coarse-tuning phase. Then, an ARBP algorithm is employed to obtain a more precise model in the fine-tuning phase. From our simulation results, it is clearly evident that the proposed robust TSK fuzzy model approach is superior to existing approaches in learning speed and in approximation accuracy.     

Particle swarm optimization of interval type-2 fuzzy systems for FPGA applications

This paper proposes the optimization of the type-2 membership functions for the average approximation of an interval of type-2 fuzzy controller (AT2-FLC) using PSO, where the optimization only considers certain points of the membership functions and, the fuzzy rules are not modified so that the algorithm minimizes the runtime. The AT2-FLC regulates the speed of a DC motor and is coded in VHDL for a FPGA Xilinx Spartan 3A. We compared the results of the optimization using PSO method with a genetic algorithm optimization of an AT2-FLC under uncertainty and the results are discussed. The main contribution of the paper is the design, simulation and implementation of PSO optimization of interval tye-2 fuzzy controllers for FPGA applications.     

基于粒子群优化的虚拟表情建模的应用研究

探讨了如何训练虚拟人物表情这一新课题,提出了将TSK模糊神经网络应用于虚拟人物表情的建模研究。并用粒子群优化（VSO）算法训练TSK模糊神经网络。实验结果表明,当该算法应用于训练虚拟人物表情这一问题时,能在保证精度的前提下快速收敛．并能避免陷入局部最优,从而使得不同的动画导演利用这个系统,能够根据自己的知识产生出符合自己要求的虚拟表情输出。     

一种基于粒子群算法的模糊隶属函数优化方法

在分析图像模糊增强算法对于隶属函数及其模糊区域选择方法不足的基础上,提出一种新的基于粒子群算法的模糊隶属函数优化方法。该方法给出一个新模糊熵的定义,这个新模糊熵定义不仅考虑到图像在模糊域中划分区域时随隶属函数变化而变化的情况,同时又考虑到图像在空域中划分区域时随隶属函数变化而变化的情况。这样就使得图像依照最大熵准则变换到模糊域更能够有效地反映图像的固有信息。另外,根据图像增强算法中使用double型数据类型的特点,采用改进粒子群优化算法寻求隶属函数的最优参数。将新算法应用于图像增强中,取得了优于现有大多数模糊增强算法的效果。     

Evolving compact and interpretable Takagi-Sugeno fuzzy models with a new encoding scheme.

Developing Takagi-Sugeno fuzzy models by evolutionary algorithms mainly requires three factors: an encoding scheme, an evaluation method, and appropriate evolutionary operations. At the same time, these three factors should be designed so that they can consider three important aspects of fuzzy modeling: modeling accuracy, compactness, and interpretability. This paper proposes a new evolutionary algorithm that fulfills such requirements and solves fuzzy modeling problems. Two major ideas proposed in this paper lie in a new encoding scheme and a new fitness function, respectively. The proposed encoding scheme consists of three chromosomes, one of which uses unique chained possibilistic representation of rule structure. The proposed encoding scheme can achieve simultaneous optimization of parameters of antecedent membership functions and rule structures with the new fitness function developed in this paper. The proposed fitness function consists of five functions that consider three evaluation criteria in fuzzy modeling problems. The proposed fitness function guides evolutionary search direction so that the proposed algorithm can find more accurate compact fuzzy models with interpretable antecedent membership functions. Several evolutionary operators that are appropriate for the proposed encoding scheme are carefully designed. Simulation results on three modeling problems show that the proposed encoding scheme and the proposed fitness functions are effective in finding accurate, compact, and interpretable Takagi-Sugeno fuzzy models. From the simulation results, it is shown that the proposed algorithm can successfully find fuzzy models that approximate the given unknown function accurately with a compact number of fuzzy rules and membership functions. At the same time, the fuzzy models use interpretable antecedent membership functions, which are helpful in understanding the underlying behavior of the obtained fuzzy models.     

Parameter Optimization of Interval Type-2 Fuzzy Neural Networks Based on PSO and BBBC Methods

Interval type-2 fuzzy neural networks (IT2FNNs) can be seen as the hybridization of interval type-2 fuzzy systems (IT2FSs) and neural networks (NNs). Thus, they naturally inherit the merits of both IT2FSs and NNs. Although IT2FNNs have more advantages in processing uncertain, incomplete, or imprecise information compared to their type-1 counterparts, a large number of parameters need to be tuned in the IT2FNNs, which increases the difficulties of their design. In this paper, big bang-big crunch (BBBC) optimization and particle swarm optimization (PSO) are applied in the parameter optimization for Takagi-Sugeno-Kang (TSK) type IT2FNNs. The employment of the BBBC and PSO strategies can eliminate the need of backpropagation computation. The computing problem is converted to a simple feed-forward IT2FNNs learning. The adoption of the BBBC or the PSO will not only simplify the design of the IT2FNNs, but will also increase identification accuracy when compared with present methods. The proposed optimization based strategies are tested with three types of interval type-2 fuzzy membership functions (IT2FMFs) and deployed on three typical identification models. Simulation results certify the effectiveness of the proposed parameter optimization methods for the IT2FNNs.      

Evolving Compact and Interpretable Takagi–Sugeno Fuzzy Models With a New Encoding Scheme

Developing Takagi–Sugeno fuzzy models by evolutionary algorithms mainly requires three factors: an encoding scheme, an evaluation method, and appropriate evolutionary operations. At the same time, these three factors should be designed so that they can consider three important aspects of fuzzy modeling: modeling accuracy, compactness, and interpretability. This paper proposes a new evolutionary algorithm that fulfills such requirements and solves fuzzy modeling problems. Two major ideas proposed in this paper lie in a new encoding scheme and a new fitness function, respectively. The proposed encoding scheme consists of three chromosomes, one of which uses unique chained possibilistic representation of rule structure. The proposed encoding scheme can achieve simultaneous optimization of parameters of antecedent membership functions and rule structures with the new fitness function developed in this paper. The proposed fitness function consists of five functions that consider three evaluation criteria in fuzzy modeling problems. The proposed fitness function guides evolutionary search direction so that the proposed algorithm can find more accurate compact fuzzy models with interpretable antecedent membership functions. Several evolutionary operators that are appropriate for the proposed encoding scheme are carefully designed. Simulation results on three modeling problems show that the proposed encoding scheme and the proposed fitness functions are effective in finding accurate, compact, and interpretable Takagi–Sugeno fuzzy models. From the simulation results, it is shown that the proposed algorithm can successfully find fuzzy models that approximate the given unknown function accurately with a compact number of fuzzy rules and membership functions. At the same time, the fuzzy models use interpretable antecedent membership functions, which are helpful in understanding the underlying behavior of the obtained fuzzy models.     

Automatically extracting T–S fuzzy models using cooperative random learning particle swarm optimization

This paper proposes a methodology for automatically extracting T–S fuzzy models from data using particle swarm optimization (PSO). In the proposed method, the structures and parameters of the fuzzy models are encoded into a particle and evolve together so that the optimal structure and parameters can be achieved simultaneously. An improved version of the original PSO algorithm, the cooperative random learning particle swarm optimization (CRPSO), is put forward to enhance the performance of PSO. CRPSO employs several sub-swarms to search the space and the useful information is exchanged among them during the iteration process. Simulation results indicate that CRPSO outperforms the standard PSO algorithm, genetic algorithm (GA) and differential evolution (DE) on the functions optimization and benchmark modeling problems. Moreover, the proposed CRPSO-based method can extract accurate T–S fuzzy model with appropriate number of rules.     

An efficient quantum neuro-fuzzy classifier based on fuzzy entropy and compensatory operation

In this paper, a quantum neuro-fuzzy classifier (QNFC) for classification applications is proposed. The proposed QNFC model is a five-layer structure, which combines the compensatory-based fuzzy reasoning method with the traditional Takagi–Sugeno–Kang (TSK) fuzzy model. The compensatory-based fuzzy reasoning method uses adaptive fuzzy operations of neuro-fuzzy systems that can make the fuzzy logic system more adaptive and effective. Layer 2 of the QNFC model contains quantum membership functions, which are multilevel activation functions. Each quantum membership function is composed of the sum of sigmoid functions shifted by quantum intervals. A self-constructing learning algorithm, which consists of the self-clustering algorithm (SCA), quantum fuzzy entropy and the backpropagation algorithm, is also proposed. The proposed SCA method is a fast, one-pass algorithm that dynamically estimates the number of clusters in an input data space. Quantum fuzzy entropy is employed to evaluate the information on pattern distribution in the pattern space. With this information, we can determine the number of quantum levels. The backpropagation algorithm is used to tune the adjustable parameters. The simulation results have shown that (1) the QNFC model converges quickly; (2) the QNFC model has a higher correct classification rate than other models.     

TSK fuzzy model with minimal parameters

In this paper, an efficient genetic algorithm (GA) to generate a simple and well defined TSK model is proposed. The approach is derived from the use of the improved Strength Pareto Evolutionary Algorithm (SPEA-2), where the genes of the chromosome are arranged into control genes and parameter genes. These genes are in a hierarchical form so that the control genes can manipulate the parameter genes in a more effective manner. In our approach, we first apply the back-propagation algorithm to optimize the parameters of the model (parameters of membership functions and fuzzy rules), then we apply the SPEA-2 to optimize the number of fuzzy rules, the number of parameters and to fine tune these parameters.Two well-known dynamic benchmarks are used to evaluate the performance of the proposed algorithm. Simulation results show that our modeling approach outperforms some methods proposed in previous work.     

一类新的粒子群算法

提出一种新的模糊粒子群优化算法--收敛模糊粒子群优化算法.重点研究了收敛因子的确定和模糊隶属度函数的选择对算法性能的影响,在考虑计算效率的同时,提高了算法的精度.利用4个基准函数测试了收敛模糊粒子群优化算法的性能,并与模糊粒子群优化算法、收敛粒子群优化算法以及基本粒子群优化算法进行了对比.实验结果表明,新算法具有很好的性能.     

Fuzzy local linearization and local basis function expansion innonlinear system modeling

Fuzzy local linearization is compared with local basis function expansion for modeling unknown nonlinear processes. First-order Takagi-Sugeno fuzzy model and the analysis of variance (ANOVA) decomposition are combined for the fuzzy local linearization of nonlinear systems, in which B-splines are used as membership functions of the fuzzy sets for input space partition. A modified algorithm for adaptive spline modeling of observation data (MASMOD) is developed for determining the number of necessary B-splines and their knot positions to achieve parsimonious models. This paper illustrates that fuzzy local linearization models have several advantages over local basis function expansion based models in nonlinear system modeling.     

A hybrid particle swarm optimization based fuzzy expert system for the diagnosis of coronary artery disease

This paper presents a particle swarm optimization (PSO)-based fuzzy expert system for the diagnosis of coronary artery disease (CAD). The designed system is based on the Cleveland and Hungarian Heart Disease datasets. Since the datasets consist of many input attributes, decision tree (DT) was used to unravel the attributes that contribute towards the diagnosis. The output of the DT was converted into crisp if–then rules and then transformed into fuzzy rule base. PSO was employed to tune the fuzzy membership functions (MFs). Having applied the optimized MFs, the generated fuzzy expert system has yielded 93.27% classification accuracy. The major advantage of this approach is the ability to interpret the decisions made from the created fuzzy expert system, when compared with other approaches.     

用于模糊控制器设计的遗传算法研究

将遗传操作用于模糊规则和控制器参数编码，实现输入变量的合理组合、模糊规则的获取和控制器参数的优化，设计者仅需给出一个运行遗传算法(GA)的个体适应度函数。同时将模拟退火算法(SA)用于优化控制器参数，这种GASA混合优化策略在模糊控制器设计中取得了良好的效果。实例表明了算法的有效性。     

基于交互式进化计算的虚拟表情建模

探讨如何训练虚拟人物表情这一新课题,提出了将TSK模糊神经网络应用于虚拟人物表情的建模研究,并用交互式进化计算对TSK模糊神经网络进行训练.实验结果表明,当该算法应用于虚拟人物表情建模时,比传统的进化计算具有更快的收敛速度,而且该算法融合了进化计算的全局优化和人的主观判断,使得表情输出更加符合用户的需要.从而使得不同的动画导演利用这个系统,能够根据自己的知识产生出符合自己要求的虚拟表情输出.     

Improving the interpretability of TSK fuzzy models by combiningglobal learning and local learning

The fuzzy inference system proposed by Takagi, Sugeno, and Kang, known as the TSK model in fuzzy system literature, provides a powerful tool for modeling complex nonlinear systems. Unlike conventional modeling where a single model is used to describe the global behavior of a system, TSK modeling is essentially a multimodel approach in which simple submodels (typically linear models) are combined to describe the global behavior of the system. Most existing learning algorithms for identifying the TSK model are based on minimizing the square of the residual between the overall outputs of the real system and the identified model. Although these algorithms can generate a TSK model with good global performance (i.e., the model is capable of approximating the given system with arbitrary accuracy, provided that sufficient rules are used and sufficient training data are available), they cannot guarantee the resulting model to have a good local performance. Often, the submodels in the TSK model may exhibit an erratic local behavior, which is difficult to interpret. Since one of the important motivations of using the TSK model (also other fuzzy models) is to gain insights into the model, it is important to investigate the interpretability issue of the TSK model. We propose a new learning algorithm that integrates global learning and local learning in a single algorithmic framework. This algorithm uses the idea of local weighed regression and local approximation in nonparametric statistics, but remains the component of global fitting in the existing learning algorithms. The algorithm is capable of adjusting its parameters based on the user's preference, generating models with good tradeoff in terms of global fitting and local interpretation. We illustrate the performance of the proposed algorithm using a motorcycle crash modeling example