A class of fuzzy clusterwise regression models

In this paper we introduce a class of fuzzy clusterwise regression models with LR fuzzy response variable and numeric explanatory variables, which embodies fuzzy clustering, into a fuzzy regression framework. The model bypasses the heterogeneity problem that could arise in fuzzy regression by subdividing the dataset into homogeneous clusters and performing separate fuzzy regression on each cluster. The integration of the clustering model into the regression framework allows us to simultaneously estimate the regression parameters and the membership degree of each observation to each cluster by optimizing a single objective function. The class of models proposed here includes, as special cases, the fuzzy clusterwise linear regression model and the fuzzy clusterwise polynomial regression model. We also introduce a set of goodness of fit indices to evaluate the fit of the regression model within each cluster as well as in the whole dataset. Finally, we consider some cluster validity criteria that are useful in identifying the “optimal” number of clusters. Several applications are provided in order to illustrate the approach.     

Enhanced Fuzzy System Models With Improved Fuzzy Clustering Algorithm

Although traditional fuzzy models have proven to have high capacity of approximating the real-world systems, they have some challenges, such as computational complexity, optimization problems, subjectivity, etc. In order to solve some of these problems, this paper proposes a new fuzzy system modeling approach based on improved fuzzy functions to model systems with continuous output variable. The new modeling approach introduces three features: i) an improved fuzzy clustering (IFC) algorithm, ii) a new structure identification algorithm, and iii) a nonparametric inference engine. The IFC algorithm yields simultaneous estimates of parameters of c-regression models, together with fuzzy c-partitioning of the data, to calculate improved membership values with a new membership function. The structure identification of the new approach utilizes IFC, instead of standard fuzzy c-means clustering algorithm, to fuzzy partition the data, and it uses improved membership values as additional input variables along with the original scalar input variables for two different choices of regression methods: least squares estimation or support vector regression, to determine ldquofuzzy functionsrdquo for each cluster. With novel IFC, one could learn the system behavior more accurately compared to other FSM models. The nonparametric inference engine is a new approach, which uses the alike -nearest neighbor method for reasoning. Empirical comparisons indicate that the proposed approach yields comparable or better accuracy than fuzzy or neuro-fuzzy models based on fuzzy rules bases, as well as other soft computing methods.     

A fuzzy clustering algorithm enhancing local model interpretability

In this work, simple modifications on the cost index of particular local-model fuzzy clustering algorithms are proposed in order to improve the readability of the resulting models. The final goal is simultaneously providing local linear models (reasonably close to the plant’s Jacobian) and clustering in the input space so that desirable characteristics (regarding final model accuracy, and convexity and smoothness of the cluster membership functions) are improved with respect to other proposals in literature. Some examples illustrate the proposed approach.     

一种快速的模糊局部C-均值聚类分割算法

针对模糊局部C-均值聚类算法计算复杂度高且对大数据样本集进行聚类时极为耗时的特点,提出了快速的模糊局部C-均值聚类分割算法。该算法将目标像素点与其邻域像素点构成的共生矩阵引入模糊局部C-均值算法,得到新的聚类隶属度和聚类中心表达式。对像素分类时,利用邻域像素隶属度进行滤波处理,进一步改善了算法的抗噪性。实验结果表明,该算法满足了图像分割有效性的需求,相较于模糊局部C-均值聚类算法,该算法具有更好的分割性能和实时性,能更好地满足实际场合图像分割的需要。     

A New Fuzzy Set Merging Technique Using Inclusion-Based Fuzzy Clustering

This paper proposes a new method of merging parameterized fuzzy sets based on clustering in the parameters space, taking into account the degree of inclusion of each fuzzy set in the cluster prototypes. The merger method is applied to fuzzy rule base simplification by automatically replacing the fuzzy sets corresponding to a given cluster with that pertaining to cluster prototype. The feasibility and the performance of the proposed method are studied using an application in mobile robot navigation. The results indicate that the proposed merging and rule base simplification approach leads to good navigation performance in the application considered and to fuzzy models that are interpretable by experts. In this paper, we concentrate mainly on fuzzy systems with Gaussian membership functions, but the general approach can also be applied to other parameterized fuzzy sets.     

加热炉钢坯温度软测量模型研究

研究基于模糊聚类的钢坯温度神经网络软测量模型.该方法由两个部分组成, FCM(Fuzzy C-Means)聚类算法用来对训练样本进行分类,分布式RBF(Radial Basis Function) 网络对每类样本进行训练.在线测量时,采用自适应模糊聚类算法对新的工况数据进行 隶属度计算.文中将该算法应用于步进式加热炉钢坯温度的预报,仿真结果表明该算法的有 效性.     

基于聚类分析的模糊分类系统构造方法

提出一种新的利用样本数据构造模糊分类系统的方法.首先对每一类样本进行聚类分析,提出一种自适应确定各类别聚类数目的迭代算法,从而实现对特征空间的划分.然后对每个特征子空间产生一条模糊规则,将所有的规则组合在一起形成初始模糊分类系统,并对该系统进行结构简化和参数优化,在系统结构尽可能简单的前提下,进一步提高系统的分类性能.最后利用该方法对二维特征空间的两类样本和Iris数据样本进行分类.仿真结果表明,该方法能利用较少的模糊分类规则达到较高的识别率.     

新的鲁棒模糊C-均值聚类分割算法及其应用

针对Krinidis和公茂果等提出的系列鲁棒模糊局部C-均值聚类算法存在聚类中心迭代公式缺乏严格数学理论基础的不足,于是将其聚类目标函数及其约束条件采用拉格朗日乘子法进行严格数学推导,从而获得最优解逼近的隶属度和聚类中心迭代表达式,并通过多次循环迭代实现图像聚类分割。实验结果表明,本文所建议的鲁棒模糊局部C-均值聚类分割算法是有效的,相比现有鲁棒模糊局部C-均值聚类分割算法更适合复杂遥感等图像的分割需要。     

Spatial dependence-based fuzzy regression clustering

Fuzzy clustering based regression analysis is a novel hybrid approach to capture the linear structure while considering the classification structure of the measurement. Using the concept that weights provided via the fuzzy degree of clustering, some regression models have been proposed in literature. In these models, membership values derived from clustering or some weights obtained from geometrical functions are employed as the weights of regression system. This paper addresses a weighted fuzzy regression analysis based on spatial dependence measure of the memberships. By the methodology presented in this paper, the relative weights are used in fuzzy regression models instead of direct membership values or their geometrical transforms. The experimental studies indicate that the spatial dependence based analyses yield more reliable results to show the correlation of the independent variables into the dependent variable. In addition, it has been observed that spatial dependence based models have high estimation and generalization capacities.     

A multivariate fuzzy c-means method

Fuzzy c-means (FCMs) is an important and popular unsupervised partitioning algorithm used in several application domains such as pattern recognition, machine learning and data mining. Although the FCM has shown good performance in detecting clusters, the membership values for each individual computed to each of the clusters cannot indicate how well the individuals are classified. In this paper, a new approach to handle the memberships based on the inherent information in each feature is presented. The algorithm produces a membership matrix for each individual, the membership values are between zero and one and measure the similarity of this individual to the center of each cluster according to each feature. These values can change at each iteration of the algorithm and they are different from one feature to another and from one cluster to another in order to increase the performance of the fuzzy c-means clustering algorithm. To obtain a fuzzy partition by class of the input data set, a way to compute the class membership values is also proposed in this work. Experiments with synthetic and real data sets show that the proposed approach produces good quality of clustering.     

基于混合聚类算法的模糊函数系统辨识方法

针对传统模糊系统存在的结构难以确定和参数辨识复杂的问题,提出了一种基于混合聚类算法的模糊函数系统辨识算法.与一般的模糊函数系统相比,混合聚类算法结合模糊C均值和模糊C回归模型聚类算法的样本距离.在模型预测部分,采用高斯函数计算每个输入变量的隶属度,利用输入变量隶属度的模糊化算子得到输入向量的隶属度.应用于Box-Jenkins煤气炉数据、一个双入单出的非线性系统和Mackey-Glass混沌时间序列数据的试验结果表明,本文算法具有很好的辨识效果,从而验证了本文算法的有效性与实用性.     

Dual-centers type-2 fuzzy clustering framework and its verification and validation indices

In this paper we present a clustering framework for type-2 fuzzy clustering which covers all steps of the clustering process including: clustering algorithm, parameters estimation, and validation and verification indices. The proposed clustering algorithm is developed based on dual-centers type-2 fuzzy clustering model. In this model the centers of clusters are defined by a pair of objects rather than a single object. The membership values of the objects to the clusters are defined by type-2 fuzzy numbers and there are not any type reduction or defuzzification steps in the proposed clustering algorithm. In addition, the relation among the size of the cluster bandwidth, distance between dual-centers and fuzzifier parameter are indicated and analyzed to facilitate the parameters estimation step. To determine the optimum number of clusters, we develop a new validation index which is compatible with the proposed model structure. A new compatible verification index is also defined to compare the results of the proposed model with existing type-1 fuzzy clustering model. Finally, the results of computational experiments are presented to show the efficiency of the proposed approach.     

Fuzzy functions with support vector machines

A new fuzzy system modeling (FSM) approach that identifies the fuzzy functions using support vector machines (SVM) is proposed. This new approach is structurally different from the fuzzy rule base approaches and fuzzy regression methods. It is a new alternate version of the earlier FSM with fuzzy functions approaches. SVM is applied to determine the support vectors for each fuzzy cluster obtained by fuzzy c-means (FCM) clustering algorithm. Original input variables, the membership values obtained from the FCM together with their transformations form a new augmented set of input variables. The performance of the proposed system modeling approach is compared to previous fuzzy functions approaches, standard SVM, LSE methods using an artificial sparse dataset and a real-life non-sparse dataset. The results indicate that the proposed fuzzy functions with support vector machines approach is a feasible and stable method for regression problems and results in higher performances than the classical statistical methods.     

Fuzzy c-means improvement using relaxed constraints support vector machines

Fuzzy clustering is a widely applied method for extracting the underlying models within data. It has been applied successfully in many real-world applications. Fuzzy c-means is one of the most popular fuzzy clustering methods because it produces reasonable results and its implementation is straightforward. One problem with all fuzzy clustering algorithms such as fuzzy c-means is that some data points which are assigned to some clusters have low membership values. It is possible that many samples may be assigned to a cluster with low-confidence. In this paper, an efficient and noise-aware implementation of support vector machines, namely relaxed constraints support vector machines, is used to solve the mentioned problem and improve the performance of fuzzy c-means algorithm. First, fuzzy c-means partitions data into appropriate clusters. Then, the samples with high membership values in each cluster are selected for training a multi-class relaxed constraints support vector machine classifier. Finally, the class labels of the remaining data points are predicted by the latter classifier. The performance of the proposed clustering method is evaluated by quantitative measures such as cluster entropy and Minkowski scores. Experimental results on real-life data sets show the superiority of the proposed method.     

Fuzzy least squares twin support vector clustering

In this paper, we have formulated a fuzzy least squares version of recently proposed clustering method, namely twin support vector clustering (TWSVC). Here, a fuzzy membership value of each data pattern to different cluster is optimized and is further used for assigning each data pattern to one or other cluster. The formulation leads to finding k cluster center planes by solving modified primal problem of TWSVC, instead of the dual problem usually solved. We show that the solution of the proposed algorithm reduces to solving a series of system of linear equations as opposed to solving series of quadratic programming problems along with system of linear equations as in TWSVC. The experimental results on several publicly available datasets show that the proposed fuzzy least squares twin support vector clustering (F-LS-TWSVC) achieves comparable clustering accuracy to that of TWSVC with comparatively lesser computational time. Further, we have given an application of F-LS-TWSVC for segmentation of color images.

     

基于子集融合与规则简约的磨矿过程模糊建模

针对选矿厂磨矿生产过程的模糊建模问题,本文提出一种基于模糊集融合和规则简约的模糊建模方法.该方法针对基于数据建立的磨矿过程Takagi-Sugeno模型,采用模糊C均值聚类方法对同一变量下的隶属度函数参数进行聚类,得到对不同工况具有代表性的融合后的隶属度函数,来降低过度拟合的影响.此外,本文根据规则库中的规则权值,对前件相同的冗余规则进行约简,形成最终的离线模糊规则库,有效提高了规则库的泛化能力.为验证本文方法的有效性,分别采用经典数据与实际工业数据进行了实验论证,从精度和泛化能力上体现了本文方法的优势.     

Regularized Linear Fuzzy Clustering and Probabilistic PCA Mixture Models

Fuzzy$c$-means (FCM)-type fuzzy clustering approaches are closely related to Gaussian mixture models (GMMs) and EM-like algorithms have been used in FCM clustering with regularized objective functions. Especially, FCM with regularization by Kullback–Leibler information (KLFCM) is a fuzzy counterpart of GMMs. In this paper, we propose to apply probabilistic principal component analysis (PCA) mixture models to linear clustering following a discussion on the relationship between local PCA and linear fuzzy clustering. Although the proposed method is a kind of the constrained model of KLFCM, the algorithm includes the fuzzy$c$-varieties (FCV) algorithm as a special case, and the algorithm can be regarded as a modified FCV algorithm with regularization by K–L information. Numerical experiments demonstrate that the proposed clustering algorithm is more flexible than the maximum likelihood approaches and is useful for capturing local substructures properly.     

基于一种新模糊模型的非线性系统模糊辨识

提出一种基于新的模糊模型和加权递推最小二乘算法 (WRLSA)的非线性系统模糊辨识方法.新型的具有插值能力的模糊系统可以通过学习从输入输出采样数据中提取MISO系统模糊规则,它继承了Sugeno模型及其变化形式的许多优点.采用相应的模糊隶属函数,使得被辨识的模型可用若干局部线性模型来表示,然后利用WRLSA拟合这些线性模型.给出了详细的模糊辨识算法,为了验证该辨识方法的有效性,还给出了对熟知的Box-Jenkins数据的辨识结果.     

A weighted multivariate Fuzzy C-Means method in interval-valued scientific production data

Clustering is the process of organizing objects into groups whose members are similar in some way. Most of the clustering methods involve numeric data only. However, this representation may not be adequate to model complex information which may be: histogram, distributions, intervals. To deal with these types of data, Symbolic Data Analysis (SDA) was developed. In multivariate data analysis, it is common some variables be more or less relevant than others and less relevant variables can mask the cluster structure. This work proposes a clustering method based on fuzzy approach that produces weighted multivariate memberships for interval-valued data. These memberships can change at each iteration of the algorithm and they are different from one variable to another and from one cluster to another. Furthermore, there is a different relevance weight associated to each variable that may also be different from one cluster to another. The advantage of this method is that it is robust to ambiguous cluster membership assignment since weights represent how important the different variables are to the clusters. Experiments are performed with synthetic data sets to compare the performance of the proposed method against other methods already established by the clustering literature. Also, an application with interval-valued scientific production data is presented in this work. Clustering quality results have shown that the proposed method offers higher accuracy when variables have different variabilities.     

A new identification method for fuzzy linear models of nonlinear dynamic systems

The most promising methods for identifying a fuzzy model are data clustering, cluster merging and subsequent projection of the clusters on the input variable space. This article proposes to modify this procedure by adding a cluster rotation step, and a method for the direct calculation of the consequence parameters of the fuzzy linear model. These two additional steps make the model identification procedure more accurate and limits the loss of information during the identification procedure. The proposed method has been tested on a nonlinear first order model and a nonlinear model of a bioreactor and results are very promising.