Suppressed possibilistic c-means clustering algorithm

The possibilistic c-means (PCM) clustering algorithm always suffers from a coincident clustering problem since it relaxes the probabilistic constraint in the fuzzy c-means (FCM) clustering algorithm. In this paper, to overcome the shortcoming of the PCM, a novel suppressed possibilistic c-means (S-PCM) clustering algorithm by introducing a suppressed competitive learning strategy into the PCM so as to improve the between-cluster relationships is proposed. Specifically, in the updating process the new algorithm searches for the biggest typicality which is regarded as winner by a competitive mechanism. Then it suppresses the non-winner typicalities with a suppressed rate which is used to control the learning strength. Moreover, the parameter setting problems of the suppressed rate and the penalty parameter in the S-PCM are also discussed in detail. In addition, the suppressed competitive learning strategy is still introduced into the possibilistic Gustafson–Kessel (PGK) clustering algorithm and a novel suppressed possibilistic Gustafson–Kessel (S-PGK) clustering model is proposed, which is more applicable to the ellipsoidal data clustering. Finally, experiments on several synthetic and real datasets with noise injection demonstrate the effectiveness of the proposed algorithms.     

An optimized SVM based possibilistic fuzzy c-means clustering algorithm for tumor segmentation

Multimedia Tools and Applications - To design an efficient partial differential equation-based total variation method for denoising and possibilistic fuzzy c-means clustering algorithm for...     

基于空间信息的可能性模糊C均值聚类遥感图像分割

可能性模糊C均值(PFCM)聚类算法作为模糊C均值(FCM)聚类算法的一种改进算法,能在一定程度上克服FCM算法对噪声的敏感性;但由于PFCM没有考虑像元间的空间信息,对含有较大噪声的图像分割效果依然不理想。为此,提出一种新的基于空间信息的PFCM算法(SPFCM),克服了PFCM算法对含有较大噪声的图像分割效果不佳的缺点。通过对人工图像和IKONOS遥感图像进行分析,结果表明,SPFCM算法无论是在视觉上还是在分割正确率上都优于传统的FCM算法、PFCM算法及两种加入空间信息的FCM算法;对于含有高斯噪声和盐椒噪声的图像,平均分割正确率高达99.71%,是一种去噪效果较好的图像分割算法。     

一种改进的可能模糊聚类算法*

通过分析FCM、PCM、IPCM和PFCM等流行的聚类算法和它们在噪声环境下所面临的问题,提出一种概率模糊聚类新算法（SWPFCM）,该算法结合样本加权和一种适用于噪音环境下的初始化聚类中心的方法,可以有效地消除噪声对聚类结果的影响。实验表明,SWPFCM算法具有处理大量噪声数据的能力,但对于没有噪声或噪声很少时,效果不明显,当目标样本集中出现噪声时,使用SWPFCM算法聚类将会得到满意的聚类结果。     

Suppressed fuzzy c-means clustering algorithm

Based on the defect of rival checked fuzzy c-means clustering algorithm, a new algorithm: suppressed fuzzy c-means clustering algorithm is proposed. The new algorithm overcomes the shortcomings of the original algorithm, establishes more natural and more reasonable relationships between hard c-means clustering algorithm and fuzzy c-means clustering algorithm.     

创意FCM算法

针对现有模糊聚类方法仅仅是对已有数据点的聚类的不足,提出了在已有数据集的基础上找到新的一类集群的聚类方法 CFCM。该算法在FCM算法的基础上,通过引入观测点P作为聚类的先验知识,来大致确定未知集群的聚类中心,定义了权重系数λ来限定观测点对新的一类聚类中心形成的影响程度。人造数据集和UCI真实数据集的实验结果表明,该算法不仅对已知数据点有较好的聚类效果,并且可以在观测点P的作用下在特定区域创造出新的一类无已知数据点的集群中心点的大致位置,因而在实际中有潜在应用价值。     

Fuzzy and possibilistic clustering for fuzzy data

The Fuzzy k-Means clustering model (FkM) is a powerful tool for classifying objects into a set of k homogeneous clusters by means of the membership degrees of an object in a cluster. In FkM, for each object, the sum of the membership degrees in the clusters must be equal to one. Such a constraint may cause meaningless results, especially when noise is present. To avoid this drawback, it is possible to relax the constraint, leading to the so-called Possibilistic k-Means clustering model (PkM). In particular, attention is paid to the case in which the empirical information is affected by imprecision or vagueness. This is handled by means of LR fuzzy numbers. An FkM model for LR fuzzy data is firstly developed and a PkM model for the same type of data is then proposed. The results of a simulation experiment and of two applications to real world fuzzy data confirm the validity of both models, while providing indications as to some advantages connected with the use of the possibilistic approach.     

Soil clustering by fuzzy c-means algorithm

In this study, hard k-means and fuzzy c-means algorithms are utilized for the classification of fine grained soils in terms of shear strength and plasticity index parameters. In order to collect data, several laboratory tests are performed on 120 undisturbed soil samples, which are obtained from Antalya region. Additionally, for the evaluation of the generalization ability of clustering analysis, 20 fine grained soil samples collected from the other regions of Turkey are also classified using the same clustering algorithms. Fuzzy c-means algorithm exhibited better clustering performance over hard k-means classifier. As expected, clustering analysis produced worse outcomes for soils collected from different regions than those of obtained from a specific region. In addition to its precise classification ability, fuzzy c-means approach is also capable of handling the uncertainty existing in soil parameters. As a result, fuzzy c-means clustering can be successfully applied to classify regional fine grained soils on the basis of shear strength and plasticity index parameters.     

Effective fuzzy c-means clustering algorithms for data clustering problems

Clustering is a well known technique in identifying intrinsic structures and find out useful information from large amount of data. One of the most extensively used clustering techniques is the fuzzy c-means algorithm. However, computational task becomes a problem in standard objective function of fuzzy c-means due to large amount of data, measurement uncertainty in data objects. Further, the fuzzy c-means suffer to set the optimal parameters for the clustering method. Hence the goal of this paper is to produce an alternative generalization of FCM clustering techniques in order to deal with the more complicated data; called quadratic entropy based fuzzy c-means. This paper is dealing with the effective quadratic entropy fuzzy c-means using the combination of regularization function, quadratic terms, mean distance functions, and kernel distance functions. It gives a complete framework of quadratic entropy approaching for constructing effective quadratic entropy based fuzzy clustering algorithms. This paper establishes an effective way of estimating memberships and updating centers by minimizing the proposed objective functions. In order to reduce the number iterations of proposed techniques this article proposes a new algorithm to initialize the cluster centers.In order to obtain the cluster validity and choosing the number of clusters in using proposed techniques, we use silhouette method. First time, this paper segments the synthetic control chart time series directly using our proposed methods for examining the performance of methods and it shows that the proposed clustering techniques have advantages over the existing standard FCM and very recent ClusterM-k-NN in segmenting synthetic control chart time series.     

On relational possibilistic clustering

This paper initially describes the relational counterpart of possibilistic c-means (PCM) algorithm, called relational PCM (or RPCM). RPCM is then improved to better handle arbitrary dissimilarity data. First, a re-scaling of the PCM membership function is proposed in order to obtain zero membership values when the distance to prototype equals the maximum value allowed in bounded dissimilarity measures. Second, a heuristic method of reference distance initialisation is provided which diminishes the known PCM tendency of producing coincident clusters. Finally, RPCM improved with our initialisation strategy is tested on both synthetic and real data sets with satisfactory results.     

基于减法聚类改进的模糊c-均值算法的模糊聚类研究

针对模糊c-均值(FCM)聚类算法受初始聚类中心影响,易陷入局部最优,以及算法对孤立点数据敏感的问题,提出了解决方案:采用快速减法聚类算法初始化聚类中心,为每个样本点赋予一个定量的权值,用来区分不同的样本点对最终的聚类结果的不同作用,为提高聚类速度采用修正隶属度矩阵的方法,并将算法与传统的FCM相比.实验结果表明,该算法较好地解决了初值问题,与随机初始化方法相比,迭代次数少、收敛速度快、具有较好的聚类结果.     

Analytically tractable case of fuzzy c-means clustering

In this paper, we offer a simple and accurate clustering algorithm which was derived as a closed-form analytical solution to a cluster fit function minimization problem. As a result, the algorithm finds the global minimum of the fit function, and combines exceptional efficiency with optimal clustering results.     

Measuring the congruence of fuzzy partitions in fuzzy c-means clustering

We propose an internal cluster validity index for a fuzzy c-means algorithm which combines a mathematical model for the fuzzy c-partition and a heuristic search for the number of clusters in the data. Our index resorts to information theoretic principles, and aims to assess the congruence between such a model and the data that have been observed. The optimal cluster solution represents a trade-off between discrepancy and the complexity of the underlying fuzzy c-partition. We begin by testing the effectiveness of the proposed index using two sets of synthetic data, one comprising a well-defined cluster structure and the other containing only noise. Then we use datasets arising from real life problems. Our results are compared to those provided by several available indices and their goodness is judged by an external measure of similarity. We find substantial evidence supporting our index as a credible alternative to the cluster validation problem, especially when it concerns structureless data.     

Soft transition from probabilistic to possibilistic fuzzy clustering

In the fuzzy clustering literature, two main types of membership are usually considered: A relative type, termed probabilistic, and an absolute or possibilistic type, indicating the strength of the attribution to any cluster independent from the rest. There are works addressing the unification of the two schemes. Here, we focus on providing a model for the transition from one schema to the other, to exploit the dual information given by the two schemes, and to add flexibility for the interpretation of results. We apply an uncertainty model based on interval values to memberships in the clustering framework, obtaining a framework that we term graded possibility. We outline a basic example of graded possibilistic clustering algorithm and add some practical remarks about its implementation. The experimental demonstrations presented highlight the different properties attainable through appropriate implementation of a suitable graded possibilistic model. An interesting application is found in automated segmentation of diagnostic medical images, where the model provides an interactive visualization tool for this task.     

基于样本-特征加权的可能性模糊核聚类算法

经典的模糊C-均值聚类算法存在对噪声数据较为敏感、未考虑样本属性特征间的不平衡性及对高维数据聚类不理想等问题,而可能性聚类算法虽然解决了噪声敏感和一致性聚类问题,但算法假定每个样本对聚类的贡献程度一样。针对以上问题,提出了一种基于样本-特征加权的可能性模糊核聚类算法,将可能性聚类应用到模糊聚类中以提高其对噪声或例外点的抗干扰能力;同时,根据不同类的具体特性动态计算样本各个属性特征对不同类别的重要性权值及各个样本对聚类的重要性权值,并优化选取核参数,不断修正核函数把原始空间中非线性可分的数据集映射到高维空间中的可分数据集。实验结果表明,基于样本-特征加权模糊聚类算法能够减少噪声数据和例外点的影响,比传统的聚类算法具有更好的聚类准确率。     

Efficient inhomogeneity compensation using fuzzy c-means clustering models

Intensity inhomogeneity or intensity non-uniformity (INU) is an undesired phenomenon that represents the main obstacle for magnetic resonance (MR) image segmentation and registration methods. Various techniques have been proposed to eliminate or compensate the INU, most of which are embedded into classification or clustering algorithms, they generally have difficulties when INU reaches high amplitudes and usually suffer from high computational load. This study reformulates the design of c-means clustering based INU compensation techniques by identifying and separating those globally working computationally costly operations that can be applied to gray intensity levels instead of individual pixels. The theoretical assumptions are demonstrated using the fuzzy c-means algorithm, but the proposed modification is compatible with a various range of c-means clustering based INU compensation and MR image segmentation algorithms. Experiments carried out using synthetic phantoms and real MR images indicate that the proposed approach produces practically the same segmentation accuracy as the conventional formulation, but 20-30 times faster.     

A size-insensitive integrity-based fuzzy c-means method for data clustering

Fuzzy c-means (FCM) is one of the most popular techniques for data clustering. Since FCM tends to balance the number of data points in each cluster, centers of smaller clusters are forced to drift to larger adjacent clusters. For datasets with unbalanced clusters, the partition results of FCM are usually unsatisfactory. Cluster size insensitive FCM (csiFCM) dealt with “cluster-size sensitivity” problem by dynamically adjusting the condition value for the membership of each data point based on cluster size after the defuzzification step in each iterative cycle. However, the performance of csiFCM is sensitive to both the initial positions of cluster centers and the “distance” between adjacent clusters. In this paper, we present a cluster size insensitive integrity-based FCM method called siibFCM to improve the deficiency of csiFCM. The siibFCM method can determine the membership contribution of every data point to each individual cluster by considering cluster's integrity, which is a combination of compactness and purity. “Compactness” represents the distribution of data points within a cluster while “purity” represents how far a cluster is away from its adjacent cluster. We tested our siibFCM method and compared with the traditional FCM and csiFCM methods extensively by using artificially generated datasets with different shapes and data distributions, synthetic images, real images, and Escherichia coli dataset. Experimental results showed that the performance of siibFCM is superior to both traditional FCM and csiFCM in terms of the tolerance for “distance” between adjacent clusters and the flexibility of selecting initial cluster centers when dealing with datasets with unbalanced clusters.     

Convergence properties of the generalized fuzzy c-means clustering algorithms

Fuzzy c-means (FCM) clustering algorithms have been widely used to solve clustering problems. Yang and Yu [1] extended these to optimization procedures with respect to any probability distribution. They showed that the optimal cluster centers are the fixed points of these generalized FCM clustering algorithms. The convergence properties of algorithms are the important theoretical issue. In this paper, we present convergence properties of the generalized FCM clustering algorithms. These are global convergence, local convergence, and its rate of convergence.     

On semi-supervised fuzzy c-means clustering for data with clusterwise tolerance by opposite criteria

This paper presents a new semi-supervised fuzzy c-means clustering for data with clusterwise tolerance by opposite criteria. In semi-supervised clustering, pairwise constraints, that is, must-link and cannot-link, are frequently used in order to improve clustering performances. From the viewpoint of handling pairwise constraints, a new semi-supervised fuzzy c-means clustering is proposed by introducing clusterwise tolerance-based pairwise constraints. First, a concept of clusterwise tolerance-based pairwise constraints is introduced. Second, the optimization problems of the proposed method are formulated. Especially, must-link and cannot-link are handled by opposite criteria in our proposed method. Third, a new clustering algorithm is constructed based on the above discussions. Finally, the effectiveness of the proposed algorithm is verified through numerical examples.     

基于模糊核c-means 算法的位置指纹聚类

提出一种针对位置指纹的模糊核c-means聚类算法.将位置指纹归结为一种服从正态分布的区间值数据以反映接入点信号强度采样值的不确定性,通过区间中值和大小确定的正态分布函数将位置指纹映射为特征空间中的一点,并在该特征空间中采用基于核方法的模糊c-means算法对其进行聚类.通过ZigBee定位实验表明,该方法对于位置指纹的分类效果明显好于基于信号强度平均值的c-means聚类,可在保证定位精度的前提下有效降低定位的计算量.