Normality-based validation for crisp clustering |
| |
Authors: | Luis F Lago-Fernández [Author Vitae] Fernando Corbacho [Author Vitae] |
| |
Affiliation: | a Departamento de Ingeniería Informática, Escuela Politécnica Superior, Universidad Autónoma de Madrid, 28049 Madrid, Spain b Cognodata Consulting, Calle Caracas 23, 28010 Madrid, Spain |
| |
Abstract: | We introduce a new validity index for crisp clustering that is based on the average normality of the clusters. Unlike methods based on inter-cluster and intra-cluster distances, this index emphasizes the cluster shape by using a high order characterization of its probability distribution. The normality of a cluster is characterized by its negentropy, a standard measure of the distance to normality which evaluates the difference between the cluster's entropy and the entropy of a normal distribution with the same covariance matrix. The definition of the negentropy involves the distribution's differential entropy. However, we show that it is possible to avoid its explicit computation by considering only negentropy increments with respect to the initial data distribution, where all the points are assumed to belong to the same cluster. The resulting negentropy increment validity index only requires the computation of covariance matrices. We have applied the new index to an extensive set of artificial and real problems where it provides, in general, better results than other indices, both with respect to the prediction of the correct number of clusters and to the similarity among the real clusters and those inferred. |
| |
Keywords: | Crisp clustering Cluster validation Negentropy |
本文献已被 ScienceDirect 等数据库收录! |
|