Statistical semantics for enhancing document clustering |
| |
Authors: | Ahmed K Farahat Mohamed S Kamel |
| |
Affiliation: | 1.Department of Electrical and Computer Engineering,University of Waterloo,Waterloo,Canada |
| |
Abstract: | Document clustering algorithms usually use vector space model (VSM) as their underlying model for document representation.
VSM assumes that terms are independent and accordingly ignores any semantic relations between them. This results in mapping
documents to a space where the proximity between document vectors does not reflect their true semantic similarity. This paper
proposes new models for document representation that capture semantic similarity between documents based on measures of correlations
between their terms. The paper uses the proposed models to enhance the effectiveness of different algorithms for document
clustering. The proposed representation models define a corpus-specific semantic similarity by estimating measures of term–term
correlations from the documents to be clustered. The corpus of documents accordingly defines a context in which semantic similarity
is calculated. Experiments have been conducted on thirteen benchmark data sets to empirically evaluate the effectiveness of
the proposed models and compare them to VSM and other well-known models for capturing semantic similarity. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |