首页 | 本学科首页   官方微博 | 高级检索  
     

一种基于族相合性的文本增量聚类箅法
引用本文:陶舒怡,王明文,万剑怡,罗远胜,左家莉.一种基于族相合性的文本增量聚类箅法[J].计算机工程,2014(6):195-200.
作者姓名:陶舒怡  王明文  万剑怡  罗远胜  左家莉
作者单位:[1]江西师范大学计算机信息工程学院,南昌330022 [2]江西财经大学网络信息管理中心,南昌330013 [3]江西师范大学初等教育学院,南昌330027
基金项目:国家自然科学基金资助项目(61272212).
摘    要:传统文本聚类方法只适合处理静态样本,且时间复杂度较高。针对该问题,提出一种基于簇相合性的文本增量聚类算法。采用基于词项语义相似度的文本表示模型,利用词项之间的语义信息,通过计算新增文本与已有簇之间的相合性实现对文本的增量聚类。增量处理完部分文本后,对其中错分可能性较大的文本重新指派类别,以进一步提高聚类性能。该算法可在对象数据不断增长或更新的情况下,避免大量重复计算,提高聚类性能。在20 Newsgroups数据集上进行实验,结果表明,与k-means算法和SHC算法相比,该算法可减少聚类时间,提高聚类性能。

关 键 词:文本聚类  增量聚类  语义相似度  簇相合性  文本再分配

An Incremental Text Clustering Algorithm Based on Cluster Congruence
TAO Shu-yi,WANG Ming-wen,WAN Jian-yi,LUO Yuan-sheng,ZUO Jia-li.An Incremental Text Clustering Algorithm Based on Cluster Congruence[J].Computer Engineering,2014(6):195-200.
Authors:TAO Shu-yi  WANG Ming-wen  WAN Jian-yi  LUO Yuan-sheng  ZUO Jia-li
Affiliation:1. School of Computer Information Engineering, Jiangxi Normal University, Nanchang 330022, China; 2. Network Information Management Center, Jiangxi University of Finance and Economics, Nanchang 330013, China; 3. School of Elementary Education, Jiangxi Normal University, Nanchang 330027, China)
Abstract:Traditional text clustering methods are only suitable for static sample, and their time complexity is too high. Aiming at these problems, this paper proposes a new Incremental Text Clustering Algorithm Based on Congruence(ITCAC) between text and cluster. The new algorithm can avoid a lot of double counting to improve the performance of clustering. It uses text representation model based on semantic similarity of lexical items, fully takes the semantic information between terms into account and computes the congruence between new documents and existing clusters. After processing part of the documents, the algorithm reassigns the categorization of documents that has large possibility of misclassification to further improve the clustering performance. Experimental results on 20 Newsgronps datasets show that, compared with the k-means algorithm and SHC algorithm, the new algorithm not only has less clustering time, but also has better performance of clustering.
Keywords:text clustering  incremental clustering  semantic similarity  cluster congruence  text redistribution
本文献已被 维普 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号