首页 | 本学科首页   官方微博 | 高级检索  
     

基于MapReduce的可扩展协同聚类算法
引用本文:马俏,万剑怡,王明文.基于MapReduce的可扩展协同聚类算法[J].计算机与现代化,2013(11):52-57.
作者姓名:马俏  万剑怡  王明文
作者单位:江西师范大学计算机信息工程学院,江西南昌330022
基金项目:国家自然科学基金资助项目(60963014,61163006)
摘    要:协同聚类算法是通过同时对文档和特征进行聚类的一种聚类算法,该算法可以挖掘文档内部特征之间的潜在关系从而达到提高聚类效果的目的。随着大数据时代的到来,算法的并行化显示出它的优越性,为此本文对协同聚类算法进行全面的研究,并扩展它的并行算法,研究基于最小化残差平方和的协同聚类算法,利用MapReduce模式设计与实现协同聚类算法的并行化。实验结果表明,本文提出的并行协同聚类算法能够提高聚类的效率,并具有很好的可扩展性。

关 键 词:协同聚类  MapReduce  可扩展  残差平方和

A Scalable Co-clustering Algorithm Based on MapReduce
MA Qiao,WAN Jian-yi,WANG Ming-wen.A Scalable Co-clustering Algorithm Based on MapReduce[J].Computer and Modernization,2013(11):52-57.
Authors:MA Qiao  WAN Jian-yi  WANG Ming-wen
Affiliation:(School of Computer and Information Engineering, Jiangxi Normal University, Nanchang 330022, China)
Abstract:Collaborative clustering algorithm is a kind of clustering algorithm to cluster the documents and the features at the same time, this algorithm can find the potential relationship between internal document features so as to improve the clustering effect. With the arrival of the era of big data, parallel algorithm showed its superiority, this paper carries out a comprehensive research on collaborative clustering algorithm, and extends the parallel algorithm of it. We studied the collaborative clustering algorithm based on minimum sum-squared residue, and then designed and realized the parallel collaborative clustering algorithm with MpReduce model. Experimental results show that the proposed parallel collaborative clustering algorithm can improve the efficiency of clustering, and be of well scalability.
Keywords:collaborative clustering  MapReduee  sealability  sum-squared residue
本文献已被 维普 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号