EFCS-Grid内基于P2P的分布聚类分析处理策略的研究

基于数据挖掘的数据可视化是将大数据量展示给用户的一种有效手段.在EFCS-Grid中,基于特定属性的k-平均聚类分析算法进行聚类分析,之后将聚类结果展示给用户.本文通过实验测试并分析了多用户下的采用服务器进行聚类分析的时间代价以及EFCS-Grid系统在不同压力情况下的数据处理的总时间代价,得出了聚类分析在系统的数据处理过程中占重要比重,并随着数据量和并发用户数的增加,系统的性能急剧下降.为此,本文结合P2P体系结构,提出了采用分布式聚类分析数据的处理策略,并将数据处理分为数据合成层和数据分析层.由数据合成层实现数据的整合,保证合成后的数据满足用户的模式需求,之后,在相同模式的基础上实现数据的一次聚类分析和二次聚类分析,达到了通过利用P2P的分布计算能力,缓解集中处理瓶颈和提高网格内数据处理的效率的目的.

Study on Distributed Clustering Analysis Processing Strategy Based on P2P in EFCS-Grid

Data visualization by means of data mining is an effective method for presenting an amount of data to users. In EFCS-Grid, data are clustered by using k-mean based on given attributes, then to present the result to users. This paper tests and analyzes the time cost of data clustering analysis implementing at centralized server in case of multi-users, and the total time cost of data processing in EFCS-Grid in different conditions, and draw an conclusion that the time cost of data clustering analysis is more important in that of data process in EFCS-Grid, and the performance of the grid system will become lower greatly with the data amount processed increasing. Thus a distributed clustering analysis strategy is proposed by means of P2P structure, in which data integration layer and data clustering layer are included, the former one integrates the partial data into a complete schema on users demand,then to implement two times data clustering analysis to reach the purposes of easing the deficiency of centralized clustering analysis and improving the efficiency of data clustering by using the distributed computing capability of P2P structure.