基于云计算的SLIQ并行算法研究

云计算为存储和分析海量数据提供了高效的解决方案,对数据挖掘算法的研究具有重要的理论意义和应用价值。SLIQ算法采用逐一遍历并计算伸缩性指标的方法来寻找最佳分裂点,这种方法过于消耗时间,当数据量增大时,算法的执行效率很低。本文针对云计算环境下的决策规则挖掘算法展开研究,介绍了Map Reduce编程模型,在此基础上,以实现云计算环境下SLIQ并行化挖掘为目的,给出了改进后的SLIQ算法在Map Reduce编程模型上的应用过程。

Research on the SLIQ Parallel Algorithm Based on Cloud Computing

Cloud computing provides efficient solutions to storing and analyzing mass data.It is very important to study the data mining algorithms based on cloud computing from the theoretical viewpoint and the practical viewpoint.The SLIQ algorithm finds the best split point through calculating the scalability indexes one by one.When the amount of data increases,the method is time-consuming,and the efficiency of the algorithm is very low.In this paper,the algorithms of mining decision rules based on the cloud computing environment are focused on the MapReduce programming model.On the basis,an improved SLIQ algorithm as well as the procedure of the improved SLIQ algorithm on MapReduce is designed in order to realize parallel data mining.