云计算中Hadoop技术研究与应用综述

Hadoop作为当今云计算与大数据时代背景下最热门的技术之一,其相关生态圈与Spark技术的结合一同影响着学术发展和商业模式。首先介绍了Hadoop的起源和优势,阐明相关技术原理,如MapReduce,HDFS,YARN,Spark等；然后着重分析了当前Hadoop学术研究成果,从MapReduce算法的改进与创新、HDFS技术的优化与创新、二次开发与其它技术相结合、应用领域创新与实践4个方面进行总结,并简述了国内外应用现状。而Hadoop与Spark结合是未来的趋势,最后展望了Hadoop未来研究的发展方向和亟需解决的问题。

Review of Research and Application on Hadoop in Cloud Computing

Hadoop is one of the most popular technologies in the area of cloud computing and big data nowadays,the combination of its relevant software ecosystem with Spark technology influences the academic development and business model.This paper firstly introduced the origin and advantages of Hadoop,and clarified the relevant technical principles,such as MapReduce,HDFS,YARN,Spark and so on.Then we focused on the analysis of the current Hadoop academic research achievements,and summarized four aspects:the improvement and innovation of the MapReduce algorithm,optimization and innovation of technology of HDFS,secondary development and other combination,innovation and practice of application field.And then the developing situation of domestic and foreign application was described.Hadoop with the Spark is the trend of the future.This paper finally discussed the development direction of the future research and some crucial problems which should be solved pressingly.