基于Hadoop的大数据计算之研究

在计算机网络技术不断发展的背景下,传统IT技术已经无法应对超大规模的信息处理与服务请求高吞吐数据量的处理要求。在国内外互联网公司的不断努力下,提出了源于Google的Apache Hadoop软件,成为了PB量级大数据处理主要方案。基于此,本文首先提出Hadoop技术理念,分析大数据产业发展的瓶颈,进而提出给予Hadoop的大数据计算方案。

Research on big data computing based on Hadoop

Under the background of continuous development of computer network technology, traditional IT technology has been unable to cope with the processing requirements of super-large scale information processing and high throughput data volume of service requests. With the continuous efforts of Internet companies at home and abroad, Apache Hadoop software originated from Google was put forward, which has become the main scheme of big data processing at PB level. Based on this, this paper first proposed the Hadoop technology concept, analyzed the bottleneck of big data industry development, and then proposed the big data computing scheme for Hadoop.