基于MapReduce的大规模流量分析系统的设计

随着用户和网络规模的快速扩大以及精细化运营需求的增加，网络流量分析系统面临的数据规模及分析深度要求都在快速发展，针对传统技术在系统扩展性、建设成本以及分析深度方面已经很难满足目前需求这一问题，提出了一种基于MapReduce 技术的大规模流量分析系统技术方案，对数据存储、数据分析全部并行化处理，消除传统系统存在的若干瓶颈。

A Large Scale Network Traffic Analysis System Design Based on the MapReduce Platform

With the rapid development of network scale and the stricter requirement for operation efficiency, network traffic analysis system is facing big challenges in terms of the scale and analyzing depth. Traditional technologies cannot meet the current requirement for the scalability, cost and analyzing depth of the system. A MapReduce based traffic analysis system was presented, which could eliminate the performance bottleneck by parallelizing the storage and computation.