基于Spark平台的网络攻击检测系统

随着计算机技术和通信技术的飞速发展,网络安全形势也越来越严峻,如何在海量日志中发现安全攻击是个值得研究的问题,传统的日志分析方法效率低,难以发现一些高级的网络安全威胁。针对该问题,提出了基于分布式存储和Spark框架的网络日志分析系统架构,不仅有效利用了云环境中的计算存储资源,同时还大大提高了计算效率。

Network Attack Detection System based on Spark Platform

With the rapid development of computer technology and communication technology,the network security situation is be?coming more and more serious.How to find security attacks in massive logs is a problem worth studying.Traditional log analysis methods are inefficient and difficult to find some advanced network security threats.To solve this problem,a network log analysis system based on distributed storage and spark framework is proposed,which not only effectively utilizes the computing storage re?sources in cloud environment,but also greatly improves the computing efficiency.