| NetFlow流量数据的压缩存储与多维度聚合 |
| |
| 引用本文： | 白杨,周晓洁,孙恩昌,孙艳华,张延华. NetFlow流量数据的压缩存储与多维度聚合[J]. 中国电子科学研究院学报, 2009, 4(4): 357-363 |
| |
| 作者姓名： | 白杨 周晓洁 孙恩昌 孙艳华 张延华 |
| |
| 作者单位： | 北京工业大学,电子信息与控制工程学院,北京,100124 |
| |
| 基金项目： | 863计划项目(2006AA06Z242-02);;北京市教委基金(KM200610005018) |
| |
| 摘 要： | 基于NetFlow技术,实现网络流量数据的采集整理、压缩存储和多维聚合。数据采集采用全时段抽样采集,保证数据的准确和高效。针对数据的海量特点,提出了固定阈值和可变阈值两种数据压缩方法,大大降低了数据存储量。此外,针对不同的统计分析需求,提出了数据多维度聚合结构,涵盖了数据流中时间、协议、IP地址、端口等信息。最后应用于真实的流量数据进行统计分析,取得良好效果。
|
| 关 键 词： | 网络流量 NetFlow 数据压缩 多维度聚合 |
The Compression Storage and Multi-dimensional Aggregation of NetFlow Traffic Data |
| |
| BAI Yang,ZHOU Xiao-jie,SUN En-chang,SUN Yan-hua,ZHANG Yan-hua. The Compression Storage and Multi-dimensional Aggregation of NetFlow Traffic Data[J]. Journal of China Academy of Electronics and Information Technology, 2009, 4(4): 357-363 |
| |
| Authors: | BAI Yang ZHOU Xiao-jie SUN En-chang SUN Yan-hua ZHANG Yan-hua |
| |
| Affiliation: | School of Electronic Information and Control Engineering;Beijing University of Technology;Beijing 100124;China |
| |
| Abstract: | The paper accomplished the collection,compression storage and multi-dimensional aggregation of network traffic data on NetFlow.It ensured the accuracy and efficiency of data by making use of sample collection,and then,In allusion to the mass characteristic of network data,the paper proposed a fixed threshold and variable threshold data compression,greatly reduced the volume of data storage.In addition,according to different needs of statistical analysis,the paper put forward a multi-dimensional aggregation ... |
| |
| Keywords: | network traffic NetFlow data compression multi-dimensional aggregation |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
|
