| 面向在线日志云的海量数据分级归档机制 |
| |
| 引用本文： | 杨锋英,;刘会超.面向在线日志云的海量数据分级归档机制[J].黑龙江电子技术,2014(8):45-48. |
| |
| 作者姓名： | 杨锋英 ;刘会超 |
| |
| 作者单位： | [1]黄淮学院信息工程学院,河南驻马店463000; [2]武汉大学计算机学院,武汉430072 |
| |
| 基金项目： | 河南省科技攻关汁划项目（122102310474）;驻马店市科技发展订一划项目（11314） |
| |
| 摘 要： | 传统日志系统和基于Hadoop的离线日志系统在分析海量日志时都具有时延长、效率低等弊端。为构建新的基于Hadoop的在线日志系统，提出了新的数据分级归档机制，用以管理海量日志数据并形成分级优化的存储文件结构。实验结果表明该机制具有良好的可扩展性，可以有效存储海量日志数据；同时，它还有助于加快系统的数据处理速度，缩短系统的处理响应时间，使其满足在线处理的要求。
|
| 关 键 词： | 云计算 分级归档 海量数据 日志云 在线处理 |
Hierarchical archiving mechanism of big data for online log cloud |
| |
| Affiliation: | YANG Feng-ying , LIU Hui-chao ( 1. School of Information Engineering, Huanghuai University, Zhumadian 463000, Henan Province, China; 2. School of Computer, Wuhan University, Wuhan 430072, China) |
| |
| Abstract: | The traditional and the offline Hadoop-based log system all have the drawbacks of longerprocessing delay and lower efficiency when processing the massive log data. In order to build the newonline Hadoop-based log system, this paper introduces a new hierarchical data archiving mechanism,which used to manage the large amounts of log data and form hierarchical and optimized storage filestructures. The experimental results show that the mechanism has good scalability and can effectivelystore massive amounts of log data. Meanwhile, it also helps to accelerate the data processing speed,shorten the system response time, which can meet the requirements of online processing. |
| |
| Keywords: | cloud computing hierarchical file archiving big data log cloud online processing |
| 本文献已被 维普 等数据库收录！ |
|
