日志采集归并技术在电力安全管理中的应用

电力二次系统安全防护工作开展以来,各级电网调度中心和变电站部署了大量的安全设备和系统,为实现安全设备运行状态检测,需采集并存储大量详实的运行数据。文章在分析电力二次系统安全管理中日志采集架构的基础上,提出了消息路径的日志采集技术,并通过基于任务池、缓冲池的多级归并技术,提高了日志处理速度,完成海量数据的归并入库。实践证明该技术能高效地处理海量多源异构数据。

Application of the Log Collection and Merging Technology to Electricity Security Management

With the implementation of security protection for power secondary systems, grid dispatching centers and transformer substations of different levels have installed abundant security devices and systems. To detect operation condition of security equipments, there is a need to collect and store substantial and precise operation log data. After analyzing the log collection framework for the security management of power secondary systems, this paper puts forward to a log collection technology using message paths, speeds up log processing and completes merging and storage of mass data by using a multi-level merging technology based on task pool and buffer pool. Practice shows that the proposed technique can efficiently process mass, multi-source and heterogeneous data.