智能电网环境下电能计量大数据智能多维分析

针对目前现有的电能计量数据分析系统处理效率低下、计算周期过长和性能差等问题,设计出一套基于大数据技术的计量装置智能多维分析系统。该系统SQL分析通过Spark SQL实现,来弥补复杂HQL转换成Map Reduce任务后计算时间长的问题;数据采集预处理方面采用基于合区聚合法ETL技术,解决了传统ETL技术处理效率差的问题;多维分析方面则采用基于关联规则的What-if分析方法,解决了传统多维分析性能差的问题。实验表明,该方案具有效率高、编程简单、易操作、性能好等优点,保证了电能计量数据分析系统稳定性。

Intelligent multi-dimensional analysis of electric energy metering big data in smart grid environment

Aiming at the problems of low processing efficiency,long calculation cycle and poor performance of the existing electric energy measurement data analysis system,this paper designs a set of intelligent multi-dimensional analysis system scheme of metering device based on big data technology.The system SQL analysis is implemented by spark SQL to make up for the long calculation time after complex HQL is converted into map reduce task.In the aspect of data acquisition and preprocessing,this paper adopts ETL technology based on aggregation method to solve the problem of poor processing efficiency of traditional ETL technology.In the aspect of multidimensional analysis,what-if analysis method based on association rules is adopted to solve the problem of poor performance of traditional multidimensional analysis.The experimental show that the scheme has the advantages of high efficiency,simple programming,easy operation and good performance,which ensure the stability of the energy metering data analysis system.