基于Hadoop和HBase的输变电设备数据聚合平台

输变电设备在运行中将产生大量的多态、异构数据,导致在数据集成和利用过程中出现信息孤岛问题,无法实现不同数据源内的数据信息共享互换。如何可靠获取、同步处理并对这些数据信息充分挖掘给电力系统中信息系统的建设及运行维护带来巨大压力。采用本体技术对多源异构数据进行聚合,可以向用户提供更具针对性的信息。针对电网中输变电设备全景信息数据的多源性、多态性、异构性,本文提出了基于Hadoop和HBase的输变电设备大数据聚合平台方案,搭载改进混合本体聚合方法,并设计了Map/Reduce分布式查询和推理流程。该平台采用标准化和开放性建模语言,屏蔽底层异构数据源,具有良好的可扩展性,可用于解决输变电设备数据信息的非结构化、共享性差、难以处理等问题。

A Data Aggregation Platform for Transmission and Transforming Equipment Based on Hadoop and HBase

Transmission and transforming equipment in operation will generate a large number of polymorphic and heterogeneous data, resulting in the "information island" problems,when the data is integrated and utilized.How to acquire and process these data and information reliably and synchronously brings great pressure to the construction, operation and maintenance of information system in power system.Using ontology technology to aggregate multi-source heterogeneous data can provide users with more targeted information. In view of the multi-source, polymorphism and heterogeneity of the panoramic information data of power transmission and transforming equipment in the power grid, this paper proposes the big data aggregation platform scheme of power transmission and transforming equipment based on Hadoop and HBase, which is equipped with the improved hybrid ontology aggregation method, and designs the Map/Reduce distributed query and reasoning process.The platform adopts standardized and open modeling language to shield the underlying heterogeneous data sources and has good scalability, which can be used to solve the problems of unstructured, poor sharing and difficult to deal with data information of power transmission and transformation equipment.