基于云计算架构的水文大数据云平台建设

随着信息技术的应用发展,水文行业在水情采集、分析、业务处理等方面产生的数据量急剧膨胀,突发性汛灾情的频发使得各水文领域应用系统对调用数据的时效性和并发性要求越发严苛,现代高效的水文数据中心的建设需求随之变得更加迫切。大数据技术与云计算技术在海量异构数据的高效存储、处理、数据挖掘等方面具有天然优势,在气象、国土等行业已落地应用,但水文行业目前尚未有大数据和云计算技术的应用先例。综合水文大数据的特点和目前浙江省水文中心私有云建设现状,创造性提出基于云计算与大数据技术的混合云水文数据中心架构设计,以满足海量水文数据高效分布式采集、融合与分发,同时为水文数据的挖掘分析提供操作平台。

Construction of Hydrology Big Data Cloud Platform based on cloud computing architecture

With the development of information application technology, the data quantity generated in water regime collection, analysis, process in hydrology sector expands rapidly and the frequent abrupt flood disasters put forward a higher requirement for data calling timeliness and concurrency of hydrology application system, so, it is urgent to construct a high effective hydrological process center. Big data technology and cloud computation technology possesses natural advantages in high-effective heterogeneous data storing, processing and mining etc. and have been applied in the sectors of meteorology, territorial resources etc., but there is no precedent case in hydrology sector. With the consideration of the characteristics of hydrological big data and private cloud construction condition of Zhejiang Hydrology Center, this paper creatively present the architecture solution of hybrid-cloud hydrological data center based on cloud computing and big data technology. Based on this we provide an operating platform for distributed collection, data fusion and data delivery of mass hydrological data as well as hydrological data mining and analysis.