首页 | 本学科首页   官方微博 | 高级检索  
     

基于起源信息的水位衰老数据的筛选算法
引用本文:郑晓东,胡汉辉,刘喜凤.基于起源信息的水位衰老数据的筛选算法[J].水利水电技术,2018,49(6):23-29.
作者姓名:郑晓东  胡汉辉  刘喜凤
作者单位:1. 东南大学 自动化学院,江苏 南京 211189; 2. 河海大学 计算机与信息学院,江苏 南京 210098
基金项目:国家自然科学基金项目( 70673010)
摘    要:为提高数据质量和决策依据的权威性,需要筛选和处理因过时而无法准确描述事物、从而影响决策的衰老数据。基于最小二乘法多项式曲线模拟数据序列,结合水位数据起源信息特征,加入时间影响因子,提出了一种带权值的多项式筛选算法,并对其进行了数学推导。为了对该算法进行正确性验证和效用分析,采用滁河流域水库水位数据进行了相关试验,并与最小二乘法多项式筛选方法进行对比分析。试验得出,该算法较最小二乘法多项式筛选方法,误筛、漏筛率降低约40%。衰老数据处理之后,系统综合处理时间减少约20%,而分析结果的准确率提升约57%。结果表明:该筛选算法能有效筛选衰老数据,提高数据分析结果的准确性和效率,从而辅助提高决策能力。

关 键 词:数据衰老  数据起源  起源模型  数据筛选  
收稿时间:2017-08-28

Provenance information-based screening algorithm for aged data of water level
ZHENG Xiaodong,HU Hanhui,LIU Xifeng.Provenance information-based screening algorithm for aged data of water level[J].Water Resources and Hydropower Engineering,2018,49(6):23-29.
Authors:ZHENG Xiaodong  HU Hanhui  LIU Xifeng
Affiliation:1. School of Automation,Southeast University,Nanjing 211189,Jiangsu,China; 2. School of Computer and Information,Hohai University,Nanjing 210098,Jiangsu,China
Abstract:In order to improve the quality of data and the authority of decision-making,it is necessary to screen and process the aged data that cannot accurately describe things and then affect decisions. Based on the least squares polynomial curve fitting data series and combined with the provenance information of water level data,a polynomial screening algorithm with weights is proposed herein by adding time influence factor,which is,moreover,mathematically deduced as well. A relevant experiment is made with the data of the water level from the reservoirs with Chuhe River Bsin,from which the result is compared with that from the least square polynomial screening method,so as to make the correctness verification and the availability analysis for this algorithm. The experiment indicates that the rates of mistaken screening and missed screening are lowered by about 40% ,if compared with those from the least square polynomial screening method. After processing the aged data,the overall processing time of the system is reduced by about 20% ,while the precision of the analysis result is increased by about 57% . The result shows that this screening algorithm can effectively screen the aged data and enhance the precision and efficiency of the data analysis result, thus assist to enhance the decision-making capacity concerned.
Keywords:data aging  data provenance  provenance model  data screening  
本文献已被 CNKI 等数据库收录!
点击此处可从《水利水电技术》浏览原始摘要信息
点击此处可从《水利水电技术》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号