| 基于动态镜像的实时数据仓库存取预处理技术研究 |
| |
| 引用本文： | 毛莺池,闵 伟,接 青,朱沥沥.基于动态镜像的实时数据仓库存取预处理技术研究[J].计算机科学,2015,42(12):130-135. |
| |
| 作者姓名： | 毛莺池 闵 伟 接 青 朱沥沥 |
| |
| 作者单位： | 河海大学计算机与信息学院 南京211100;河海大学淮安研究院 淮安223001,河海大学计算机与信息学院 南京211100,河海大学计算机与信息学院 南京211100,河海大学计算机与信息学院 南京211100 |
| |
| 基金项目： | 本文受国家自然科学基金项目(61272543,U1301252),国家科技支撑计划项目(2013BAB06B04),中国华能集团公司总部科技项目(HNKJ13-H17-04),云南省科技计划项目(2014GA007),中央高校基本科研业务费专项资金(2015B22214)资助 |
| |
| 摘 要： | 实时数据仓库是数据仓库技术的重要分支,而实时数据查询和实时数据导入引发的查询竞争问题一直是实时数据仓库技术研究的重点之一。查询竞争问题严重影响了查询分析的精度和效率,还降低了数据仓库的性能。提出了一种在数据仓库外部构建动态存储区域的方法,它采用动态镜像技术,有效地缓解查询竞争问题。同时,为了提高实时OLAP上的查询分析操作的性能,提出了蝇量级物化方法及蝇量级物化下的表连接算法FWMJoin(Fly-Weight Materialization Join)。基于TPC-H基准的实时数据仓库测试系统,针对动态镜像技术下的动态存储区域的OLAP性能进行分析与评估,并对实验结果进行总结。
|
| 关 键 词： | 查询竞争 动态镜像 实时数据仓库 联机在线分析 |
| 收稿时间： | 2015/2/13 0:00:00 |
| 修稿时间： | 4/8/2015 12:00:00 AM |
Real-time Data Warehouse Pre-processing Based on Dynamic Mirror Replication |
| |
| MAO Ying-chi,MIN Wei,JIE Qing and ZHU Li-li.Real-time Data Warehouse Pre-processing Based on Dynamic Mirror Replication[J].Computer Science,2015,42(12):130-135. |
| |
| Authors: | MAO Ying-chi MIN Wei JIE Qing and ZHU Li-li |
| |
| Affiliation: | College of Computer and Information,Hohai University,Nanjing 211100,China;Huaian Research Institute of Hohai University,Huaian 223001,China,College of Computer and Information,Hohai University,Nanjing 211100,China,College of Computer and Information,Hohai University,Nanjing 211100,China and College of Computer and Information,Hohai University,Nanjing 211100,China |
| |
| Abstract: | Real-time data warehouse is one of the important research field in the data management.Real-time data query and import can bring about the problem of query contention.Query contention will not only seriously affect the accuracy of query analysis,but also reduce the performance of the real-time data warehouse.In this paper,combining an external dynamic storage area,a dynamic mirror replication technology was proposed to effectively solve the query contention problem.Meanwhile,the fly-weight materialization method and the fly-weight materialization join algorithm were proposed to improve the query and analysis performance in the real-time OLAP.Based on the TPC-H benchmark,the proposed dynamic mirror replication technology was evaluated.The experimental results demonstrate the proposed solution can get better performance in terms of effectiveness. |
| |
| Keywords: | Query contention Dynamic mirror replication Real-time data warehouse OLAP |
|
| 点击此处可从《计算机科学》浏览原始摘要信息 |
|
点击此处可从《计算机科学》下载全文 |
|
