| 一种面向大规模数据处理的数据库引擎 |
| |
| 引用本文： | 王毅,刘长城,马建庆. 一种面向大规模数据处理的数据库引擎[J]. 计算机工程, 2012, 38(11): 48-50 |
| |
| 作者姓名： | 王毅 刘长城 马建庆 |
| |
| 作者单位： | 复旦大学计算机科学技术学院,上海,200433 |
| |
| 基金项目： | 国家自然科学基金资助项目 |
| |
| 摘 要： | 当数据量从GB级上升至TB级甚至PB级时，具有高性能的并行数据库在保证扩展性和容错性的同时计算代价会很高。针对该问题，设计一种面向大规模数据处理的并行数据库引擎FlexDB。利用Map Reduce的并行计算框架作为通信层，调度和协调集群中各节点的计算和通信。实验结果表明，FlexDB的系统性能接近于并行数据库，并且具有较好的扩展性和容错性。
|
| 关 键 词： | 海量数据 扩展性 容错性 Map Reduce框架 并行数据库 |
| 收稿时间： | 2011-12-19 |
Database Engine for Large Scale Data Processing |
| |
| WANG Yi , LIU Chang-cheng , MA Jian-qing. Database Engine for Large Scale Data Processing[J]. Computer Engineering, 2012, 38(11): 48-50 |
| |
| Authors: | WANG Yi LIU Chang-cheng MA Jian-qing |
| |
| Affiliation: | (School of Computer Science,Fudan University,Shanghai 200433,China) |
| |
| Abstract: | When the amount of data from GB goes up to TB level or even PB level,parallel database with high performance cost too much in order to achieve scalability and fault tolerance.To address the problem,this paper designs a parallel database engine——FlexDB,which is based on Map Reduce.The parallel computing framework of Map Reduce is as a communication layer of FlexDB which is to assign computing tasks and coordinate communications among all nodes in cluster.Experimental results show that the FlexDB system performance is close to parallel database,and has good expansibility and fault tolerance. |
| |
| Keywords: | mass data scalability fault tolerance Map Reduce framework parallel database |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
| 点击此处可从《计算机工程》浏览原始摘要信息 |
|
点击此处可从《计算机工程》下载免费的PDF全文 |
