| HDFS一致性管理的研究 |
| |
| 引用本文： | 姚远,王丽芳,蒋泽军. HDFS一致性管理的研究[J]. 现代电子技术, 2012, 35(8): 86-89 |
| |
| 作者姓名： | 姚远 王丽芳 蒋泽军 |
| |
| 作者单位： | 西北工业大学计算机学院,陕西西安,710075 |
| |
| 基金项目： | 航空科学基金(2010ZD53,2009ZD53044);陕西省自然科学基金资助项目(2009JM8017,2009JQ021,2010JM8023);西北工业大学种子基金(Z2011139) |
| |
| 摘 要： | HDFS是开源云计算项目Hadoop的存储系统,具有良好的容错性和扩展性,但是HDFS原有的一致性模型不能适用于实时性要求高,数据完整性要求不严格的任务。为了让HDFS能够满足云存储不同应用场景,在已有HDFS的总体架构和读写流程基础上,从数据一致性的角度剖析HDFS的局限和不足,提出解决方案,把NWR模型引入HDFS当中,并且将文件系统的读写锁机制改进为多粒度的锁机制。实验结果证明：通过以上措施,使用户可以根据自身需要配置云存储系统,平衡一致性和可用性。
|
| 关 键 词： | 云存储 HDFS NWR 一致性管理 锁机制 |
Research of HDFS consistency management |
| |
| YAO Yuan , WANG Li-fang , JIANG Ze-jun. Research of HDFS consistency management[J]. Modern Electronic Technique, 2012, 35(8): 86-89 |
| |
| Authors: | YAO Yuan WANG Li-fang JIANG Ze-jun |
| |
| Affiliation: | (School of Computer Science,Northwestern Polytechnic University,Xi’an 710129,China) |
| |
| Abstract: | HDFS is a storage system of open source cloud computing project Hadoop.It has good fault tolerance and scalability,but the original consistency model of HDFS can not be applied to the task which has high real-time request but high data integrity requirement is not strict.The overall architecture of HDFS,read/write process,and HDFS limitations and shortcomings are analyzed in the view of data consistency.The solutions are proposed.NWR model was introduced into HDFS and read/write lock mechanism was improved as multi-granularity lock mechanism.Experimental results prove that through the above measures,the users are allowed to configure their cloud storage system,and balance the consistency and availability according to their own needs. |
| |
| Keywords: | cloud storage HDFS NWR consistency management lock mechanism |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
|
