首页 | 本学科首页   官方微博 | 高级检索  
     

基于纠删码的细粒度云存储调度方案
引用本文:廖辉,薛广涛,钱诗友,李明禄.基于纠删码的细粒度云存储调度方案[J].计算机应用,2017,37(3):613-619.
作者姓名:廖辉  薛广涛  钱诗友  李明禄
作者单位:上海交通大学 计算机科学与工程系, 上海 200240
基金项目:国家863计划项目(2015AA01A2020)。
摘    要:针对云存储系统中数据获取时延长以及数据下载不稳定的问题,提出了一种基于存储节点负载信息和纠删码技术的调度方案。首先,利用纠删码对文件进行编码存储以降低每份数据拷贝的大小,同时利用多个线程并发下载以提高数据获取的速度;其次,通过分析大量存储节点的负载信息确定影响时延的性能指标并对现有的云存储系统架构进行优化,设计了一种基于负载信息的云存储调度算法LOAD-ALGORITHM;最后,利用开源项目OpenStack搭建了一个云计算平台,根据真实的用户请求数据在云平台上进行部署和测试。实验结果表明,相比于现有的工作,调度算法在数据获取时延方面最高能减少15%的平均时延,在数据下载稳定性方面最高能降低40%的时延波动。该调度方案在真实的云平台环境下能有效地提高数据获取速度和稳定性,降低数据获取时延,达到更好的用户体验。

关 键 词:云存储系统    纠删码    调度算法    平均时延    稳定性
收稿时间:2016-09-21
修稿时间:2016-10-18

Fine-grained scheduling policy based on erasure code
LIAO Hui,XUE Guangtao,QIAN Shiyou,LI Minglu.Fine-grained scheduling policy based on erasure code[J].journal of Computer Applications,2017,37(3):613-619.
Authors:LIAO Hui  XUE Guangtao  QIAN Shiyou  LI Minglu
Affiliation:Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
Abstract:Aiming at the problems of long data acquisition delay and unstable data download in cloud storage system, a scheduling scheme based on storage node load information and erasure code technique was proposed. Firstly, erasure code was utilized to improve the delay performance of data retrieving in cloud storage, and parallel threads were used to download multiple data copies simultaneously. Secondly, a lot of load information about storage nodes was analyzed to figure out which performance indicators would affect delay performance, and a new scheduling algorithm was proposed based on load information. Finally, the open-source project OpenStack was used to build a real cloud computing platform to test algorithm performance based on real user request tracing and erasure coding. A large number of experiments show that the proposed scheme not only can achieve 15% lower average delay but also reduce 40% volatility of delay compared with other scheduling policies. It proves that the scheduling policy can effectively improve delay performance and stability of data retrieving in real cloud computing platform, achieving a better user experience.
Keywords:cloud storage system                                                                                                                        erasure code                                                                                                                        scheduling algorithm                                                                                                                        average delay                                                                                                                        stability
点击此处可从《计算机应用》浏览原始摘要信息
点击此处可从《计算机应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号