首页 | 本学科首页   官方微博 | 高级检索  
     

一种云环境中的动态细粒度资源调度方法
引用本文:周墨颂,董小社,陈衡,张兴军.一种云环境中的动态细粒度资源调度方法[J].软件学报,2020,31(12):3981-3999.
作者姓名:周墨颂  董小社  陈衡  张兴军
作者单位:西安交通大学电子与信息工程学院,陕西西安710049;西安交通大学电子与信息工程学院,陕西西安710049;西安交通大学电子与信息工程学院,陕西西安710049;西安交通大学电子与信息工程学院,陕西西安710049
基金项目:国家重点研发计划(2016YFB0200902);国家自然科学基金(61572394)
摘    要:云计算平台中普遍采用固定资源量的粗粒度资源分配方式,由此会引起资源碎片、过度分配、低集群资源利用率等问题.针对此问题,提出一种细粒度资源调度方法,该方法根据相似任务运行时信息推测任务资源需求;将任务划分为若干执行阶段,分阶段匹配资源,从分配时间和分配资源量两方面细化资源分配粒度;资源匹配过程中,基于资源可压缩特性进一步提高资源利用率和性能;采用资源监控、策略调整、约束检查等机制保证资源使用效率和负载性能.在开源云资源管理平台中,基于细粒度资源调度方法实现了调度器.实验结果表明:细粒度资源调度方法可以在不丧失公平性且调度响应时间可接受的前提下,细化资源匹配的粒度,有效提高云计算平台资源利用率和性能.

关 键 词:细粒度  调度  云计算  资源管理  平台优化
收稿时间:2017/10/16 0:00:00
修稿时间:2018/6/20 0:00:00

Dynamically Fine-grained Scheduling Method in Cloud Environment
ZHOU Mo-Song,DONG Xiao-She,CHEN Heng,ZHANG Xing-Jun.Dynamically Fine-grained Scheduling Method in Cloud Environment[J].Journal of Software,2020,31(12):3981-3999.
Authors:ZHOU Mo-Song  DONG Xiao-She  CHEN Heng  ZHANG Xing-Jun
Affiliation:Faculty of Electronics and Information Engineering, Xi''an Jiaotong University, Xi''an 710049, China
Abstract:The coarse-grained scheduling used in cloud computing platform allocates fixed quantity resources to tasks. However, this allocation can easily lead to problems such as resource fragmentation, over-commitment and inefficient resource utilization. This study proposes a dynamically fine-grained scheduling method to resolve those problems. This method estimates resource requirement of task according to similar tasks and divides tasks into execution stages according to the task requirement, and it also matches task resource requirement and available server resources by stages to refine two aspects of allocation granularity: allocation duration and allocation quantity. Furthermore, this method may compress resource allocation to further improve resource utilization and performance, and this method uses several mechanisms including runtime resource monitoring, allocation policy adjustments, and scheduling constraint checks to ensure resource utilization and performance of cloud computing platform. Based on this method, a scheduler has been implemented in the open source cloud computing platform Yarn. The test results show that the dynamically fine-grained scheduling method can resolve resource allocation problems by significantly improving resource utilization and performance with acceptable fairness and scheduling response times.
Keywords:fine-grained  schedule  cloud computing  resource management  platform optimization
本文献已被 万方数据 等数据库收录!
点击此处可从《软件学报》浏览原始摘要信息
点击此处可从《软件学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号