首页 | 本学科首页   官方微博 | 高级检索  
     

云平台下基于截止时间的自适应调度策略
引用本文:吴仁彪,张振驰,贾云飞,乔晗.云平台下基于截止时间的自适应调度策略[J].计算机应用,2023,43(1):176-184.
作者姓名:吴仁彪  张振驰  贾云飞  乔晗
作者单位:天津市智能信号与图像处理重点实验室(中国民航大学),天津 300300
基金项目:天津市研究生科研创新项目(2020YJSS008)
摘    要:针对在共享集群中进行任务调度时,无法兼顾任务的响应速度与任务完成时间的问题,提出一种基于截止时间的自适应调度算法。该算法以用户提交的截止时间为依据,根据任务的执行进度自适应地分配适当的计算资源。不同于传统调度方式里由用户提交固定资源参数,该算法在资源约束的情况下会对优先级高的任务进行抢占式调度以保证服务质量(QoS),并在抢占过程结束后额外分配资源补偿被抢占的任务。在Spark平台进行的任务调度实验结果显示,与另一种资源协调者(YARN)框架下的调度算法相比,所提算法能严格地控制短任务的响应速度,并使长作业的任务完成时间缩短35%。

关 键 词:云平台任务调度  服务质量  自适应  任务抢占  Spark  
收稿时间:2021-11-29
修稿时间:2022-05-06

Adaptive scheduling strategy based on deadline under cloud platform
Renbiao WU,Zhenchi ZHANG,Yunfei JIA,Han QIAO.Adaptive scheduling strategy based on deadline under cloud platform[J].journal of Computer Applications,2023,43(1):176-184.
Authors:Renbiao WU  Zhenchi ZHANG  Yunfei JIA  Han QIAO
Affiliation:Tianjin Key Laboratory of Advanced Signal Processing (Civil Aviation University of China),Tianjin 300300,China
Abstract:Aiming at the problem that the response speed and the completion time of the task cannot be taken into account at the same time when scheduling tasks in a shared cluster, an adaptive scheduling algorithm based on deadline was proposed. In the algorithm, based on the deadline submitted by the user, the appropriate computing resources were allocated adaptively according to the execution progress of the tasks. Different from that fixed resource parameters were submitted by users in the traditional scheduling methods, in this algorithm, tasks with high priority would be executed with preemptive scheduling under resource constraints. Preemptive scheduling was used to ensure the Quality of Service (QoS), and additional resources would be allocated to compensate the preempted tasks after the preemption process. The task scheduling experimental results on the Spark platform show that compared with the scheduling algorithm under Yet Another Resource Negotiator (YARN) framework, the proposed algorithm can control the response speed of short tasks strictly and shorten the task completion time of long jobs by 35%.
Keywords:cloud platform task scheduling  Quality of Service (QoS)  adaptive  task preemption  Spark  
点击此处可从《计算机应用》浏览原始摘要信息
点击此处可从《计算机应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号