异构集群中CPU与GPU协同调度算法的设计与实现

为有效提高异构的CPU/GPU集群计算性能,提出一种支持异构集群的CPU与GPU协同计算的两级动态调度算法。根据各节点计算能力评测结果和任务请求动态分发数据,在节点内CPU和GPU之间动态调度任务,使用数据缓存和数据处理双队列机制,提高异构集群的传输和处理效率。该算法实现了集群各节点“能者多劳”,避免了单节点性能瓶颈造成的任务长尾现象。实验结果表明,该算法较传统MPI/GPU并行计算性能提高了11倍。

Design and implementation of CPU and GPU cooperative scheduling algorithm with heterogeneous clusters

To effectively improve the computing performance of heterogeneous CPU/GPU clusters,a two-level dynamic scheduling algorithm of CPU and GPU cooperative computing in heterogeneous cluster was proposed.Data were dynamically distributed according to each node’s computing capability evaluation result and task request,and tasks were dynamically scheduled between the CPU and GPU in the node,and data caching and data processing dual queue mechanism were used to improve the transmission and processing efficiency of heterogeneous clusters.The algorithm realizes that each node of the cluster follows the rule that the abler ones do more and avoids the long tail phenomenon of the task caused by the single node performance bottleneck.The experimental results show that the performance of parallel computing using this algorithm is 11 times better than that of traditional MPI/GPU parallel computing.