云工作流中基于分时虚拟机的任务层调度算法

云计算是新的一种面向市场的商业计算模式,向用户按需提供服务,云计算的商业特性使其关注向用户提供服务的服务质量。任务调度和资源分配是云计算中两个关键的技术,所使用的虚拟化技术使得其资源分配和任务调度有别于以往的并行分布式计算。目前主要的调度算法是借鉴网格环境下的调度策略,研究基于QoS的调度算法,存在执行效率较低的问题。我们对云工作流任务层调度进行深入研究,分析由底层资源虚拟化形成的虚拟机的特性,结合工作流任务的各类QoS约束,提出了基于虚拟机分时特性的任务层ACS调度算法。经过试验,我们提出的算法相比于文献[1]中的算法在对于较多并行任务的执行上存在较大的优势,能够很好的利用虚拟的分时特性,优化任务到虚拟机的调度。     

Preemptive cloud resource allocation modeling of processing jobs

Cloud computing allows execution and deployment of different types of applications such as interactive databases or web-based services which require distinctive types of resources. These applications lease cloud resources for a considerably long period and usually occupy various resources to maintain a high quality of service (QoS) factor. On the other hand, general big data batch processing workloads are less QoS-sensitive and require massively parallel cloud resources for short period. Despite the elasticity feature of cloud computing, fine-scale characteristics of cloud-based applications may cause temporal low resource utilization in the cloud computing systems, while process-intensive highly utilized workload suffers from performance issues. Therefore, ability of utilization efficient scheduling of heterogeneous workload is one challenging issue for cloud owners. In this paper, addressing the heterogeneity issue impact on low utilization of cloud computing system, conjunct resource allocation scheme of cloud applications and processing jobs is presented to enhance the cloud utilization. The main idea behind this paper is to apply processing jobs and cloud applications jointly in a preemptive way. However, utilization efficient resource allocation requires exact modeling of workloads. So, first, a novel methodology to model the processing jobs and other cloud applications is proposed. Such jobs are modeled as a collection of parallel and sequential tasks in a Markovian process. This enables us to analyze and calculate the efficient resources required to serve the tasks. The next step makes use of the proposed model to develop a preemptive scheduling algorithm for the processing jobs in order to improve resource utilization and its associated costs in the cloud computing system. Accordingly, a preemption-based resource allocation architecture is proposed to effectively and efficiently utilize the idle reserved resources for the processing jobs in the cloud paradigms. Then, performance metrics such as service time for the processing jobs are investigated. The accuracy of the proposed analytical model and scheduling analysis is verified through simulations and experimental results. The simulation and experimental results also shed light on the achievable QoS level for the preemptively allocated processing jobs.     

An energy-efficient task scheduling for mobile devices based on cloud assistant

Mobile cloud computing is an emerging service model to extend the capability and the battery life of mobile devices. Mostly one network application can be decomposed into fine-grained tasks which consist of sequential tasks and parallel tasks. With the assistance of mobile cloud computing, some tasks could be offloaded to the cloud for speeding up executions and saving energy. However, the task offloading results in some additional cost during the communication between cloud and mobile devices. Therefore, this paper proposes an energy-efficient scheduling of tasks, in which the mobile device offloads appropriate tasks to the cloud via a Wi-Fi access point. The scheduling aims to minimize the energy consumption of mobile device for one application under the constraint of total completion time. This task scheduling problem is reconstructed into a constrained shortest path problem and the LARAC method is applied to get the approximate optimal solution. The proposed energy-efficient strategy decreases 81.93% of energy consumption and 25.70% of time at most, compared with the local strategy. Moreover, the applicability and performance of the proposed strategy are verified in different patterns of applications, where the time constraint, the workload ratio between communication and computation are various.     

云环境下基于模板遗传算法的任务调度方法

云任务调度是云计算研究的一个热点。云任务调度方法的好坏直接影响云平台的整体性能。提出一种基于模板遗传算法(TBGA)的任务调度方法。首先,根据处理机的运算速度和带宽等条件,计算出每个处理机应分配的任务量模板大小;然后,根据模板大小将任务集合中的任务划分为多个子集合;最后,利用遗传算法将集合中的任务分配到对应的处理机。实验证明通过此方法能得到总任务完成时间较短的调度结果。通过仿真实验将TBGA算法与Min-Min算法和遗传算法(GA)进行比较,实验结果表明,TBGA算法与Min-Min算法相比任务集合完成时间降低了20%左右,与遗传算法相比任务集合完成时间降低了30%左右,是一种有效的任务调度算法。     

Logistics service scheduling with manufacturing provider selection in cloud manufacturing

In service-oriented manufacturing models, manufacturing resources in different enterprises are integrated and shared through network, cloud platforms, and logistics. On cloud manufacturing platforms, service providers offer on-demand manufacturing services to service demanders according to supply-demand matching results. As a special type of manufacturing services, logistics services provide transportation capabilities for production services and demanders. It is a critical issue to schedule logistics services efficiently, especially when manufacturer selections have been planned. This research focuses on the logistics scheduling problem in cloud manufacturing with pre-selected manufacturers. We analyze this optimization problem from aspects of tasks, production services, logistics services, and optimization objectives. Then a logistics scheduling method is proposed to reduce the average delivery time from manufacturers to customers. In the proposed method, the total time from start points of logistics to demanders is considered to reduce the average delivery time of all tasks. Based on four different scenarios, we build their scheduling models and run simulations to verify the effectiveness of the proposed method. Results show that the average task delivery time of the proposed method is shorter than three typical strategies.     

Towards IoT-enabled dynamic service optimal selection in multiple manufacturing clouds

With the Internet of Things, it is now possible to sense the real-time status of manufacturing objects and processes. For complex Service Selection (SS) in Cloud Manufacturing, real-time information can be utilized to deal with uncertainties emerging during task execution. Moreover, in the face of diversified demands, multiple manufacturing clouds (MCs) can provide a much wider range of choices of services with their real-time status. However, most researchers have neglected the superiority of multiple MCs and failed to make a study of how to utilize the abundant and diverse resources of multiple MCs, let alone the multi-MCs service mode under dynamic environment. Therefore, we first propose a new dynamic SS paradigm that can leverage the abundant services from multiple MCs, real-time sensing ability of the Internet of Things (IoT) and big data analytics technology for knowledge and insights. In this way, providing optimal manufacturing services (with high QoS) for customers can be guaranteed under dynamic environments. In addition, considering that a relatively long time might be spent to complete a complex manufacturing task after SS, a quantified approach, based on the Analytic Hierarchy Process and big data, is proposed to evaluate whether the intended cloud manufacturing services should be reserved to make sure that eligible services are ready to use without compromising cost or time. In this paper, the problem of IoT-enabled dynamic SS across multiple MCs is formulated in detail to enable an event-driven adaptive scheduling when the model is faced with three kinds of uncertainties (of the service market, service execution and the user side respectively). Experiments with different settings are also performed, which show the advantages of our proposed paradigm and optimization model.     

云制造环境下的动态调度

在云制造环境下, 制造资源和制造能力以服务的形式封装起来, 不同的任务通过云端汇集到云平台并通过合适的调度给每个任务分配相应的服务. 由于任务在执行的过程中的不确定性, 会在某个时刻遇到突发状况从而导致对余下任务的重调度问题. 因此, 针对该问题, 考虑到云制造环境下任务的复杂性和多样性会导致在合理的时间段内很难找到最优解, 以所有任务的最大完成时间为优化目标, 提出了一种以改进的遗传算法与邻域搜索技术相结合的元启发式算法, 旨在解决云制造环境下由于任务和资源服务等的不确定性导致的重调度问题. 实验结果表明,本文所提出的算法能够很好地解决动态调度过程中的重调度问题, 并可以快速地获取最优解.     

云计算中基于优先级和费用约束的任务调度算法

针对云计算中的服务质量保证问题,提出一种基于优先级和费用约束的任务调度算法。该算法通过计算任务优先级和资源服务能力,分别对任务和资源进行排序和分组,并根据优先级高低和服务能力强弱建立任务组和资源组间的调度约束关联;再通过计算任务在关联资源组内不同资源上的完成时间和费用,将任务按优先级高低依次调度到具有任务完成时间和费用折中值最小的资源上。与Min-Min和QoS-Guided-Min算法的对比实验结果表明,该算法具有良好的系统性能和负载均衡性,并降低了服务总费用。     

Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems

As the cost-driven public cloud services emerge, budget constraint is one of the primary design issues in large-scale scientific applications executed on heterogeneous cloud computing systems. Minimizing the schedule length while satisfying the budget constraint of an application is one of the most important quality of service requirements for cloud providers. A directed acyclic graph (DAG) can be used to describe an application consisted of multiple tasks with precedence constrains. Previous DAG scheduling methods tried to presuppose the minimum cost assignment for each task to minimize the schedule length of budget constrained applications on heterogeneous cloud computing systems. However, our analysis revealed that the preassignment of tasks with the minimum cost does not necessarily lead to the minimization of the schedule length. In this study, we propose an efficient algorithm of minimizing the schedule length using the budget level (MSLBL) to select processors for satisfying the budget constraint and minimizing the schedule length of an application. Such problem is decomposed into two sub-problems, namely, satisfying the budget constraint and minimizing the schedule length. The first sub-problem is solved by transferring the budget constraint of the application to that of each task, and the second sub-problem is solved by heuristically scheduling each task with low-time complexity. Experimental results on several real parallel applications validate that the proposed MSLBL algorithm can obtain shorter schedule lengths while satisfying the budget constraint of an application than existing methods in various situations.     

基于动态匹配网络的制造服务组合自适应方法

云制造（cloud manufacturing,CMfg）模式下,制造任务和制造服务都处于动态变化的环境中,制造服务组合的动态适应能力问题亟待解决.针对这一问题,以制造任务和制造服务的匹配关系为基础,构建了制造任务-制造服务动态匹配网络（dynamic matching network,DMN）理论模型,在此基础上提出了一种三阶段的制造服务组合自适应方法（three-phase manufacturing service composition self-adaptive approach,TPMSCSAA）.第一阶段通过负载队列模型对QoS进行动态评估,以负载和动态QoS为优化目标,将最优制造服务组合问题转化为制造服务网络中最短路径的搜索,实现制造服务的动态调度;第二阶段对不同类型的制造任务和制造服务变更进行实时获取,同步更新制造任务网络和制造服务网络;第三阶段触发动态调度算法,完成动态匹配边的重构.最后,通过对电梯设计服务组合的实验仿真,验证了方法的可行性和有效性.     

一种云环境中的动态细粒度资源调度方法

云计算平台中普遍采用固定资源量的粗粒度资源分配方式,由此会引起资源碎片、过度分配、低集群资源利用率等问题.针对此问题,提出一种细粒度资源调度方法,该方法根据相似任务运行时信息推测任务资源需求;将任务划分为若干执行阶段,分阶段匹配资源,从分配时间和分配资源量两方面细化资源分配粒度;资源匹配过程中,基于资源可压缩特性进一步提高资源利用率和性能;采用资源监控、策略调整、约束检查等机制保证资源使用效率和负载性能.在开源云资源管理平台中,基于细粒度资源调度方法实现了调度器.实验结果表明:细粒度资源调度方法可以在不丧失公平性且调度响应时间可接受的前提下,细化资源匹配的粒度,有效提高云计算平台资源利用率和性能.     

能耗优化的流媒体传输任务调度研究

随着信息技术和网络技术的迅速发展,三网融合使得智能电视系统迅速发展,随着云计算技术的出现,基于云计算构架的流媒体平台成为智能电视主流发展方向。智能电视系统提供的视频点播业务迅猛增长,其相应的流媒体传输任务无论在性能上,还是能耗上都成为需要解决的问题。针对智能电视系统中视频点播业务的流媒体传输任务调度问题,提出了一种能耗优化的流媒体传输任务调度算法。该算法根据预测任务时间长度区分不同类型的任务并分别分配到各自类型的节点执行,将碎片化的任务集中调度,让尽可能少的服务器以较高负载状态执行任务从而达到整体能耗减少的目的。相关实验结果表明,该算法可以在不影响服务质量的前提下对能耗实现一定程度的优化。     

Dynamic task assignment and resource management in cloud services by using bargaining solution

Cloud computing provides infrastructure, platform and software as services to customers. For the purpose of providing reliable and truthful service, a fair and elastic resource allocation strategy is essential from the standpoint of service customers. In this paper, we propose a game theoretic mechanism for dynamic cloud service management, including task assignment and resource allocation to provide reliable and truthful cloud services. A user utility function is first devised considering the dynamic characteristics of cloud computing. The elementary stepwise system is then applied to efficiently assign tasks to cloud servers. A resource allocation mechanism based on bargaining game solution is also adopted for fair resource allocation in terms of quality of service of requested tasks. Through numerical experiments, it is shown that the proposed mechanism guarantees better system performance than several existing methods. The experimental results show that the mechanism completes the requested tasks earlier with relatively higher utility while providing a significant level of fairness compared with existing ones. The proposed mechanism is expected to support cloud service providers in elastically managing their limited resources in a cloud computing environment in terms of quality of service. Copyright © 2013 John Wiley & Sons, Ltd.     

基于双层规划的容器云资源动态配置算法

本文分析容器云资源动态配置决策问题,通过定义容器云资源的调度任务,求解得到容器云资源调度时间;利用容器云资源调度任务的最短时间矩阵,获取容器云资源调度所需的条件。在双层规划条件下,求解容器云资源调度的目标函数和约束函数;考虑到用户的任务情况和云数据中心的云资源状况,在虚拟机上构建一个到物理主机的矩阵,通过构建容器云资源动态配置结果在优化时的目标函数,结合约束条件,实现容器云资源的动态配置。实验结果表明,资源动态配置算法不仅可以提高容器云资源的利用率,还可以减少配置完成时间,具有更好的动态配置性能。     

混合云中基于截止时间和费用约束的调度方法研究*

针对混合云调度中私有云利用率不高和公有云费用偏高的问题,基于性能和费用目标提出了两个调度策略—截止时间优先和费用优先策略,建立了混合云中的任务和资源模型,能够根据用户提交的任务需求自适应选择合适的调度资源,对截止时间要求比较高的任务可以优先调度至公有云,对费用要求高的任务可以优先调度至私有云,而且两种策略均满足截止时间和一定的费用约束,因此相对于其它类似的基准调度方法,本文的两种调度策略在调度完成时间、费用、截止时间超出率和私有云利用率等方面均有很好的表现,尤其是当任务量比较大的时候,两种调度策略表现出更好的自适应性和优势。     

Research on the collaboration of service selection and resource scheduling for IoT simulation workflows

Cloud resources provide a promising way to efficiently perform the needed simulation tasks for a complex manufacturing process. Most of the existing work focuses only on how to effectively schedule computing resources to execute computing requirements of simulation workflows in Internet of Things (IoT) applications. Research on the scheduling of simulation workflows in consideration of task ordering, service selection, and resource allocation altogether has not been lacking. To fill in this void, this paper proposes a cloud-based 3-stage workflow scheduling model. Before scheduling computing resources to complete task requirements, the order of the tasks is determined and the services that can meet the task requirements are selected. In this model, the workload to satisfy task requirements is not fixed and takes on a different value depending upon the service selected with its unique complexity and accuracy. An optimization function that transforms and integrates makespan, cost, and accuracy in a unique way is proposed. For its solution, the relatively new symbiotic organisms search (SOS) algorithm is modified and two SOS-based optimization strategies are developed, i.e., joint optimization-based SOS (JOSOS) and split optimization-based SOS (SOSOS). The simulation results reveal that SOS-based algorithms, especially the SOSOS method, outperform all compared algorithms. Based on the proposed method, simulation services and computing resources can be rationally selected and scheduled to ensure the requirements of IoT applications.     

一种多QoS目标约束的云计算任务调度策略

针对云计算环境下大量用户任务请求各异的服务质量（Quality of Service, QoS）调度目标要求,通过综合考虑云用户任务的截止时间底线、调度预算等QoS目标约束条件以及各类可用资源的性能参数,对任务调度的多QoS目标约束条件进行形式化建模,基于构造的隶属度函数将多QoS目标约束的优化求解问题转化成一个单目标约束的优化问题,对转化后的单目标约束优化问题进行近似求解,最终提出一种多QoS目标约束的云计算任务调度策略。在CloudSim模拟器上的仿真结果表明,提出的多QoS目标约束的云计算任务调度策略总体上优于传统的Min-min算法以及改进的以QoS为导向的Min-min算法。     

An Effective Cloud Workflow Scheduling Approach Combining PSO and Idle Time Slot-Aware Rules

Workflow scheduling is a key issue and remains a challenging problem in cloud computing.Faced with the large number of virtual machine(VM)types offered by cloud providers,cloud users need to choose the most appropriate VM type for each task.Multiple task scheduling sequences exist in a workflow application.Different task scheduling sequences have a significant impact on the scheduling performance.It is not easy to determine the most appropriate set of VM types for tasks and the best task scheduling sequence.Besides,the idle time slots on VM instances should be used fully to increase resources'utilization and save the execution cost of a workflow.This paper considers these three aspects simultaneously and proposes a cloud workflow scheduling approach which combines particle swarm optimization(PSO)and idle time slot-aware rules,to minimize the execution cost of a workflow application under a deadline constraint.A new particle encoding is devised to represent the VM type required by each task and the scheduling sequence of tasks.An idle time slot-aware decoding procedure is proposed to decode a particle into a scheduling solution.To handle tasks'invalid priorities caused by the randomness of PSO,a repair method is used to repair those priorities to produce valid task scheduling sequences.The proposed approach is compared with state-of-the-art cloud workflow scheduling algorithms.Experiments show that the proposed approach outperforms the comparative algorithms in terms of both of the execution cost and the success rate in meeting the deadline.     

云计算环境下的节能任务调度策略的随机Petri网分析

针对当前云计算异构服务器集群环境下的高能耗问题,提出一种最小能耗优先的任务调度策略(first sche-duling with minimum energy)。该策略在调度任务时优先考虑处于运行状态的服务器,并以任务响应时间为约束,按照最小能耗原则将任务分配到相应的服务器上执行。当处于运行状态的服务器都不能满足任务对响应时间的要求时,则考虑处于休眠状态的服务器;同时,也基于最小能耗原则进行调度。采用随机Petri网工具对节能任务调度策略进行分析建模,考虑其能耗和相关性能指标。实验结果表明,该方法不仅能满足任务的QoS性能要求,而且具有较好的节能效果。