面向大规模云资源调度的可扩展分布式调度方法

云数据中心异构物理服务器的能耗优化资源分配问题是NP难的组合优化问题,当资源分配问题规模较大时,求解的空间比较大,很难在合理时间内求得最优解。基于分而治之的思想,从调度模式方面提出可扩展分布式调度方法,即当云数据中心待调度的物理服务器的数量比较大时,将待调度的服务器划分为若干个服务器集群,然后在每个服务器集群建立能耗优化的资源分配模型,并利用约束编程框架Choco求解模型,获得能耗最优的资源分配方式。将提出的基于可扩展分布式调度方法的能耗优化云资源调度算法与非扩展调度算法进行实验比较,实验结果表明,提出的基于可扩展分布式调度方法的能耗优化云资源调度算法在大规模云资源分配上有明显的性能优势。     

云中多媒体应用中基于混合DAG的最优任务调度研究

云计算的平台优势使得它在多媒体应用中得到广泛使用。由于多媒体服务的多样性和异构性,如何将多媒体任务有效地调度至虚拟机进行处理成为当前多媒体应用的研究重点。对此,研究了云中多媒体最优任务调度问题,首先引入有向无环图来模拟任务中的优先级及任务之间的依赖性,分别对串行、并行、混合结构任务调度模型进行任务调度研究,根据有限资源成本将关键路径中任务节点融合,提出一种实用的启发式近似最优调度方法。实验结果表明,所提调度方法能够以最短的执行时间在有限的资源成本下完成最优的任务分配。     

云边环境下基于博弈论的两阶段任务迁移策略

移动边缘计算（MEC）为计算密集型应用和资源受限的移动设备之间的冲突提供了有效解决办法,但大多关于MEC迁移的研究仅考虑移动设备与MEC服务器之间的资源分配,忽略了云计算中心的巨大计算资源。为了充分利用云和MEC资源,提出一种云边协作的任务迁移策略。首先,将云边服务器的任务迁移问题转化为博弈问题;然后,证明该博弈中纳什均衡（NE）的存在以及唯一性,并获得博弈问题的解决方案;最后,提出了一种基于博弈论的两阶段任务迁移算法来求解任务迁移问题,并通过性能指标对该算法的性能进行了评估。仿真结果表明,采用所提算法所产生的总开销分别比本地执行、云中心服务器执行和MEC服务器执行的总开销降低了72.8%、47.9%和2.65%,数值结果证实了所提策略可以实现更高的能源效率和更低的任务迁移开销,并且随着移动设备数量的增加可以很好地扩展规模。     

双层虚拟化云架构下任务调度能耗优化算法

虚拟机上部署容器的双层虚拟化云架构在云数据中心中的使用越来越广泛。为了解决该架构下云数据中心的能耗问题,提出了一种工作流任务调度算法TUMS-RTC。针对有截止时间约束的并行工作流,算法将调度过程划分为时间利用率最大化调度和运行时间压缩两个阶段。时间利用率最大化调度通过充分使用给定的时间范围减少完成工作流所需的虚拟机和服务器数量;运行时间压缩阶段通过压缩虚拟机空闲时间以缩短虚拟机和服务器的工作时间,最终达到降低能耗的目标。使用大量特征可控的随机工作流对TUMS-RTC算法的性能进行了测试。实验结果表明,TUMS-RTC算法相较于对比算法有更高的资源利用率,虚拟机数量减少率和能耗节省率,并且可以很好地处理云计算中规模大且并行度高的工作流。     

基于双层规划的容器云资源动态配置算法

本文分析容器云资源动态配置决策问题,通过定义容器云资源的调度任务,求解得到容器云资源调度时间;利用容器云资源调度任务的最短时间矩阵,获取容器云资源调度所需的条件。在双层规划条件下,求解容器云资源调度的目标函数和约束函数;考虑到用户的任务情况和云数据中心的云资源状况,在虚拟机上构建一个到物理主机的矩阵,通过构建容器云资源动态配置结果在优化时的目标函数,结合约束条件,实现容器云资源的动态配置。实验结果表明,资源动态配置算法不仅可以提高容器云资源的利用率,还可以减少配置完成时间,具有更好的动态配置性能。     

面向云计算的期限约束的MapReduce作业调度方法

提出一种面向异构云计算环境的截止时间约束的MapReduce作业调度方法。使用加权偶图建模MapReduce作业调度问题,将Map任务及Reduce任务与资源槽分为2个节点集合,连接2个节点集合的边的权重为任务在资源槽上的执行时间。进而,使用整数线性规划求解最小加权偶图匹配,从而得到任务到资源槽的调度方案。本文考虑了云计算环境下异构节点任务处理时间的差异性,在线动态评估和调整任务的截止时间,从而提升了MapReduce作业处理的性能。实验结果表明,所提出的方法缩短了作业数据访问的时间,最小化了截止时间冲突的作业数量。     

基于非协作博弈的边缘分布式缓存方案

随着多媒体数据流量的急剧增长,传统云计算模式难以满足用户对于低延时和高带宽的需求.虽然边缘计算中基站等边缘设备拥有的计算能力以及基站与用户之间的短距离通信能够使用户获得更高的服务质量,但是如何利用边缘节点的收益和成本之间的关系设计边缘缓存策略,仍然是一个具有挑战性的问题.利用5G和协作边缘计算技术,在大量短视频应用场景下,提出了一种协作边缘缓存技术来同时解决以下3个问题：（1）通过减少传输延时,提高了用户的服务体验;（2）通过近距离传输,降低了骨干网络的数据传输压力;（3）分布式的工作模式减少了云服务器的工作负载.首先定义了一个协作边缘缓存模型,其中,边缘节点配备有容量有限的存储空间,移动用户可以接入这些边缘节点,一个边缘节点可以服务多个用户;其次,设计了一个非协作博弈模型来研究边缘节点之间的协作行为,每一个边缘节点看成一个玩家并且可以做出缓存初始和缓存重放策略;最后,找到了该博弈的纳什均衡,并设计了一个分布式的算法以达到均衡.实验仿真结果表明,提出的边缘缓存策略能够降低用户20%的延时,并且减少了80%的骨干网络的流量.     

Resource scheduling approach for multimedia cloud content management

With the development of multimedia application and services, the multimedia technology has already permeated each aspect of our life. Multimedia cloud is used for processing multimedia services. However due to huge data volume, high concurrency, strict real-time, resource scheduling for content dissemination in multimedia cloud still remain challenges. In order to increase the user satisfaction and decrease completion time of content dissemination, the resource scheduling for content dissemination in multimedia cloud is proposed in this paper. The multimedia jobs are clustered according to user expectation and job complexity. The job with highest priority will be executed first. Moreover, considered multimedia task types and the impact of stragglers, the multimedia task scheduling based on task types and node workload is presented, which is a time-efficient scheduling approach. The experiments are conducted and the experiment results show that the job clustering algorithm-based user expectation and job complexity in multimedia cloud has better user satisfaction and shorter completion time, while the multimedia task scheduling based on task types and node workload can reduce completion time and achieve load-balancing.     

A novel resource allocation mechanism for live cloud-based video streaming service

With the recent emergence of cloud computing, growing numbers of clients are using online cloud services through the Internet such as video streaming service. The rent costs of cloud service providers increase when the resource utilizations of the cloud-servers are not well. Therefore, resource allocation is a crucial problem for cloud data centers. The resource allocation problem is an NP-hard problem. This paper proposes a novel cloud resource allocation mechanism based on a winning strategy for a Nim game. This mechanism offers all clients an effective number of running cloud servers, and allocates cloud resources rapidly and effectively by using a pre-pairing approach. The proposed mechanism does not require searching for remaining resources of the running cloud server; hence, it can reduce the time taken to arrange resources. The experimental results show that the proposed mechanism can improve utilization of cloud servers and reduce the rent costs of the cloud service providers. The proposed mechanism can reach the utilization of cloud servers by as much as 99.96 %. The proposed mechanism is approximately 9 % more efficient than the market-based grid resource allocation algorithm, and 19 % more efficient than the modified best fit decreasing algorithm.

     

基于云存储的多用户可搜索加密方案

云存储服务允许用户外包数据并以此来降低资源开销。针对云服务器不被完全信任的现状,文章研究如何在云环境下对数据进行安全存储和加密搜索。多用户的可搜索加密方案为用户提供了一种保密机制,使用户可以在不受信任的云存储环境下安全地共享信息。在现有的可搜索加密方案的基础上,文章提出了一种安全有效的带关键字搜索的加密方案,以及更加灵活的密钥管理机制,降低了云端数据处理的开销。     

基于概率性能感知演化博弈策略的“云+边”混合环境中任务卸载方法

针对“中心云服务器+多个边缘服务器”构成的“云+边”混合环境中多任务卸载效率不足的问题,提出了一种基于概率性能感知演化博弈策略的任务卸载方法。首先,在一个“中心云服务器+多个边缘服务器”构成的“云+边”混合环境中,假设其中分布的边缘服务器具有时变波动的性能,采用一种基于概率性能感知演化博弈策略的任务卸载方法对边缘云服务器的历史性能数据进行概率分析,以获得演化博弈模型;然后,生成服务卸载的演化稳定策略（ESS）,使每个用户都能在获得高满意度的前提下进行任务的卸载。基于云边缘资源位置数据集和云服务性能测试数据集进行模拟实验,在24个连续时间窗口上进行不同方法的测试比较。实验结果表明,所提方法在多个性能指标上都优于传统的贪婪（Greedy）算法、遗传算法（GA）和基于纳什均衡的博弈论算法等任务卸载方法。该方法的平均用户期望达成度相较于三个对比方法分别提升了13.7%、117.0%、13.8%,平均卸载时延分别降低了6.5%、24.9%、8.3%,平均货币成本分别降低了67.9%、88.7%、18.0%。     

虚拟云下满足多重约束的时限敏感任务调度算法

目前以虚拟云服务平台作为强大计算平台的虚拟云环境下,许多现存调度方法致力于合并虚拟机以减少物理机数目,从而达到减少能源消耗的目的,但会引入高额虚拟机迁移成本;此外,现存方法也没有考虑导致用户高额支付成本的成本因子影响。以减少云服务提供者能源消耗和云服务终端用户支付成本为目标,同时保障用户任务的时限要求,提出一种能源与时限可感知的非迁移调度（EDA-NMS）算法。EDA-NMS利用任务时限的松弛度,延迟宽松时限任务的执行从而无需唤醒新的物理机,更无需引入虚拟机动态迁移成本,以达到减少能源消耗的目的。多重扩展实验结果表明,EDA-NMS采用成本和能耗有效的虚拟机实例类型组合方案,与主动及响应式调度（PRS）算法相比,在减少静态能耗的同时,能更有效地满足用户关键任务的敏感时限并确保用户支付成本最低。     

An efficient scheduling optimization strategy for improving consistency maintenance in edge cloud environment

The development of Internet of Things leads to an increase in edge devices, and the traditional cloud is unable to meet the demands of the low latency of numerous devices in edge area. On the hand, the media delivery requires high-quality solution to meet ever-increasing user demands. The edge cloud paradigm is put forward to address the issues, which facilitates edge devices to acquire resources dynamically and rapidly from nearby places. However, in order to complete as many tasks as possible in a limited time to meet the needs of users, and to complete the consistency maintenance in as short a time as possible, a two-level scheduling optimization scheme in an edge cloud environment is proposed. The first-level scheduling is by using our proposed artificial fish swarm-based job scheduling method, most jobs will be scheduled to edge data centers. If the edge data center does not have enough resource to complete, the job will be scheduled to centralized cloud data center. Subsequently, the job is divided into same-sized tasks. Then, the second-level scheduling, considering balance load of nodes, the edge cloud task scheduling is proposed to decrease completion time, while the centralized cloud task scheduling is presented to reduce total cost. The experimental results show that our proposed scheme performs better in terms of minimizing latency and completion time, and cutting down total cost.

     

Fitness rate-based rider optimization enabled for optimal task scheduling in cloud

ABSTRACT

Not long ago, there has been a dramatic augment in the attractiveness of cloud computing systems that depends computing resources on-demand, bill on a pay-as-you-go basis, and multiplex many users on the same physical infrastructure. It is considered as an essential pool of resources, which are offered to users through Internet. Without troubling the fundamental infrastructure, pay-per-use computing resources are provided to the users by the cloud computing technology. Scheduling is a significant dilemma in cloud computing as a cloud provider has to serve multiple users in cloud environment. This proposal plans to implement an optimal task scheduling model in cloud sector as a challenge over the existing technologies. The proposed model solves the task scheduling problem using an improved meta-heuristic algorithm called Fitness Rate-based Rider Optimization Algorithm (FR-ROA), which is the advanced form of conventional Rider Optimization Algorithm (ROA). The objective constraints considered for optimal task scheduling are the maximum makespan or completion time, and the sum of the completion times of entire tasks. Since the proposed FR-ROA has attained the advantageous part of reaching the convergence in a small duration, the proposed model will outperform the other conventional algorithms for accomplishing the optimal task scheduling in cloud environment.     

A new multi-objective bi-level programming model for energy and locality aware multi-job scheduling in cloud computing

How to reduce power consumption of data centers has received worldwide attention. By combining the energy-aware data placement policy and locality-aware multi-job scheduling scheme, we propose a new multi-objective bi-level programming model based on MapReduce to improve the energy efficiency of servers. First, the variation of energy consumption with the performance of servers is taken into account; second, data locality can be adjusted dynamically according to current network state; last but not least, considering that task-scheduling strategies depend directly on data placement policies, we formulate the problem as an integer bi-level programming model. In order to solve the model efficiently, specific-design encoding and decoding methods are introduced. Based on these, a new effective multi-objective genetic algorithm based on MOEA/D is proposed. As there are usually tens of thousands of tasks to be scheduled in the cloud, this is a large-scale optimization problem and a local search operator is designed to accelerate convergent speed of the proposed algorithm. Finally, numerical experiments indicate the effectiveness of the proposed model and algorithm.     

任务序列强度感知的大规模集群服务器控制模型

异构云数据中心各类服务器的控制成本和性能上的差异将影响其运维管理成本及QoS博弈平衡关系,针对任务序列强度具有的时效性,提出了任务序列强度感知的大规模任务调度模型。依据当前到达数据中心的任务序列的强度以及集群中服务器的当前状态,在任务调度中强调节约服务器运维管理成本和各服务器负载均衡的基础上实现优化数据中心对任务序列处理的平均响应时间和系统的吞吐量。通过对实验结果的分析,验证了集群服务器控制模型在任务调度中的可信度大于95%,同时通过与当前应用广且具代表性的算法——最短任务优先,公平分发机制进行比较分析,其效果是三者中最好的,也验证了模型的有效性和可行性。     

一种云环境中数据流的高效多目标调度方法

在分布式系统中,云计算作为一种新的服务提供模式出现,其执行科学应用数据流时的优势和缺点得到越来越多的关注,其主要特点为拥有大量同质和并发的任务包,并构成了性能瓶颈的主要因素.在云数据流中调度大规模任务是已被证实的NP难问题.文中专注于解决优化云数据流中的调度过程,并由现实世界启发,从不同角度将优化目标分别划分为用户指标（完工时间和经济成本）和云系统指标（网络带宽、存储约束和系统公平度）,并将该调度问题制定成为一个新的连续的合作博弈,设计出快速收敛的高效Muliti-Objective Game（MOG）调度算法,在优化用户指标的同时,实现系统指标的约束,并保证云资源的效率和公平度.通过综合实验,证实文中方法和其它相关算法相比,在算法复杂度O（l·K·M）（明显改进数量级）,结果质量（一些情况下最佳）,系统级别公平性上具有明显优越性.     

A fault‐tolerant dynamic scheduling method on hierarchical mobile edge cloud computing

Mobile edge cloud computing has been a promising computing paradigm, where mobile users could offload their application workloads to low‐latency local edge cloud resources. However, compared with remote public cloud resources, conventional local edge cloud resources are limited in computation capacity, especially when serve large number of mobile applications. To deal with this problem, we present a hierarchical edge cloud architecture to integrate the local edge clouds and public clouds so as to improve the performance and scalability of scheduling problem for mobile applications. Besides, to achieve a trade‐off between the cost and system delay, a fault‐tolerant dynamic resource scheduling method is proposed to address the scheduling problem in mobile edge cloud computing. The optimization problem could be formulated to minimize the application cost with the user‐defined deadline satisfied. Specifically, firstly, a game‐theoretic scheduling mechanism is adopted for resource provisioning and scheduling for multiprovider mobile applications. Then, a mobility‐aware dynamic scheduling strategy is presented to update the scheduling with the consideration of mobility of mobile users. Moreover, a failure recovery mechanism is proposed to deal with the uncertainties during the execution of mobile applications. Finally, experiments are designed and conducted to validate the effectiveness of our proposal. The experimental results show that our method could achieve a trade‐off between the cost and system delay.     

一种基于深度强化学习与概率性能感知的边缘计算环境多工作流卸载方法

移动边缘计算是一种新兴的分布式和泛在计算模式,其将计算密集型和时延敏感型任务转移到附近的边缘服务器,有效缓解了移动终端资源不足的问题,显著减小了用户与计算处理节点之间的通信传输开销.然而,如果多个用户同时提出计算密集型任务请求,特别是流程化的工作流任务请求,边缘计算环境往往难以有效地进行响应,并会造成任务拥塞.另外,受...     

Lightweight and Informative Traffic Metrics for Data Center Monitoring

In recent years, thousands of commodity servers have been deployed in Internet data centers to run large scale Internet applications or cloud computing services. Given the sheer volume of data communications between servers and millions of end users, it becomes a daunting task to continuously monitor the availability, performance and security of data centers in real-time operational environments. In this paper, we propose and evaluate a lightweight and informative traffic metric, streaming frequency, for network monitoring in Internet data centers. The power-series based metric that is extracted from the aggregated IP traffic streams, not only carries temporal characteristics of data center servers, but also helps uncover traffic patterns of these servers. We show the convergence and reconstructability properties of this metric through theoretical proof and algorithm analysis. Using real data-sets collected from multiple data centers of a large Internet content provider, we demonstrate its applications in detecting unwanted traffic towards data center servers. To the best of our knowledge, this paper is the first to introduce a streaming metric with a unique reconstruction capability that could aid data center operators in network management and security monitoring.