Scheduling multi‐component applications with mobile agents in heterogeneous distributed systems

In grid computing environment, several classes of multi‐component applications exist. These types of applications may often require additional resources of different types that go beyond what is available in any of the sites making up the grid resource composition. The heterogeneity nature of both the user application and the computing environment makes this a challenging problem. However, the current off‐the‐shelf scheduling software can hardly cope with these diversities in distributed computing application frameworks. Therefore, there is the need for an adequate scheduling system that would grant simultaneous or coordinated access to application of multi‐component nature that requires resources of possibly multiple types, in multiple locations, managed by different resource providers. The main focus of this paper is to develop a mobile agent scheduling model that addresses the aforementioned challenge. A scheduling policy that pertains to job scheduling and resource allocation is proposed. The scheduling policy treats different multi‐component applications requiring diverse heterogeneous resources fairly. The policy is used by mobile agents to schedule user applications and to also find available and suitable distributed resource that are capable of executing user application at a very minimal time. Copyright © 2015 John Wiley & Sons, Ltd.     

Coordinated rescheduling of Bag‐of‐Tasks for executions on multiple resource providers

Metaschedulers can distribute parts of a Bag‐of‐Tasks (BoT) application among various resource providers in order to speed up its execution. The expected completion time of the user application is then calculated based on the run‐time estimates of all applications running and waiting for resources. However, because of inaccurate run time estimates, initial schedules are not those that provide users with the earliest completion time. These estimates increase the time distance between the first and last tasks of a BoT application, which increases average user response time, especially in multi‐provider environments. This paper proposes a coordinated rescheduling algorithm to handle inaccurate run‐time estimates when executing BoT applications in multi‐provider environments. The coordinated rescheduling defines which tasks can have start time updated based on the expected completion time of the entire BoT application. We have also evaluated the impact of system‐generated run‐time estimates to schedule BoT applications on multiple providers. We performed experiments using simulations and a real distributed platform, Grid'5000. From our experiments, we obtained reductions of up to 5 and 10% for response time and slowdown metrics, respectively, by using coordinated rescheduling over a traditional rescheduling solution. Moreover, coordinated rescheduling requires little modification of existing scheduling systems. System‐generated predictions, on the other hand, are more complex to be deployed and may not reduce response times as much as coordinated rescheduling. Copyright © 2011 John Wiley & Sons, Ltd.     

A fault‐tolerant dynamic scheduling method on hierarchical mobile edge cloud computing

Mobile edge cloud computing has been a promising computing paradigm, where mobile users could offload their application workloads to low‐latency local edge cloud resources. However, compared with remote public cloud resources, conventional local edge cloud resources are limited in computation capacity, especially when serve large number of mobile applications. To deal with this problem, we present a hierarchical edge cloud architecture to integrate the local edge clouds and public clouds so as to improve the performance and scalability of scheduling problem for mobile applications. Besides, to achieve a trade‐off between the cost and system delay, a fault‐tolerant dynamic resource scheduling method is proposed to address the scheduling problem in mobile edge cloud computing. The optimization problem could be formulated to minimize the application cost with the user‐defined deadline satisfied. Specifically, firstly, a game‐theoretic scheduling mechanism is adopted for resource provisioning and scheduling for multiprovider mobile applications. Then, a mobility‐aware dynamic scheduling strategy is presented to update the scheduling with the consideration of mobility of mobile users. Moreover, a failure recovery mechanism is proposed to deal with the uncertainties during the execution of mobile applications. Finally, experiments are designed and conducted to validate the effectiveness of our proposal. The experimental results show that our method could achieve a trade‐off between the cost and system delay.     

Tracking Control for Stochastic Multi‐Agent Systems Based on Hybrid Event‐Triggered Mechanism

This paper deals with the leader‐following consensus for nonlinear stochastic multi‐agent systems. To save communication resources, a new centralized/distributed hybrid event‐triggered mechanism (HETM) is proposed for nonlinear multi‐agent systems. HETMs can be regarded as a synthesis of continuous event‐triggered mechanism and time‐driven mechanism, which can effectively avoid Zeno behavior. To model the multi‐agent systems under centralized HETM, the switched system method is applied. By utilizing the property of communication topology, low‐dimensional consensus conditions are obtained. For the distributed hybrid event‐triggered mechanism, due to the asynchronous event‐triggered instants, the time‐varying system method is applied. Meanwhile, the effect of network‐induced time‐delay on the consensus is also considered. To further reduce the computational resources by constantly testing whether the broadcast condition has been violated, self‐triggered implementations of the proposed event‐triggered communication protocols are also derived. A numerical example is given to show the effectiveness of the proposed method.     

A cost‐efficient resource provisioning algorithm for DHT‐based cloud storage systems

Personal cloud storage provides users with convenient data access services. Service providers build distributed storage systems by utilizing cloud resources with distributed hash table (DHT), so as to enhance system scalability. Efficient resource provisioning could not only guarantee service performance, but help providers to save cost. However, the interactions among servers in a DHT‐based cloud storage system depend on the routing process, which makes its execution logic more complicated than traditional multi‐tier applications. In addition, production data centers often comprise heterogeneous machines with different capacities. Few studies have fully considered the heterogeneity of cloud resources, which brings new challenges to resource provisioning. To address these challenges, this paper presents a novel resource provisioning model for service providers. The model utilizes queuing network for analysis of both service performance and cost estimation. Then, the problem is defined as a cost optimization with performance constraints. We propose a cost‐efficient algorithm to decompose the original problem into a sub‐optimization one. Furthermore, we implement a prototype system on top of an infrastructure platform built with OpenStack. It has been deployed in our campus network. Based on real‐world traces collected from our system and Dropbox, we validate the efficiency of our proposed algorithms by extensive experiments. Copyright © 2016 John Wiley & Sons, Ltd.     

Characterizing application scheduling on edge,fog, and cloud computing resources

Cloud computing has grown to become a popular distributed computing service offered by commercial providers. More recently, edge and fog computing resources have emerged on the wide-area network as part of Internet of things (IoT) deployments. These three resource abstraction layers are complementary, and offer distinctive benefits. Scheduling applications on clouds has been an active area of research, with workflow and data flow models offering a flexible abstraction to specify applications for execution. However, the application programming and scheduling models for edge and fog are still maturing, and can benefit from learnings on cloud resources. At the same time, there is also value in using these resources cohesively for application execution. In this article, we offer a taxonomy of concepts essential for specifying and solving the problem of scheduling applications on edge, fog, and cloud computing resources. We first characterize the resource capabilities and limitations of these infrastructure and offer a taxonomy of application models, quality-of-service constraints and goals, and scheduling techniques, based on a literature review. We also tabulate key research prototypes and papers using this taxonomy. This survey benefits developers and researchers on these distributed resources in designing and categorizing their applications, selecting the relevant computing abstraction(s), and developing or selecting the appropriate scheduling algorithm. It also highlights gaps in literature where open problems remain.     

Libra: a computational economy‐based job scheduling system for clusters

Clusters of computers have emerged as mainstream parallel and distributed platforms for high‐performance, high‐throughput and high‐availability computing. To enable effective resource management on clusters, numerous cluster management systems and schedulers have been designed. However, their focus has essentially been on maximizing CPU performance, but not on improving the value of utility delivered to the user and quality of services. This paper presents a new computational economy driven scheduling system called Libra, which has been designed to support allocation of resources based on the users' quality of service requirements. It is intended to work as an add‐on to the existing queuing and resource management system. The first version has been implemented as a plugin scheduler to the Portable Batch System. The scheduler offers market‐based economy driven service for managing batch jobs on clusters by scheduling CPU time according to user‐perceived value (utility), determined by their budget and deadline rather than system performance considerations. The Libra scheduler has been simulated using the GridSim toolkit to carry out a detailed performance analysis. Results show that the deadline and budget based proportional resource allocation strategy improves the utility of the system and user satisfaction as compared with system‐centric scheduling strategies. Copyright © 2004 John Wiley & Sons, Ltd.     

Resource brokering using a multi‐site resource allocation strategy for computational grids

Grid computing employs heterogeneous resources which may be installed on different platforms, hardware/software, computer architectures, and perhaps using different computer languages to solve large‐scale computational problems. As many more Grids are being developed worldwide, the number of multi‐institutional collaborations is growing rapidly. However, to realize Grid computing's full potential, it is expected that Grid participants must be able to share one another's resources. This paper presents a resource broker that employs the multi‐site resource allocation (MSRA) strategy and the dynamic domain‐based network information model that we propose to allocate Grid resources to submitted jobs, where the Grid resources may be dispersed at different sites, and owned and governed by different organizations or institutes. The jobs and resources may also belong to different clusters/sites. Resource statuses collected by the Ganglia, and network bandwidths gathered by the Network Weather Service, are both considered in the proposed scheduling approach. A dynamic domain‐based model for network information measurement is also proposed to choose the most appropriate resources that meet the jobs' execution requirements. Experimental results show that MSRA outperformed the other tested strategies. Copyright © 2010 John Wiley & Sons, Ltd.     

NNs‐Based Event‐Triggered Consensus Control of a Class of Uncertain Nonlinear Multi‐Agent Systems

We are concerned with the consensus problem for a class of uncertain nonlinear multi‐agent systems (MASs) connected through an undirected communication topology via event‐triggered approaches in this paper. Two distributed control strategies, the adaptive centralized event‐triggered control one and adaptive distributed event‐triggered control one, are presented utilizing neural networks (NNs) and event‐driven mechanisms, where the advantages of the proposed control laws lie that they remove the requirement for exact priori knowledge about parameters of individual agents by taking advantage of NNs approximators and they save computing and communication resources since control tasks only execute at certain instants with respect to predefined threshold functions. Also, the trigger coefficient can be regulated adaptively with dependence on state errors to ensure not only the control performance but also the efficiency of the network interactions. It is proven that all signals in the closed‐loop system are bounded and the Zeno behavior is excluded. Finally, simulation examples are presented for illustration of the theoretical claims.     

Energy‐efficient task allocation with quality of service provisioning for concurrent applications in multi‐functional wireless sensor network systems

Multi‐functional wireless sensor network (WSN) system is a new design trend of WSNs, which are evolving from dedicated application‐specific systems to an integrated infrastructure that supports the execution of multiple concurrent applications. Such system offers inherent advantages in terms of cost and flexibility because it allows the effective utilization of available sensors and resource sharing among multiple applications. However, sensor nodes are very constrained in resources, mainly regarding their energy. Therefore, the usage of such resources needs to be carefully managed, and the sharing with several applications imposes new challenges in achieving energy efficiency in these networks. In order to exploit the full potential of multi‐functional WSN systems, it is crucial to design mechanisms that effectively allocate tasks onto sensors so that the entire system lifetime is maximized while meeting various application requirements. However, it is likely that the requirements of different applications cannot be simultaneously met. In this paper, we present the Multi‐Application Requirements Aware and Energy Efficiency algorithm as a new resource allocation heuristic for multi‐functional WSN system to maximize system lifetime subject to various application requirements. The heuristic effectively deals with different quality of service parameters (possibly conflicting) trading those parameters and exploiting heterogeneity of multiple WSNs. Copyright © 2013 John Wiley & Sons, Ltd.     

An optimization approach for decentralized QoS‐based scheduling based on utility and pricing in Grid computing

This paper presents an optimization approach for decentralized Quality of Service (QoS)‐based scheduling based on utility and pricing in Grid computing. The paper assumes that the quality dimensions can be easily formulated as utility functions to express quality preferences for each task agent. The utility values are calculated by the user‐supplied utility function that can be formulated with the task parameters. The QoS constraint Grid resource scheduling problem is formulated into a utility optimization problem. The QoS‐based Grid resource scheduling optimization is decomposed into two subproblems by applying the Lagrangian method. In the Grid, a Grid task agent acts as a consumer paying for the Grid resource and the resource providers receive profits from task agents. A pricing‐based QoS scheduling algorithm is used to perform optimally decentralized QoS‐based resource scheduling. The experiments investigate the effect of the QoS metrics on the global utility and compare the performance of the proposed algorithm with other economical Grid resource scheduling algorithms. Copyright © 2006 John Wiley & Sons, Ltd.     

Event‐Based Consensus Controller for Linear Multi‐Agent Systems Over Directed Communication Topologies: A Co‐Design Approach

The paper addresses the distributed event‐triggered consensus problem in directed topologies for multi‐agent systems (MAS) with general linear dynamic agents. A co‐design approach is proposed to determine parameters of the consensus controller and its event‐triggered mechanism (ETM), simultaneously. This approach guarantees asymptotic stability along with decreasing data transmission among agents. In the proposed event‐based consensus controller, each agent broadcasts data to the neighbors only at its own triggering instants; this differs from previous studies in which continuous data streams among agents were required. Furthermore, the proposed control law is based on the piecewise constant functions of the measurement values, which are updated at triggering instants. In this case the control scheme decreases the communication network usage, energy consumption, and wear of the actuator. As a result, it facilitates distributed implementation of the proposed consensus controller for real‐world applications. A theorem is proved to outline sufficient conditions to guarantee the asymptotic stability of the closed‐loop system with the event‐based consensus controller. Another theorem is also proved to show the Zeno behavior exclusion. As a case study, the proposed event‐based controller is applied for a diving consensus problem to illustrate the effectiveness of the method.     

Multi‐Variable Direct Self‐Organizing Fuzzy Neural Network Control for Wastewater Treatment Process

A multi‐variable direct self‐organizing fuzzy neural network control (M‐DSNNC) method is proposed for the multi‐variable control of the wastewater treatment process (WWTP). In this paper, the proposed control system is an essential multi‐variable control method for the WWTP. No exact plant model is required, which avoids the difficulty of establishing the mathematics model of WWTP. The M‐DSNNC system is comprised of a fuzzy neural network controller and a compensation controller. The fuzzy neural network is used for approximating the ideal control law under a general nonlinear system. Moreover, the neural network is designed in a self‐organizing mode to adapt the uncertainty environment. Simulation results, based on the international benchmark simulation model No.1 (BSM1), demonstrate that the control accuracy is improved under the proposed M‐DSNNC method, and the controller has a much stronger decoupling ability.     

Market‐based grid resource co‐allocation and reservation for applications with hard deadlines

Grid computing technology enables the creation of large‐scale IT infrastructures that are shared across organizational boundaries. In such shared infrastructures, conflicts between user requirements are common and originate from the selfish actions that users perform when formulating their service requests. The introduction of economic principles in grid resource management offers a promising way of dealing with these conflicts. We develop and analyze both a centralized and a decentralized algorithm for economic grid resource management in the context of compute bound applications with deadline‐based quality of service requirements and non‐migratable workloads. Through the use of reservations, we co‐allocate resources across multiple providers in order to ensure that applications finish within their deadline. An evaluation of both algorithms is presented and their performance in terms of realized user value is compared with an existing market‐based resource management algorithm. We establish that our algorithms, which operate under a more realistic workload model, can closely approximate the performance of this algorithm. We also quantify the effect of allowing local workload preemption and different scheduling heuristics on the realized user value. Copyright © 2009 John Wiley & Sons, Ltd.     

Scheduling parameter sweep applications on global Grids: a deadline and budget constrained cost–time optimization algorithm

Computational Grids and peer‐to‐peer (P2P) networks enable the sharing, selection, and aggregation of geographically distributed resources for solving large‐scale problems in science, engineering, and commerce. The management and composition of resources and services for scheduling applications, however, becomes a complex undertaking. We have proposed a computational economy framework for regulating the supply of and demand for resources and allocating them for applications based on the users' quality‐of‐service requirements. The framework requires economy‐driven deadline‐ and budget‐constrained (DBC) scheduling algorithms for allocating resources to application jobs in such a way that the users' requirements are met. In this paper, we propose a new scheduling algorithm, called the DBC cost–time optimization scheduling algorithm, that aims not only to optimize cost, but also time when possible. The performance of the cost–time optimization scheduling algorithm has been evaluated through extensive simulation and empirical studies for deploying parameter sweep applications on global Grids. Copyright © 2005 John Wiley & Sons, Ltd.     

基于云计算神经网络物流车辆调度算法研究

研究了物流车辆调度优化问题。针对云计算下任务调度算法没有考虑调度的服务质量和用户满意度的问题,特别是在物流任务调度问题中存在复杂的计算网络,造成计算率降低,为了解决上述问题,提出了一种新的有关云计算和神经网络相结合的物流作业调度算法。算法充分考虑了调度的服务质量以及用户满意度,建立一个参数化的处理模型,计算用户在各个资源上的综合满意度,再将任务分配到满足用户需求和使系统资源达到均衡的资源上执行,最后采用改进的神经网络进行优化车辆调度。实验结果表明,改进算法不仅能满足用户的多种需求,提高了用户的满意度,同时也提高了资源调度率和系统资源的利用率。     

计算网格中的资源选择与调度算法

针对文中描述的计算网格资源环境模型,构造了一种分布式的层次型任务调度模型,任务调度分为计算资源站点的选择以及资源站点内部的本地调度两层进行。通过研究该调度模型,提出了一种基于双目标衡量函数的资源选择算法,该算法可以通过设置相关参数动态调节响应时间和价格在总目标中所占比重。试验结果表明能够选择综合满足响应时间和价格这两个目标的计算资源,以适应用户的不同需求。     

Distributed Consensus of Multi‐Agent Networks Via Event‐Triggered Pinning Control

This paper is concerned with distributed consensus between two multi‐agent networks with the same topology structure. Considering one network as the leaders' network and the other one as the followers' network, a new event‐triggered pinning control scheme is proposed to realize distributed consensus between these two networks. By utilizing the graph theory and Lyapunov functional method, consensus criteria are derived in the form of linear matrix inequalities. Moreover, distributed consensus of multi‐agent networks with Lipschitz nonlinear dynamics is also discussed. Numerical simulations are provided to demonstrate the effectiveness of the theoretical analysis.     

Consensus of linear multi‐agent systems with stochastic noises and binary‐valued communications

This article studies consensus problems of discrete‐time linear multi‐agent systems with stochastic noises and binary‐valued communications. Different from quantized consensus of first‐order systems with binary‐valued observations, the quantized consensus of linear multi‐agent systems requires that each agent observes its neighbors' states dynamically. Unlike the existing quantized consensus of linear multi‐agent systems, the information that each agent in this article gets from its neighbors is only binary‐valued. To estimate its neighbors' states dynamically by using the binary‐valued observations, we construct a two‐step estimation algorithm. Based on the estimates, a stochastic approximation‐based distributed control is proposed. The estimation and control are analyzed together in the closed‐loop system, since they are strongly coupled. Finally, it is proved that the estimates can converge to the true states in mean square sense and the states can achieve consensus at the same time by properly selecting the coefficient in the estimation algorithm. Moreover, the convergence rate of the estimation and the consensus speed are both given by O(1/t). The theoretical results are illustrated by simulations.     

Multi‐Tracking of First Order Multi‐Agent Networks Via Self‐Triggered Control

A multi‐tracking problem of multi‐agent networks is investigated in this paper where multi‐tracking refers to that the states of multiple agents in each subnetwork asymptotically converge to the same desired trajectory in the presence of information exchanges among subnetworks. The multi‐tracking of first order multi‐agent networks with directed topologies was studied. Self‐triggered protocols were proposed along with triggering functions to solve the stationary multi‐tracking and bounded dynamic multi‐tracking. The self‐triggered scheduling is obtained, and the system does not exhibit Zeno behavior. Numerical examples are provided to illustrate the effectiveness of the obtained criteria.