Context-aware workflow management for virtual enterprises based on coordination of agents

Although virtual enterprises (VE) make it possible for small flexible enterprises to form a collaborative network to respond to business opportunities through dynamic coalition and sharing of the core competencies and resources, they also pose new challenges and issues. Creation of VE involves dynamically established partnerships between the partners and relies on a flexible coordination scheme. The dynamic organizations formed in VE present a challenge in the development of a new methodology to dynamically allocate re-sources and deliver the relevant information to the right people at the right time. A key issue is the development of an effective workflow management scheme for VE. Multi-agent systems (MAS) provide a flexible architecture to deal with changes based on dynamic organization and collaboration of autonomous agents. Despite the extensive studies and research results on MAS, development of a design methodology to support coordination and operations is critical to the success and adoption of VE. The objectives of this research are to propose a design methodology to facilitate coordination and development of context-aware workflow management systems and achieve effective resource allocation for VE based on MAS architecture. To achieve these objectives, a scheme for coordination of agents is proposed. Petri net models are used in the coordination scheme to describe workflows and capture resource activities in VE. The interactions between agents lead to a dynamic workflow model for VE. Based on the aforementioned model, we propose architecture to dynamically generate context-aware graphical user interface to guide the users and control resource allocation based on the state of VE. An order management example is used throughout this paper to illustrate the proposed design methodology.     

An architecture for workflow scheduling under resource allocation constraints

Research on specification and scheduling of workflows has concentrated on temporal and causality constraints, which specify existence and order dependencies among tasks. However, another set of constraints that specify resource allocation is also equally important. The resources in a workflow environment are agents such as person, machine, software, etc. that execute the task. Execution of a task has a cost and this may vary depending on the resources allocated in order to execute that task. Resource allocation constraints define restrictions on how to allocate resources, and scheduling under resource allocation constraints provide proper resource allocation to tasks. In this work, we provide an architecture to specify and to schedule workflows under resource allocation constraints as well as under the temporal and causality constraints. A specification language with the ability to express resources and resource allocation constraints and a scheduler module that contains a constraint solver in order to find correct resource assignments are core and novel parts of this architecture.     

Real-time workflows oriented online scheduling in uncertain cloud environment

Workflow scheduling has become one of the hottest topics in cloud environments, and efficient scheduling approaches show promising ways to maximize the profit of cloud providers via minimizing their cost, while guaranteeing the QoS for users’ applications. However, existing scheduling approaches are inadequate for dynamic workflows with uncertain task execution times running in cloud environments, because those approaches assume that cloud computing environments are deterministic and pre-computed schedule decisions will be statically followed during schedule execution. To cover the above issue, we introduce an uncertainty-aware scheduling architecture to mitigate the impact of uncertain factors on the workflow scheduling quality. Based on this architecture, we present a scheduling algorithm, incorporating both event-driven and periodic rolling strategies (EDPRS), for scheduling dynamic workflows. Lastly, we conduct extensive experiments to compare EDPRS with two typical baseline algorithms using real-world workflow traces. The experimental results show that EDPRS performs better than those algorithms.     

基于Agent的工作流系统探讨

当前，大多数工作流管理系统都是独立地管理单个工作流，而忽视了工作流之间的资源约束关系，基于Agent的工作流管理系统能够有效地解决这个问题。该文主要讨论了基于Agent的工作流管理系统，包括系统配置、工作流执行的动态调度以及多Agent系统的组织和通信问题。     

A self-adaptation scheme for workflow management in multi-agent systems

Business processes, operational environment, variability of resources and user needs may change from time to time. An effective workflow management software system must be able to accommodate these changes. The ability to dynamically adapt to changes is a key success factor for workflow management systems. Holonic multi-agent systems (HMS) provide a flexible and reconfigurable architecture to accommodate changes based on dynamic organization and collaboration of autonomous agents. Although HMS provides a potential architecture to accommodate changes, the dynamic organization formed in HMS poses a challenge in the development of a new software development methodology to dynamically compose the services and adapt to changes as needed. This motivates us to study and propose a methodology to design self-adaptive software systems based on the HMS architecture. In this paper, we formulate a workflow adaptation problem (WAP) and propose an interaction mechanism based on contract net protocol (CNP) to find a solution to WAP to compose the services based on HMS. The interaction mechanism relies on a service publication and discovery scheme to find a set of task agents and a set of actor agents to compose the required services in HMS. We propose a viable self-adaptation scheme to reconfigure the agents and the composed services based on cooperation of agents in HMS to accommodate the changes in workflow and capabilities of actors. We propose architecture for our design methodology and present an application scenario to illustrate our idea.     

A novel approach for multi-agent-based Intelligent Manufacturing System

In the recent years, the competition of shortening the development cycle of new products is more and more fierce. Given the shortcomings of traditional scheduling algorithm in Intelligent Manufacturing, the architecture of multi-agent-based Intelligent Manufacturing System is put forward, which represents the basic processing entity. The architecture is based on the methodology of multi-agent systems (MAS) in distributed artificial intelligence (DAI). The multi-agent system has some common characteristics, such as distribution, autonomy, interaction and openness, which are helpful to transform the traditional architecture into a distributed and cooperative architecture in an Intelligent Manufacturing System. To develop a multi-agent-based scheduling system for Intelligent Manufacturing, it is necessary to build various functional agents for all the resources and an agent manager to improve the scheduling agility. In this paper, the proposed architecture consists of various autonomous agents that are capable of communicating with each other and making decisions based on their knowledge. The architecture of Intelligent Manufacturing, the scheduling optimization algorithm, the negotiation processes and protocols among the agents are described in detail. A prototype system is built and validated in an illustrative example, which demonstrates the feasibility of the proposed approach. The experiments prove that the implementation of multi-agent technology in Intelligent Manufacturing System makes the operations much more flexible, economical and energy-efficient.     

A hybrid evolutionary algorithm for task scheduling and data assignment of data-intensive scientific workflows on clouds

A growing number of data- and compute-intensive experiments have been modeled as scientific workflows in the last decade. Meanwhile, clouds have emerged as a prominent environment to execute this type of workflows. In this scenario, the investigation of workflow scheduling strategies, aiming at reducing its execution times, became a top priority and a very popular research field. However, few work consider the problem of data file assignment when solving the task scheduling problem. Usually, a workflow is represented by a graph where nodes represent tasks and the scheduling problem consists in allocating tasks to machines to be executed at a predefined time aiming at reducing the makespan of the whole workflow. In this article, we show that the scheduling of scientific workflows can be improved when both task scheduling and the data file assignment problems are treated together. Thus, we propose a new workflow representation, where nodes of the workflow graph represent either tasks or data files, and define the Task Scheduling and Data Assignment Problem (TaSDAP), considering this new model. We formulated this problem as an integer programming problem. Moreover, a hybrid evolutionary algorithm for solving it, named HEA-TaSDAP, is also introduced. To evaluate our approach we conducted two types of experiments: theoretical and practical ones. At first, we compared HEA-TaSDAP with the solutions produced by the mathematical formulation and by other works from related literature. Then, we considered real executions in Amazon EC2 cloud using a real scientific workflow use case (SciPhy for phylogenetic analyses). In all experiments, HEA-TaSDAP outperformed the other classical approaches from the related literature, such as Min–Min and HEFT.     

A heterogeneous computing system for data mining workflows in multi-agent environments

Abstract: The computing-intensive data mining (DM) process calls for the support of a heterogeneous computing system, which consists of multiple computers with different configurations connected by a high-speed large-area network for increased computational power and resources. The DM process can be described as a multi-phase pipeline process, and in each phase there could be many optional methods. This makes the workflow for DM very complex and it can be modeled only by a directed acyclic graph (DAG). A heterogeneous computing system needs an effective and efficient scheduling framework, which orchestrates all the computing hardware to perform multiple competitive DM workflows. Motivated by the need for a practical solution of the scheduling problem for the DM workflow, this paper proposes a dynamic DAG scheduling algorithm according to the characteristics of an execution time estimation model for DM jobs. Based on an approximate estimation of job execution time, this algorithm first maps DM jobs to machines in a decentralized and diligent (defined in this paper) manner. Then the performance of this initial mapping can be improved through job migrations when necessary. The scheduling heuristic used considers the factors of both the minimal completion time criterion and the critical path in a DAG. We implement this system in an established multi-agent system environment, in which the reuse of existing DM algorithms is achieved by encapsulating them into agents. The system evaluation and its usage in oil well logging analysis are also discussed.     

启发式规则与GA结合的优化方法求解工作流动态调度优化问题

调度是工作流管理系统的核心问题,是保证工作流正确运行的关键。在工作流环境下,动态调度要比静态调度更切合实际。本文在总结前人工作的基础上,提出了一系列工作流动态调度的启发式规则,并以最小化任务总拖期时间和最大化任务总提前时间为目标,建立了工作流动态调度问题模型。采用启发式规则与遗传算法相结合的优化方法求解工作流动态调度优化问题。仿真结果说明了优化方法的可行性和有效性,同时比较了该方法与多种静态调度方法,进而说明了该方法的优越性。     

基于可能回答集程序的多Agent信念协调

多Agent系统(Multi-Agent System,MAS)是人工智能领域的一个非常活跃的研究方向。在多Agent系统中,由于Agent之间信念的差异,会不可避免地造成行动冲突。Sakama等提出的严格协调方法只适用于各Agent之间有共同信念的情境,当不存在共同信念时,此协调方法无解。针对该问题,文中提出了一种基于可能回答集程序(Possibilistic Answer Set Programming,PASP)的信念协调方法。首先,针对各Agent的不同信念集,基于加权定量的方法计算PASP的回答集相对Agent信念的满足度,以此来弱化某些信念,并且引入缺省决策理论推理得到Agent信念协调的一致解。然后,根据一致解建立一致的协调程序,将其作为Agent共同认同的背景知识库。最后,以dlv求解器为基础实现了多Agent信念协调算法,使Agent之间可以自主完成信念协调。文中以旅游推荐系统为例,说明该算法能够打破严格协调方法的局限,有效解决各Agent之间无共同信念时的协调问题。     

A policy-based B2C e-Contract management workflow methodology using semantic web agents

Since e-Commerce has become a discipline, e-Contracts are acknowledged as the tools that will assure the safety and robustness of the transactions. A typical e-Contract is a binding agreement between parties that creates relations and obligations. It consists of clauses that address specific tasks of the overall procedure which can be represented as workflows. Similarly to e-Contracts, Intelligent Agents manage a private policy, a set of rules representing requirements, obligations and restrictions, additionally to personal data that meet their user’s interests. In this context, this study aims at proposing a policy-based e-Contract workflow management methodology that can be used by semantic web agents, since agents benefit from Semantic Web technologies for data and policy exchanges, such as RDF and RuleML that maximize interoperability among parties. Furthermore, this study presents the integration of the above methodology into a multi-agent knowledge-based framework in order to deal with issues related to rules exchange where no common syntax is used, since this framework provides reasoning services that assist agents in interpreting the exchanged policies. Finally, a B2C e-Commerce scenario is presented that demonstrates the added value of the approach.     

An Effective Cloud Workflow Scheduling Approach Combining PSO and Idle Time Slot-Aware Rules

Workflow scheduling is a key issue and remains a challenging problem in cloud computing.Faced with the large number of virtual machine(VM)types offered by cloud providers,cloud users need to choose the most appropriate VM type for each task.Multiple task scheduling sequences exist in a workflow application.Different task scheduling sequences have a significant impact on the scheduling performance.It is not easy to determine the most appropriate set of VM types for tasks and the best task scheduling sequence.Besides,the idle time slots on VM instances should be used fully to increase resources'utilization and save the execution cost of a workflow.This paper considers these three aspects simultaneously and proposes a cloud workflow scheduling approach which combines particle swarm optimization(PSO)and idle time slot-aware rules,to minimize the execution cost of a workflow application under a deadline constraint.A new particle encoding is devised to represent the VM type required by each task and the scheduling sequence of tasks.An idle time slot-aware decoding procedure is proposed to decode a particle into a scheduling solution.To handle tasks'invalid priorities caused by the randomness of PSO,a repair method is used to repair those priorities to produce valid task scheduling sequences.The proposed approach is compared with state-of-the-art cloud workflow scheduling algorithms.Experiments show that the proposed approach outperforms the comparative algorithms in terms of both of the execution cost and the success rate in meeting the deadline.     

分布式约束满足问题及其在MAS任务分配中的应用*

针对多智能体系统(MAS)任务分配问题中多个任务与MAS两者的分布式特征,将任务分配问题形式化为分布式约束满足问题(DCSP)进行求解,分别建立了以任务为中心和以agent为中心两种MAS任务分配模型,基于改进的DCSP分布式并行求解算法,提出了基于DCSP的MAS任务分配问题求解框架。该方法适合求解agent间通信有随机延迟以及agent间存在多约束的问题,应用实例的求解表明了其实用性与有效性。     

On the decentralized coordination of herding activities: a Jadex-based solution

The AgentContest 2009 provided a revised Cows and Herders scenario which extended the last year’s setting. First, additional environment objects, i.e., fences and switches, were introduced. Secondly, the team score is calculated by the net amount of herded cows at the game end. In this paper we present the design of the multi-agent system (MAS) prototype which participated in this contest and has been developed under usage of the Jadex multi-agent platform. The main focus of our second-time participation was to switch from the centralized coordination architecture of our previous MAS to a decentralized coordination in order to increase the single agents’ autonomy. To facilitate the development parts of the Tropos methodology were utilized. These have been extended by platform specific features (e.g. the modularization concept). During the development we were able to identify and eliminate key problems and as a result our prototype could achieve the second place in the contest.     

计算资源共享平台中工作流任务调度研究

提出了计算资源共享平台中具有时间约束的工作流任务调度方法,该方法利用了非集中式的树型应用层覆盖网络拓扑结构,从而可以高效而快速的收集资源的可用信息。采用全局调度器与本地调度器结合的方式,通过定义资源的收集功能过程,使每个节点中的本地调度器能够把自身的资源可用信息提供给全局的调度器,工作流中任务的最后期限时间约束和任务的恢复时间以一种时间间隙的机制来完成。仿真结果表明,分治模式和解方程类的迭代模式的工作流任务能够在平台上成功调度运行,具有比较快的响应时间和低的通信负载。     

基于MAS的动态生产调度与控制及系统开发

提出基于MAS的面向敏捷制造的生产过程动态调度与控制的层次结构．1）以任务分解与分配层为中心，建立各层之间的协调工作及协同决策机制；2）引入协商式招／投标方法实现任务的分解与分配；3）采用能力匹配与动态调度相结合的方法实现任务分配与调度控制的有效集成；4）面向生产任务需求动态确定Agent粒度、组建MAS模型；5）适应制造系统状态变化的需要，进行任务的动态重构．讨论基于MAS的采用分级递阶和并行处理相结合的自治组织结构和运作模式，以及利用与组织结构相对应的层次黑板结构实现各Agent之间信息与数据共享．在支持生产过程动态调度与控制基础设施建设的基础上，结合奏川机床集团有限公司车间生产实际，研究开发了基于MAS的车间动态调度系统．     

Static scheduling of multiple workflows with soft deadlines in non-dedicated heterogeneous environments

Typical patterns of using scientific workflows include their periodical executions using a fixed set of computational resources. Using the statistics from multiple runs, one can accurately estimate task execution and communication times to apply static scheduling algorithms. Several workflows with known estimates could be combined into a set to improve the resulting schedule. In this paper, we consider the mapping of multiple workflows to partially available heterogeneous resources. The problem is how to fill free time windows with tasks from different workflows, taking into account users’ requirements of the urgency of the results of calculations. To estimate quality of schedules for several workflows with various soft deadlines, we introduce the unified metric incorporating levels of meeting constraints and fairness of resource distribution.The main goal of the work was to develop a set of algorithms implementing different scheduling strategies for multiple workflows with soft deadlines in a non-dedicated environment, and to perform a comparative analysis of these strategies. We study how time restrictions (given by resource providers and users) influence the quality of schedules, and which scheme of grouping and ordering the tasks is the most effective for the batched scheduling of non-urgent workflows. Experiments with several types of synthetic and domain-specific sets of multiple workflows show that: (i) the use of information about time windows and deadlines leads to the significant increase of the quality of static schedules, (ii) the clustering-based scheduling scheme outperforms task-based and workflow-based schemes. This was confirmed by an evaluation of studied algorithms on a basis of the CLAVIRE workflow management platform.     

Campus Grids Meet Applications: Modeling, Metascheduling and Integration

Air Quality Forecasting (AQF) is a new discipline that attempts to reliably predict atmospheric pollution. An AQF application has complex workflows and in order to produce timely and reliable forecast results, each execution requires access to diverse and distributed computational and storage resources. Deploying AQF on Grids is one option to satisfy such needs, but requires the related Grid middleware to support automated workflow scheduling and execution on Grid resources. In this paper, we analyze the challenges in deploying an AQF application in a campus Grid environment and present our current efforts to develop a general solution for Grid-enabling scientific workflow applications in the GRACCE project. In GRACCE, an application’s workflow is described using GAMDL, a powerful dataflow language for describing application logic. The GRACCE metascheduling architecture provides the functionalities required for co-allocating Grid resources for workflow tasks, scheduling the workflows and monitoring their execution. By providing an integrated framework for modeling and metascheduling scientific workflow applications on Grid resources, we make it easy to build a customized environment with end-to-end support for application Grid deployment, from the management of an application and its dataset, to the automatic execution and analysis of its results.The work has been performed as part of the University of Houston’s Sun Microsystems Center of Excellence in Geosciences [38].     

A distributed multi-agent production planning and scheduling framework for mobile robots

Inspired by the new achievements in mobile robotics having as a result mobile robots able to execute different production tasks, we consider a factory producing a set of distinct products via or with the additional help of mobile robots. This particularly flexible layout requires the definition and the solution of a complex planning and scheduling problem. In order to minimize production costs, dynamic determination of the number of robots for each production task and the individual robot allocation are needed. We propose a solution in terms of a two-level decentralized Multi-Agent System (MAS) framework: at the first, production planning level, agents are tasks which compete for robots (resources at this level); at the second, scheduling level, agents are robots which reallocate themselves among different tasks to satisfy the requests coming from the first level. An iterative auction based negotiation protocol is used at the first level while the second level solves a Multi-Robot Task Allocation (MRTA) problem through a distributed version of the Hungarian Method. A comparison of the results with a centralized approach is presented.     

An agent-oriented approach to resolve scheduling optimization in intelligent manufacturing

Agent technology is considered as a promising approach for developing optimizing process plans in intelligent manufacturing. As a bridge between computer aided design (CAD) and computer aided manufacturing (CAM), the computer aided scheduling optimization (CASO) plays an important role in the computer integrated manufacturing (CIM) environment. In order to develop a multi-agent-based scheduling system for intelligent manufacturing, it is necessary to build various functional agents for all the resources and an agent manager to improve the scheduling agility. Identifying the shortcomings of traditional scheduling algorithm in intelligent manufacturing, the architecture of intelligent manufacturing system based on multi-agent is put forward, among which agent represents the basic processing entity. Multi-agent-based scheduling is a new intelligent scheduling method based on the theories of multi-agent system (MAS) and distributed artificial intelligence (DAI). It views intelligent manufacturing as composed of a set of intelligent agents, who are responsible for one or more activities and interacting with other related agents in planning and executing their responsibilities. In this paper, the proposed architecture consists of various autonomous agents that are capable of communicating with each other and making decisions based on their knowledge. The architecture of intelligent manufacturing, the scheduling optimization algorithm, the negotiation processes and protocols among the agents are described in detail. A prototype system is built and validated in an illustrative example, which demonstrates the feasibility of the proposed approach. The experiments prove that the implementation of multi-agent technology in intelligent manufacturing system makes the operations much more flexible, economical and energy efficient.