DynaGrid: An Adaptive, Scalable, and Reliable Resource Provisioning Framework for WSRF-Compliant Applications

The Web Services Resource Framework (WSRF) is a set of specifications which define a generic and open framework for modeling and accessing stateful resources using Web services. This paper proposes DynaGrid, a new framework for WSRF-compliant applications. Many new components, such as ServiceDoor, Dynamic Service Launcher, ClientProxy, and PartitionManager, have been introduced to offer adaptive, scalable, and reliable resource provisioning. All of these components are implemented as standard WSRF-compliant Web services, hence DynaGrid is complementary to the existing GT4. Our experimental evaluation shows that DynaGrid effectively utilizes Grid resources by allocating only the required number of resources adaptively according to the amount of incoming requests, providing both the scalability and the reliability at the same time.     

Service scheduling and rescheduling in an applications integration framework

Grid technologies are evolving towards a service oriented architecture (SOA) and the traditional client/server architecture of heterogeneous computing (HC) can be transformed into a grid service oriented architecture. In this architecture, when more than one service fulfills the user request, a service which can make scheduling decisions is essential. A scheduling service has been proposed in a framework which achieves the dynamic deployment and scheduling of scientific and engineering applications. The framework treats all components (resource service and scheduler service) as WSRF-compliant services which support the applications integration with underlying native platform facilities and facilitate the construction of the hierarchical scheduling system. In order to enhance the system performance, we replace the MWL scheduling algorithm with an MCT algorithm and integrate a rescheduling mechanism in the framework. The experiments show that the MCT algorithm can achieve a smaller makespan and the rescheduling mechanism ensures the task execution even if an application is removed from the Resource Service.     

The Weka4WS framework for distributed data mining in service‐oriented Grids

The service‐oriented architecture paradigm can be exploited for the implementation of data and knowledge‐based applications in distributed environments. The Web services resource framework (WSRF) has recently emerged as the standard for the implementation of Grid services and applications. WSRF can be exploited for developing high‐level services for distributed data mining applications. This paper describes Weka4WS, a framework that extends the widely used open source Weka toolkit to support distributed data mining on WSRF‐enabled Grids. Weka4WS adopts the WSRF technology for running remote data mining algorithms and managing distributed computations. The Weka4WS user interface supports the execution of both local and remote data mining tasks. On every computing node, a WSRF‐compliant Web service is used to expose all the data mining algorithms provided by the Weka library. The paper describes the design and implementation of Weka4WS using the WSRF libraries and services provided by Globus Toolkit 4. A performance analysis of Weka4WS for executing distributed data mining tasks in different network scenarios is presented. Copyright © 2008 John Wiley & Sons, Ltd.     

Introduce: An Open Source Toolkit for Rapid Development of Strongly Typed Grid Services

Service-oriented architectures and applications have gained wide acceptance in the Grid computing community. A number of tools and middleware systems have been developed to support application development using Grid Services architectures. Most of these efforts, however, have focused on low-level support for management and execution of Grid services, management of Grid-enabled resources, and deployment and execution of applications that make use of Grid services. Simple-to-use service development tools, which would allow a Grid service developer to leverage Grid technologies without needing to know low-level details, are becoming increasingly important for wider application of the Grid. In this paper, we describe an open-source, extensible toolkit, called Introduce, that supports easy development and deployment of Web Services Resource Framework (WSRF) compliant services. Introduce is designed to reduce the service development and deployment effort by hiding low level details of the Globus Toolkit and to enable the implementation of strongly typed services. In strongly typed services, a service produces and consumes data types that are well-defined and published in the Grid. This enables data-level syntactic interoperability so that clients and services can access and consume data elements programmatically and correctly. We expect that enabling strongly typed Grid services while lowering the difficulty of entry to the Grid via toolkits like Introduce will have a major impact to the success of the Grid and its wider adoption as a viable technology of choice in the commercial sector as well as in academic, medical, and government research.     

基于CORBA的网格实现技术研究

本文介绍了CORBA与WSRF,分析了将CORBA对象封装成网格服务的必要性和可行性。利用WSRF来封装CORBA对象,使用户在网格环境能透明地调用CORBA服务,并简单分析了该系统模型,以及如何对资源进行封装。     

Autonomic QoS control in enterprise Grid environments using online simulation

As Grid Computing increasingly enters the commercial domain, performance and quality of service (QoS) issues are becoming a major concern. The inherent complexity, heterogeneity and dynamics of Grid computing environments pose some challenges in managing their capacity to ensure that QoS requirements are continuously met. In this paper, a comprehensive framework for autonomic QoS control in enterprise Grid environments using online simulation is proposed. This paper presents a novel methodology for designing autonomic QoS-aware resource managers that have the capability to predict the performance of the Grid components they manage and allocate resources in such a way that service level agreements are honored. Support for advanced features such as autonomic workload characterization on-the-fly, dynamic deployment of Grid servers on demand, as well as dynamic system reconfiguration after a server failure is provided. The goal is to make the Grid middleware self-configurable and adaptable to changes in the system environment and workload. The approach is subjected to an extensive experimental evaluation in the context of a real-world Grid environment and its effectiveness, practicality and performance are demonstrated.     

A resource elasticity framework for QoS-aware execution of cloud applications

Cloud infrastructures consisting of heterogeneous resources are increasingly being utilized for hosting large-scale distributed applications from diverse users with discrete needs. The multifarious cloud applications impose varied demands for computational resources along with multitude of performance implications. Successful hosting of cloud applications necessitates service providers to take into account the heterogeneity existing in the behavior of users, applications and system resources while respecting the user’s agreed Quality of Service (QoS) criteria. In this work, we propose a QoS-Aware Resource Elasticity (QRE) framework that allows service providers to make an assessment of the application behavior and develop mechanisms that enable dynamic scalability of cloud resources hosting the application components. Experimental results conducted on the Amazon EC2 cloud clearly demonstrate the effectiveness of our approach while complying with the agreed QoS attributes of users.     

The Web Services Resource Framework in a Peer-to-Peer Context

While Peer-To-Peer technologies can offer Grid computing increased scalability and inclusivity, they do not typically engage in the kind of complex interactions often required by the Grid in which context, or state, needs to be maintained across multiple service interactions. The Web Services Resource Framework is a relatively new specification that addresses the issue of handling resources with state in service-oriented architectures. While the specification makes a distinction between services and stateful resources, it still retains a coupling between a service address and a resource exposed by it. This coupling can be a hinderance in Peer-To-Peer networks where nodes may join and leave frequently and addresses may change or not be directly accessible. Furthermore it can undermine the loose coupling advocated by service-orientation. In this paper we assess the Web Services Resource Framework in the context of Peer-To-Peer environments and describe how WSPeer, a framework for hosting, discovering and invoking Web services, makes use of logical addressing, endpoint resolution and late-binding to maintain message consistency in such dynamic environments and de-couple services from stateful resources.November 24, 2005     

The Triangular Pyramid Scheduling Model and algorithm for PDES in Grid

Grid is a perfect environment for the large scale Parallel Discrete Event Simulation (PDES), because its distribution and collaboration features match the PDES applications well. The PDES tasks or applications are modeled as a Directed Acyclic Graph (DAG), in which the simulation resources consist of three critical factors, simulation hosting machine (SHM), simulation service (SS) and simulation data (SD) in Grid environment. By solving the model we attempt to obtain an optimized triangular matching of the simulation resources on Grid, so that it can support the PDES activities better. We name the algorithm of solving the model Triangular Pyramid Scheduling (TPS). The PDES DAG is divided into three basic graph structures: Sequential structure, Fork structure, and Join structure. The TPS algorithm is developed based on these graph structures. The simulation results show that TPS algorithm can reduce the makespan and congestion, improve the simulation efficiency, and increase the resource utilization efficiency, compared to the existing algorithms.     

基于服务网格的制造资源集成

提出了一种基于服务网格的制造资源集成方法，通过将服务网格技术引入制造行业，实现了制造资源的虚拟化，为制造资源提供了统一的接口和互操作协议、屏蔽平台及所使用技术的异构性。平台采用基于服务的协同工作流技术，在动态变化的环境中，能够根据用户需求优化业务逻辑及其执行过程，选择、配置和调度相应的制造资源完成指定的任务，实现跨组织的资源共享和任务协同。     

Bi-level fuzzy based advanced reservation of Cloud workflow applications on distributed Grid resources

The increasing demand on execution of large-scale Cloud workflow applications which need a robust and elastic computing infrastructure usually lead to the use of high-performance Grid computing clusters. As the owners of Cloud applications expect to fulfill the requested Quality of Services (QoS) by the Grid environment, an adaptive scheduling mechanism is needed which enables to distribute a large number of related tasks with different computational and communication demands on multi-cluster Grid computing environments. Addressing the problem of scheduling large-scale Cloud workflow applications onto multi-cluster Grid environment regarding the QoS constraints declared by application’s owner is the main contribution of this paper. Heterogeneity of resource types (service type) is one of the most important issues which significantly affect workflow scheduling in Grid environment. On the other hand, a Cloud application workflow is usually consisting of different tasks with the need for different resource types to complete which we call it heterogeneity in workflow. The main idea which forms the soul of all the algorithms and techniques introduced in this paper is to match the heterogeneity in Cloud application’s workflow to the heterogeneity in Grid clusters. To obtain this objective a new bi-level advanced reservation strategy is introduced, which is based upon the idea of first performing global scheduling and then conducting local scheduling. Global-scheduling is responsible to dynamically partition the received DAG into multiple sub-workflows that is realized by two collaborating algorithms: (1) The Critical Path Extraction algorithm (CPE) which proposes a new dynamic task overall critically value strategy based on DAG’s specification and requested resource type QoS status to determine the criticality of each task; and (2) The DAG Partitioning algorithm (DAGP) which introduces a novel dynamic score-based approach to extract sub-workflows based on critical paths by using a new Fuzzy Qualitative Value Calculation System to evaluate the environment. Local-scheduling is responsible for scheduling tasks on suitable resources by utilizing a new Multi-Criteria Advance Reservation algorithm (MCAR) which simultaneously meets high reliability and QoS expectations for scheduling distributed Cloud-base applications. We used the simulation to evaluate the performance of the proposed mechanism in comparison with four well-known approaches. The results show that the proposed algorithm outperforms other approaches in different QoS related terms.     

Resource Modeling and Cargos Tracking Service in Logistics Resource Grid Based on WSRF

I. INTRODUCTION The Web Service Resource Framework (WSRF) [1] is a set of specifications announced in 2004 as a new way for manipulating stateful resources to perform grid tasks using web services. A WS-Resource is a composition of a web service and a stateful resource described by an XML schema that is associated with the web service’s port type and addressed by a WS-Addressing EndpointReference [2]. Four specifications in the WS-ResourceFramework have been released. WS-Resou…     

Formal QoS Policy Based Grid Resource Provisioning Framework

Grid resource provisioning is a complex task that is often compromised due to non-availability of the desired resources. The heterogeneous and dynamic nature of the Grid resources depends on the Quality of Service (QoS) based resource provisioning for allocation of appropriate resources to Grid applications. Until resource provisioning is considered a fundamental capability, predictable QoS cannot be delivered to the Grid consumers. A resource provisioning policy based on QoS parameters is required for efficient Grid resource provisioning. In this paper a resource provisioning framework has been proposed. This framework offers resource provisioning policy that caters to provisioned resource allocation and resource scheduling. The policy rules have been specified in XML schema. The policy has been validated by Z Formal specification language and implementation has been demonstrated through a case study. The experimental results demonstrate that QoS based provisioned approach is effective in minimizing cost and submission burst time of applications in comparison to the existing approaches.     

服务网格虚拟服务动态部署和自适应策略

以"服务"的形式包装网格资源已成为一种趋势,并得到网格界的一致认可.为了更加充分灵活的利用网格资源,提出了一个网格虚拟服务动态部署架构以及基于此架构的服务平衡调度算法,通过服务按需部署和实时监控,动态调整资源在不同任务间的分配,并在需要时进行任务迁移,保证应用的服务质量.实验结果表明此系统较其它系统在资源利用率、QoS命中率上都有一定的提高.     

A secure information service for monitoring large scale grids

The Grid Information Service (GIS) is a core component in the Grid software infrastructure. It provides diverse information to users or other service components in Grid environments. In this paper, we propose a scalable GIS architecture for information management in a large scale Grid Virtual Organization (VO). This architecture consists of the VO layer, site layer and resource layer: at the resource layer, information agents and pluggable information sensors are deployed on each resource monitored. This information agent and sensor approach provides a flexible framework that enables specific information to be captured; at the site layer, a site information service component with caching capability aggregates and maintains up-to-date information of all the resources monitored within an administrative domain; at the VO layer, a peer-to-peer approach is used to build a virtual network of site information services for information discovery and query in a large scale Grid VO. This decentralized approach makes information management scalable and robust. Furthermore, we propose a security framework for the GIS, which provide security policies for authentication and authorization control of the GIS at both the site and the VO layers. Our GIS has been implemented based on the Globus Toolkit 4 as Web services compliant to Web Services Resource Framework (WSRF) specifications. The experimental results show that the GIS presents satisfactory scalability in handling information for large scale Grids.     

Flexible Grid service management through resource partitioning

In this paper, a distributed and scalable Grid service management architecture is presented. The proposed architecture is capable of monitoring task submission behaviour and deriving Grid service class characteristics, for use in performing automated computational, storage and network resource-to-service partitioning. This partitioning of Grid resources amongst service classes (each service class is assigned exclusive usage of a distinct subset of the available Grid resources), along with the dynamic deployment of Grid management components dedicated and tuned to the requirements of a particular service class introduces the concept of Virtual Private Grids. We present two distinct algorithmic approaches for the resource partitioning problem, the first based on Divisible Load Theory (DLT) and the second built on Genetic Algorithms (GA). The advantages and drawbacks of each approach are discussed and their performance is evaluated on a sample Grid topology using NSGrid, an ns-2 based Grid simulator. Results show that the use of this Service Management Architecture in combination with the proposed algorithms improves computational and network resource efficiency, simplifies schedule making decisions, reduces the overall complexity of managing the Grid system, and at the same time improves Grid QoS support (with regard to job response times) by automatically assigning Grid resources to the different service classes prior to scheduling.     

基于Web服务的网格体系结构及其支撑环境研究

网格技术是当前网络计算的前沿领域,基于Web服务技术构建网格系统有助于提高网格系统的可扩展性和互操作能力,是这一领域中的最新热点.但现有的工作尚未明确界定基于Web服务的网格的功能模型和实现机制.首先讨论了网格功能模型,基于OGSA(open grid service architecture)框架提出了基于Web服务的网格层次体系结构,并将Web服务工作流引入到网格任务描述中,给出一种Web服务与网格技术相融合的机制,介绍了基于Web服务的网格支撑环境WebSASE4G的总体结构和设计原理,为基于Web     

GEMLCA: Running Legacy Code Applications as Grid Services

There are many legacy code applications that cannot be run in a Grid environment without significant modification. To avoid re-engineering of legacy code, we developed the Grid Execution Management for Legacy Code Architecture (GEMLCA) that enables deployment of legacy code applications as Grid services. GEMLCA implements a general architecture for deploying legacy applications as Grid services without the need for code re-engineering, or even access to the source files. With GEMLCA, only a user-level understanding is required to run a legacy application from a standard Grid service client. The legacy code runs in its native environment using the GEMLCA resource layer to communicate with the Grid client, thus hiding the legacy nature of the application and presenting it as a Grid service. GEMLCA as a Grid service layer supports submitting jobs, getting their results and status back. The paper introduces the GEMLCA concept, its life cycle, design and implementation. It also presents as an example a legacy simulation code that has been successfully transformed into a Grid service using GEMLCA.     

网格环境下基于HLA的分布交互仿真动态交互研究

基于HLA开发的分布交互仿真缺乏灵活性，不支持动态资源分配。网格服务是开发基于网络的分布交互仿真的另一途径，但只应用网格服务开发分布交互仿真，开发者必须自己创建通信机制来协调仿真执行。本文提出了一个动态交互框架，将基于HLA的分布交互仿真建立在网格服务的基础之上，来克服两者所存在的问题并发挥各自的优点，实现仿真资源的动态分配、动态状态监控及任务动态迁移。文中详细地阐述了框架的构成、框架关键服务构建的设计和实现、各种网格服务的机制及服务接口，并给出实例进行验证。     

面向普适计算的服务构件动态部署问题及算法

有限的资源是嵌入式应用的一个局限性,因此越来越多的嵌入式设备联网,通过共享资源为用户提供灵活的服务以适应普适计算的要求.以构件化嵌入式操作系统Liquid为背景,研究普适计算环境下多个服务构件动态部署问题,合理分配利用资源,克服单个嵌入式设备的资源局限性.首先对部署问题进行描述,然后给出服务构件动态部署的基本算法和启发式算法,并对启发式算法优化,最后通过算法模拟及数据分析算法的性能.虽然在Liquid系统上进行模拟实现,但算法具有通用性,启发式算法的效率分析表明,它适合设备或者服务构件数目较多的普适计算环境,在部署服务构件的同时提高服务准入成功率和资源的利用率.