Distributed data mining patterns and services: an architecture and experiments

Distributed data mining implements techniques for analyzing data on distributed computing systems by exploiting data distribution and parallel algorithms. The grid is a computing infrastructure for implementing distributed high‐performance applications and solving complex problems, offering effective support to the implementation and use of data mining and knowledge discovery systems. The Web Services Resource Framework has become the standard for the implementation of grid services and applications, and it can be exploited for developing high‐level services for distributed data mining applications. This paper describes how distributed data mining patterns, such as collective learning, ensemble learning, and meta‐learning models, can be implemented as Web Services Resource Framework mining services by exploiting the grid infrastructure. The goal of this work was to design a distributed architectural model that can be exploited for different distributed mining patterns deployed as grid services for the analysis of dispersed data sources. In order to validate such an approach, we presented also the implementation of two clustering algorithms on the developed architecture. In particular, the distributed k‐means and distributed expectation maximization were exploited as pilot examples to show the suitability of the implemented service‐oriented framework. An extensive evaluation of its performance was provided. Copyright © 2011 John Wiley & Sons, Ltd.     

Supporting dynamic access to virtualized data resources via WSRF-based services

Today grid applications require not only lots of computational power but data at a very large scale too. Although grid computing was initially conceptualized as the technology that focuses on solving compute-intensive problems, this focus has gradually shifted to applications where data is distributed over various locations. Access to these data resources stored in heterogeneous grid storage systems located at geographically distributed virtual organizations in an integrated and uniform way is a challenging problem. The Web Services Resource Framework (WSRF) has recently emerged as the standard for the development and integration of grid services. This paper proposes and presents Gravy4WS, a middleware architecture based on WSRF Web services that enables the dynamic access to virtualized grid data resources. A novel scheduling algorithm called DCE (Delegating-Cluster-Execution based Scheduling) is proposed to improve load balancing of the system. The implementation of Gravy4WS using WSRF libraries and services provided by Globus Toolkit 4 is described together with its performance evaluation.     

A standards‐based Grid resource brokering service supporting advance reservations,coallocation, and cross‐Grid interoperability

The problem of Grid‐middleware interoperability is addressed by the design and analysis of a feature‐rich, standards‐based framework for all‐to‐all cross‐middleware job submission. The architecture is designed with focus on generality and flexibility and builds on extensive use, internally and externally, of (proposed) Web and Grid services standards such as WSRF, JSDL, GLUE, and WS‐Agreement. The external use provides the foundation for easy integration into specific middlewares, which is performed by the design of a small set of plugins for each middleware. Currently, plugins are provided for integration into Globus Toolkit 4 and NorduGrid/ARC. The internal use of standard formats facilitates customization of the job submission service by replacement of custom components for performing specific well‐defined tasks. Most importantly, this enables the easy replacement of resource selection algorithms by algorithms that address the specific needs of a particular Grid environment and job submission scenario. By default, the service implements a decentralized brokering policy, striving to optimize the performance for the individual user by minimizing the response time for each job submitted. The algorithms in our implementation perform resource selection based on performance predictions, and provide support for advance reservations as well as coallocation of multiple resources for coordinated use. The performance of the system is analyzed with focus on overall service throughput (up to over 250 jobs per min) and individual job submission response time (down to under 1 s). Copyright © 2009 John Wiley & Sons, Ltd.     

网格与Web服务的融合-WSRF和WS-Notification

Web服务通知(WS-Notification)和Web服务资源框架(WS-Resource Framework,简称WSRF)规范提供可扩展的发布／预定通知模式和用Web服务为有状态资源(Statefu Resource)建模的能力。本文首先介绍了OGSI和WSRF的关系,WSRF可以简单地看作是OGS11．0规范中的概念和接口的重写。WSRF通过Web服务资源(WS-Resource)方法来为有状态资源建模,通过WS-Resource方法来说明、执行Web服务和一个或多个指定类型的状态组件间的关系,阐述了通过Web服务接口来设置WS-Resource的属性和生命周期的方法,还讨论了预定／发布模式的通知机制是如何建立在WSRF基础上的,最后对WSRF和WS-Notmcation进行了简单总结并讨论了它的未来研究方向。     

MicroMAIS: executing and orchestrating Web services on constrained mobile devices

Mobile devices with their more and more powerful resources allow the development of mobile information systems in which services are not only provided by traditional systems but also autonomously executed and controlled in the mobile devices themselves. Services distributed on autonomous mobile devices allow both the development of cooperative applications without a back‐end infrastructure and the development of applications blending distributed and centralized services. In this paper, we propose MicroMAIS: an integrated platform for supporting the execution of Web service‐based applications natively on a mobile device. The MicroMAIS platform is composed of mAS and μ‐BPEL. The former allows the execution of a single Web service, whereas the latter permits the orchestration of several Web services according to the WS‐BPEL standard. Copyright © 2011 John Wiley & Sons, Ltd.     

DynaGrid: A dynamic service deployment and resource migration framework for WSRF-compliant applications

Large-scale Grid is a computing environment composed of Internet-wide distributed resources shared by a number of applications. Although WSRF and Java-based hosting environment can successfully deal with the heterogeneity of resources and the diversity of applications, the current Grid systems have several limitations to support the dynamic nature of large-scale Grid.This paper proposes DynaGrid, a new framework for building large-scale Grid for WSRF-compliant applications. Compared to the existing Grid systems, DynaGrid provides three new mechanisms: dynamic service deployment, resource migration, and transparent request dispatching. Two core components, ServiceDoor and dynamic service launcher (DSL), have been implemented as WSRF-compliant Web services to realize DynaGrid, which are applicable to any Java-based WSRF hosting environment. We construct a real testbed with DynaGrid on the Globus Toolkit 4 and evaluate the effectiveness of our framework using two practical applications. The evaluation results show that dynamic service deployment and resource migration in DynaGrid bring many advantages to large-scale Grid in terms of performance and reliability with minimal overhead.     

Delivering Web service load testing as a service with a global cloud

In this paper, we present WS‐TaaS, a Web services load testing platform built on a global platform PlanetLab. WS‐TaaS enables load testing process to be simple, transparent, and as close as possible to the real running scenarios of the target services. First, we briefly introduce the base of WS‐TaaS, Service4All. Second, we provide detailed analysis of the requirements of Web service load testing and present its conceptual architecture as well as algorithm design for improving resource utilization. Third, we present the implementation details of WS‐TaaS. Finally, we perform the evaluation of WS‐TaaS with a set of experiments based on the testing of real Web services, and the results illustrate that WS‐TaaS can efficiently facilitate the whole process of Web service load testing. Especially, comparing with existing testing tools, WS‐TaaS can obtain more effective and accurate test results. Copyright © 2014 John Wiley & Sons, Ltd.     

基于服务网格的制造资源集成

提出了一种基于服务网格的制造资源集成方法，通过将服务网格技术引入制造行业，实现了制造资源的虚拟化，为制造资源提供了统一的接口和互操作协议、屏蔽平台及所使用技术的异构性。平台采用基于服务的协同工作流技术，在动态变化的环境中，能够根据用户需求优化业务逻辑及其执行过程，选择、配置和调度相应的制造资源完成指定的任务，实现跨组织的资源共享和任务协同。     

基于代理和BPEL4WS的Web服务合成与实现

Web服务的交互和实现被推荐通过软件代理来实现.Web服务目前还不能很好地支持动态、自适应的服务组合和分布式业务流程.软件代理在建模、知识表达和交互等技术上的优势,能够强化Web服务的交互和动态应用能力.基于代理和面向流程建模的BPEL4WS,可以实现Web服务面向业务应用的合成与执行,支持多个协同的业务流程及其动态配置.系统分析了代理、BPEL4WS和Web服务整合的技术与实现方案,利用JADE平台开发了相关的测试模型,并且以网上拍卖为案例,验证了所提方案及实现.     

Automatic replication of WSRF-based Grid services via operation providers

The advent of service-oriented architectures in Grid environments has fostered the development of applications in distributed deployments. The Globus Toolkit 4 (GT4) and its implementation of stateful Web services, via the WS-Resource Framework (WSRF), is a suitable platform to develop these Grid services. This way, its increased usage in many scientific areas reveals new scenarios where fault-tolerance and high availability should be considered. This paper describes a library that manages the automatic replication of WSRF-based Grid services. This functionality can be plugged to existing Grid services, by means of minimal changes in its source code, to achieve state replication through WS-Resources. The architecture of the library and its performance evaluation are described. In particular, two different replica topologies are addressed: ring-based and leaf-to-root complete binary tree, in order to achieve resource state update in logarithmic time with respect to the number of replicas. Finally, the paper describes the integration of the replication library into a service-oriented metascheduler to enhance fault-tolerance and to guarantee service availability.     

基于Web Services的高考服务系统的设计和开发

Web Services是一种构建应用程序的应用实体,形成特定条件下的API;同时也是一个可互操作的分布式应用程序平台,并能在所有支持HTTP协议操作系统上实施运行。在网络中服务方提供了一个Web Services平台,该平台不仅提供相关的网络服务,而且会提供一种标准来描述它的服务;而客户可以在网络中其它任何一点调用该服务,并且可以得到足够的信息来得知如何调用。本文设计并开发一款基于Web Services技术的高考服务系统,即在移动终端开发客户端系统,并通过Web Services获取服务器提供的各种信息。在系统中采用多种算法完成模拟志愿填报、高校查询、学习计划等多种模块,并提供高考动态、工具娱乐、心理辅导等多种工具模块,能够帮助考生在高考过程中得到更好的发挥。     

基于任务依赖信息的Web服务自动合成

随着Web服务的大量出现,Web服务的合成成为当前的一个研究热点.然而,目前大多数的合成语言规范,例如BPEL4WS和WSCI,都需要人工预先设计一个固定的执行流程,难以充分发挥Web服务自适应的特点.通过形式化描述单一的Web服务,建立了通过任务间依赖规范实施合成的方法,提出了一种具有柔性和自适应能力的工作流模型,实现Web服务的自动合成.同时,设计了合成的正确性验证算法以及动态补偿机制使提出的模型易于实用.     

Resource-oriented Computing: Design,Implementation, and Evaluation of WSRF.NET

Web services have changed the nature of distributed systems development and operation. The Grid community has begun architecting Grid systems to leverage available commercial and open-source Web services technology through the definition of “stateful resources.” These resource-oriented systems are an extension of service-oriented systems typically built using Web services in that they treat state (and the management of state) as an architectural concern rather than an application-level concern. We present the design, implementation, and evaluation of WSRF.NET, a toolkit for building resource-oriented services using the Microsoft .NET platform. We describe the benefits WSRF.NET provides over “pure” .NET Web services for resource-oriented systems development, in terms of programmability (both programming-language abstractions and compile-time tooling) and improved run-time persistence/management of state. The run-time overhead of WSRF.NET is quantitatively evaluated against other technologies that can be used to add state management to Web services. We argue the core WSRF.NET primitives incur negligible overhead compared to typical domain-specific resource manipulation operations. For example, a computational simulation that lasts 10 min and reads/writes 100 medium-sized resources over those 10 min incurs only 0.46% overhead in WSRF.NET operations.     

Qualitative and quantitative analysis and comparison of Java distributed architectures

In this article we have undertaken a qualitative and quantitative comparison of common approaches used to develop distributed solutions in Java: RMI and Web services for regular unsecured communication, RMI‐SSL and WS‐Security for secure communication and authentication, and HTTP‐to‐port and HTTP‐to‐CGI/servlet tunnelling for RMI communication through firewalls and proxies. We have performed a functional comparison that helps with the selection of the most appropriate approach. We have also carried out a detailed performance analysis with the identification of major bottlenecks, identification of design and implementation guidelines for distributed applications, and specification of optimizations for distributed middleware. This article contributes to the understanding of different approaches for developing Java distributed applications, provides detailed performance analysis, presents design and implementation guidelines, and identifies the major performance overheads. Copyright © 2006 John Wiley & Sons, Ltd.     

集成资源预留与QoS监控框架的元调度体系结构

缺乏服务质量保证已成为制约网格应用的瓶颈,针对该问题提出一个能够在网格中基于SLA协商资源预留并监控资源的QoS的服务框架。首先定义资源预留的XML Schema,使得资源请求者和提供者基于WS-Agreement能够协商包含关于资源预留的协定;然后遵循WSRF及WS-*规范设计和开发出一组Web服务用于构建基于WS-Agreement的资源预留与QoS监控框架（RMF）,并集成到GridWay元调度体系结构中使其能够支持基于QoS协商的资源管理;最后通过模拟实验,客观评估了RMF的性能。     

基于WSRF实现网格与Web服务的融合*

Web服务通知和Web服务资源框架规范提供了可扩展的发布/预订通知模式以及用Web服务为有状态资源建模的能力.介绍WSRF的核心规范,讨论WSRF在Globus Toolkit 4(GT4)的Java实现.最后给出一个基于WSRF和WS-Notification的开发实例,利用WSRF实现网格服务与Web服务的融合.     

基于流程树的BPEL4WS中流程服务动态优化方法*

针对服务流程建模语言BPEL4WS难以满足用户个性化需求也无法适应动态环境变化的问题,提出了一种动态优化BPEL4WS中流程服务的方法。该方法给出了一种Web服务交互代价计算模型,用来评价用户对Web服务的偏好程度以及实时环境下Web服务交互的现实代价。将BPEL4WS描述的服务组合流程转换为服务组合流程树,并借助领域本体对流程树节点进行语义检查,消除流程树中不合法的流程组合。通过深度优先遍历流程树,利用单亲遗传算法对流程服务进行优化组合。最后给出应用算例,并对用来优化组合流程服务的单亲遗传算法的适用性与     

基于BPEL4WS的网格服务组合体系结构及其分析

开放网格服务基础结构OGSI（Open Grid ServicesInfrastrstructure）把Web服务工作流引入到网格任务描述中,给出了几种Web服务与网格技术相融合机制,但并没有界定如何进行网格服务组合.而BPEL4WS（Business Process Execution Language for Web Services）是描述Web服务业务工作流的工业标准.通过对BPEL4WS和OGSI在生命周期管理、Web服务实例化和状态交互管理等方面异同的深度分析,提出了一种兼容OGIS并使用BPEL4WS来合成网格服务的高层体系结构.介绍了一个电力网电能损耗理论计算的实际应用原型系统,表明该文提出的体系结构可应用于网格服务的建模和构造.