共查询到20条相似文献,搜索用时 46 毫秒
1.
Several Grids have been established and used for varying science applications during the last years. Most of these Grids, however, work in isolation and with different utilisation levels. Previous work has introduced an architecture and a mechanism to enable resource sharing amongst Grids. It has demonstrated that there can be benefits for a Grid to offload requests or provide spare resources to another Grid. In this work, we address the problem of resource provisioning to Grid applications in multiple-Grid environments. The provisioning is carried out based on availability information obtained from queueing-based resource management systems deployed at the provider sites which are the participants of the Grids. We evaluate the performance of different allocation policies. In contrast to existing work on load sharing across Grids, the policies described here take into account the local load of resource providers, imprecise availability information and the compensation of providers for the resources offered to the Grid. In addition, we evaluate these policies along with a mechanism that allows resource sharing amongst Grids. Experimental results obtained through simulation show that the mechanism and policies are effective in redirecting requests thus improving the applications’ average weighted response time. 相似文献
2.
Julien Perez Cécile Germain-Renaud Balazs Kégl Charles Loomis 《Journal of Grid Computing》2010,8(3):473-492
Grids organize resource sharing, a fundamental requirement of large scientific collaborations. Seamless integration of Grids
into everyday use requires responsiveness, which can be provided by elastic Clouds, in the Infrastructure as a Service (IaaS)
paradigm. This paper proposes a model-free resource provisioning strategy supporting both requirements. Provisioning is modeled
as a continuous action-state space, multi-objective reinforcement learning (RL) problem, under realistic hypotheses; simple
utility functions capture the high level goals of users, administrators, and shareholders. The model-free approach falls under
the general program of autonomic computing, where the incremental learning of the value function associated with the RL model
provides the so-called feedback loop. The RL model includes an approximation of the value function through an Echo State Network.
Experimental validation on a real data-set from the EGEE Grid shows that introducing a moderate level of elasticity is critical
to ensure a high level of user satisfaction. 相似文献
3.
Grids facilitate creation of wide-area collaborative environment for sharing computing or storage resources and various applications. Inter-connecting distributed Grid sites through peer-to-peer routing and information dissemination structure (also known as Peer-to-Peer Grids) is essential to avoid the problems of scheduling efficiency bottleneck and single point of failure in the centralized or hierarchical scheduling approaches. On the other hand, uncertainty and unreliability are facts in distributed infrastructures such as Peer-to-Peer Grids, which are triggered by multiple factors including scale, dynamism, failures, and incomplete global knowledge.In this paper, a reputation-based Grid workflow scheduling technique is proposed to counter the effect of inherent unreliability and temporal characteristics of computing resources in large scale, decentralized Peer-to-Peer Grid environments. The proposed approach builds upon structured peer-to-peer indexing and networking techniques to create a scalable wide-area overlay of Grid sites for supporting dependable scheduling of applications. The scheduling algorithm considers reliability of a Grid resource as a statistical property, which is globally computed in the decentralized Grid overlay based on dynamic feedbacks or reputation scores assigned by individual service consumers mediated via Grid resource brokers. The proposed algorithm dynamically adapts to changing resource conditions and offers significant performance gains as compared to traditional approaches in the event of unsuccessful job execution or resource failure. The results evaluated through an extensive trace driven simulation show that our scheduling technique can reduce the makespan up to 50% and successfully isolate the failure-prone resources from the system. 相似文献
4.
Scheduling and resource allocation in large scale distributed environments, such as Computational Grids (CGs), arise new requirements and challenges not considered in traditional distributed computing environments. Among these new requirements, task abortion and security become needful criteria for Grid schedulers. The former arises due to the dynamics of the Grid systems, in which resources are expected to enter and leave the system in an unpredictable way. The latter requirement appears crucial in Grid systems mainly due to a multi-domain nature of CGs. The main aim of this paper is to develop a scheduling model that enables the aggregation of task abortion and security requirements as additional, together with makespan and flowtime, scheduling criteria into a cumulative objective function. We demonstrate the high effectiveness of genetic-based schedulers in finding near-optimal solutions for multi-objective scheduling problem, where all criteria (objectives) are simultaneously optimized. The proposed meta-heuristics are experimentally evaluated in static and dynamic Grid scenarios by using a Grid simulator. The obtained results show the fast reduction of the values of basic scheduler performance metrics, especially in the dynamic case, that confirms the usefulness of the proposed approach in real-life scenarios. 相似文献
5.
Grid resource management systems and schedulers are important components for building Grids. They are responsible for the
selection and allocation of Grid resources to current and future applications. Thus, they are important building blocks for
making Grids available to user communities. In this paper we briefly analyze the requirements of Grid resource management
and provide a classification of schedulers. Then, we define an extensible formal model for Grid scheduling activities, and
characterize the general Grid scheduling problem. Finally, we provide a reference architecture for the support of our model
and discuss different aspects of architectural implementations. 相似文献
6.
Computational Grids connect resources and users in a complex way in order to deliver nontrivial qualities of services. According
to the current trend various communities build their own Grids and due to the lack of generally accepted standards these Grids
are usually not interoperable. As a result, large scale sharing of resources is prevented by the isolation of Grid systems.
Similarly, people are isolated, because the collaborative work of Grid users is not supported by current environments. Each
user accesses Grids as an individual person without having the possibility of organizing teams that could overcome the difficulties
of application development and execution more easily. The paper describes a new workflow-oriented portal concept that solves
both problems. It enables the interoperability of various Grids during the execution of workflow applications, and supports
users to develop and run their Grid workflows in a collaborative way. The paper also introduces a classification model that
can be used to identify workflow-oriented Grid portals based on two general features: Ability to access multiple Grids, and
support for collaborative problem solving. Using the approach the different potential portal types are introduced, their unique
features are discussed and the portals and Problem Solving Environments (PSE) of our days are classified. The P-GRADE Portal
as a Globus-based implementation for the classification model is also presented.
The work described in this paper is supported by the Hungarian Grid project (IHM 4671/1/2003), by the Hungarian OTKA project
(No. T042459) and a collaboration project with the University of Reading. 相似文献
7.
Raouf Boutaba Wojciech Golab Youssef Iraqi Tianshu Li Bill St. Arnaud 《Journal of Grid Computing》2003,1(4):387-394
Grid applications call for high performance networking support. One attractive solution is to deploy Grids over optical networks. However, resource management in optical domains is traditionally very rigid and cannot successfully meet the requirements of Grid applications, such as flexible provisioning and configuration. In this paper, we present a customizable resource management solution for optical networks where users can create lightpaths on demand and manage their own network resources. Thanks to a Grid-centric system architecture, lightpath resources can be shared among users and easily integrated with data and computation Grids. 相似文献
8.
Online algorithms for advance resource reservations 总被引:2,自引:0,他引:2
C. CastilloAuthor Vitae G.N. RouskasAuthor Vitae 《Journal of Parallel and Distributed Computing》2011,71(7):963-973
We consider the problem of providing QoS guarantees to Grid users through advance reservation of resources. Advance reservation mechanisms provide the ability to allocate resources to users based on agreed-upon QoS requirements and increase the predictability of a Grid system, yet incorporating such mechanisms into current Grid environments has proven to be a challenging task due to the resulting resource fragmentation. We use concepts from computational geometry to present a framework for tackling the resource fragmentation, and for formulating a suite of scheduling strategies. We also develop efficient implementations of the scheduling algorithms that scale to large Grids. We conduct a comprehensive performance evaluation study using simulation, and we present numerical results to demonstrate that our strategies perform well across several metrics that reflect both user- and system-specific goals. Our main contribution is a timely, practical, and efficient solution to the problem of scheduling resources in emerging on-demand computing environments. 相似文献
9.
《Journal of Parallel and Distributed Computing》2006,66(5):763-771
Since the late 1990s, we have witnessed an extraordinary development of Grid technologies. Nowadays, different Grids are being deployed within the context of a growing number of national and transnational research projects. However, the coexistence of those different infrastructures involves two challenging issues, namely: (i) simultaneous and coordinated use of resources from different Grids, from the end user perspective; and (ii) the simultaneous contribution of resources to different Grids, from the resource owner perspective. In this paper, we demonstrate that a decentralized and “end-to-end” scheduling and execution system can efficiently interoperate different Grids. In particular, we evaluate the coordinated use of the EGEE and IRISGrid testbeds in the execution of a Bioinformatics application. Results show the feasibility of building loosely coupled computational Grid environments only based on Globus services, while obtaining non-trivial levels of quality of service, in terms of performance and reliability. Such approach allows a straightforward resource sharing since the resources are accessed by using de facto standard protocols and interfaces. 相似文献
10.
As Grid computing has emerged as a technology for providing the computational resources to industries and scientific projects, new requirements arise. Nowadays, resource management has become an important research area in the Grid computing environment. To provision the appropriate resource to a corresponding application is a tedious task. So, it is important to check and verify the provisioning of the resource before the application’s execution. In this paper, a resource provisioning framework has been presented that offers a resource provisioning policy, which caters to provisioned resource allocation and resource scheduling. The framework has been formally specified and verified. Formal specification and verification of the framework helps in predicting possible errors before the scheduling process itself, and thus results in efficient resource provisioning and scheduling of Grid resources. 相似文献
11.
Mohsen Amini Salehi Bahman Javadi Rajkumar Buyya 《Journal of Parallel and Distributed Computing》2012
Resource provisioning is one of the challenges in federated Grid environments. In these environments each Grid serves requests from external users along with local users. Recently, this resource provisioning is performed in the form of Virtual Machines (VMs). The problem arises when there are insufficient resources for local users to be served. The problem gets complicated further when external requests have different QoS requirements. Serving local users could be solved by preempting VMs from external users which impose overheads on the system. Therefore, the question is how the number of VM preemptions in a Grid can be minimized. Additionally, how we can decrease the likelihood of preemption for requests with more QoS requirements. We propose a scheduling policy in InterGrid, as a federated Grid, which reduces the number of VM preemptions and dispatches external requests in a way that fewer requests with QoS constraints get affected by preemption. Extensive simulation results indicate that the number of VM preemptions is decreased at least by 60%, particularly, for requests with more QoS requirements. 相似文献
12.
A Market-Oriented Grid Directory Service for Publication and Discovery of Grid Service Providers and their Services 总被引:1,自引:0,他引:1
The emergence of Grids as a platform for sharing and aggregation of distributed resources increases the need for mechanisms
that allow an efficient management of resources. The Grid economy has been identified as one of the potential solutions as
it helps in managing the supply and demand for resources and enables sustained sharing of resources by providing economic
incentive for Grid resource providers. An economy based Grid computing environment needs to support an infrastructure that
enables the creation of a marketplace for meeting of providers and consumers. This paper presents the Grid Market Directory (GMD) that serves as a registry for publication and discovery of Grid service providers and their services. 相似文献
13.
Oscar Ardaiz Pau Artigas Torsten Eymann Felix Freitag Leandro Navarro Michael Reinicke 《Applied Intelligence》2006,25(2):131-145
Efficient resource allocation in dynamic large-scale environments is one of the challenges of Grids. In centralized economic-based
allocation approaches, the user requests can be matched to the fastest, cheapest or most available resource. This approach,
however, shows limitations in scalability and in dynamic environments. In this paper, we explore a decentralized economic
approach for resource allocation in Grid markets based on the Catallaxy paradigm. Catallactic agents discover selling nodes
in the resource and service Grid markets, and negotiate with each other maximizing their utility by following a strategy.
By means of simulations, we evaluate the behavior of the approach, its resource allocation efficiency and its performance
with different demand loads in a number of Grid density and dynamic environments. Our results indicate that while the decentralized
economic approach based on Catallaxy applied to Grid markets shows similar efficiency to a centralized system, its decentralized
operation provides greater advantages: scalability to demand and offer, and robustness in dynamic environments. 相似文献
14.
Computational Grids are emerging as a new paradigm for sharing and aggregation of geographically distributed resources for solving large‐scale compute and data intensive problems in science, engineering and commerce. However, application development, resource management and scheduling in these environments is a complex undertaking. In this paper, we illustrate the development of a Virtual Laboratory environment by leveraging existing Grid technologies to enable molecular modelling for drug design on geographically distributed resources. It involves screening millions of compounds in the chemical database (CDB) against a protein target to identify those with potential use for drug design. We have used the Nimrod‐G parameter specification language to transform the existing molecular docking application into a parameter sweep application for executing on distributed systems. We have developed new tools for enabling access to ligand records/molecules in the CDB from remote resources. The Nimrod‐G resource broker along with molecule CDB data broker is used for scheduling and on‐demand processing of docking jobs on the World‐Wide Grid (WWG) resources. The results demonstrate the ease of use and power of the Nimrod‐G and virtual laboratory tools for grid computing. Copyright © 2003 John Wiley & Sons, Ltd. 相似文献
15.
Umar Farooq Author Vitae Shikharesh Majumdar Author Vitae Author Vitae 《Journal of Systems and Software》2009,82(1):23-38
Scalability, flexibility, quality of service provisioning, efficiency and robustness are the desired characteristics of most computing systems. Although the emerging Grid computing paradigm is scalable and flexible, achieving both efficiency and quality of service provisioning in Grids is a challenging task but is necessary for the wide adoption of Grids. Grid middleware should also be robust to uncertainties such as those in user-estimated runtimes of Grid applications. In this paper, we present a complete middleware framework for Grids that achieves user satisfaction by providing QoS guarantees for Grid applications, cost effectiveness by efficiently utilizing resources and robustness by intelligently handling uncertain runtimes of applications. 相似文献
16.
Cristian Mateos Alejandro Zunino Matías HirschMariano Fernández Marcelo Campo 《Advances in Engineering Software》2011,42(4):172-186
Computational Grids deliver the necessary computational infrastructure to perform resource-intensive computations such as the ones that solve the problems scientists are facing today. Exploiting Computational Grids comes at the expense of explicitly adapting the ordinary software implementing scientific problems to take advantage of Grid resources, which unavoidably requires knowledge on Grid programming. The recent notion of “gridifying” ordinary applications, which is based on semi-automatically deriving a Grid-aware version from the compiled code of a sequential application, promises users to be relieved from the requirement of manual usage of Grid APIs within their source codes. In this paper, we describe a novel gridification tool that allows users to easily parallelize Java applications on Grids. Extensive experiments with two real-world applications - ray tracing and sequence alignment - suggest that our approach provides a convenient balance between ease of gridification and Grid resource exploitation compared to manually using Grid APIs for gridifying ordinary applications. 相似文献
17.
Bruno Volckaert Pieter Thysebaert Marc De Leenheer Filip De Turck Bart Dhoedt Piet Demeester 《The Journal of supercomputing》2006,38(3):279-305
In this paper, a distributed and scalable Grid service management architecture is presented. The proposed architecture is
capable of monitoring task submission behaviour and deriving Grid service class characteristics, for use in performing automated
computational, storage and network resource-to-service partitioning. This partitioning of Grid resources amongst service classes
(each service class is assigned exclusive usage of a distinct subset of the available Grid resources), along with the dynamic
deployment of Grid management components dedicated and tuned to the requirements of a particular service class introduces
the concept of Virtual Private Grids. We present two distinct algorithmic approaches for the resource partitioning problem,
the first based on Divisible Load Theory (DLT) and the second built on Genetic Algorithms (GA). The advantages and drawbacks
of each approach are discussed and their performance is evaluated on a sample Grid topology using NSGrid, an ns-2 based Grid
simulator. Results show that the use of this Service Management Architecture in combination with the proposed algorithms improves
computational and network resource efficiency, simplifies schedule making decisions, reduces the overall complexity of managing
the Grid system, and at the same time improves Grid QoS support (with regard to job response times) by automatically assigning
Grid resources to the different service classes prior to scheduling. 相似文献
18.
Marcos Dias de Assuno Rajkumar Buyya Srikumar Venugopal 《Concurrency and Computation》2008,20(8):997-1024
Over the last few years, several nations around the world have set up Grids to share resources such as computers, data, and instruments to enable collaborative science, engineering, and business applications. These Grids follow a restricted organizational model wherein a Virtual Organization (VO) is created for a specific collaboration and all interactions such as resource sharing are limited to within the VO. Therefore, dispersed Grid initiatives have led to the creation of disparate Grids with little or no interaction between them. In this paper, we propose a model that: (a) promotes interlinking of islands of Grids through peering arrangements to enable InterGrid resource sharing; (b) provides a scalable structure for Grids that allow them to interconnect with one another and grow in a sustainable way; (c) creates a global Cyberinfrastructure to support e‐Science and e‐Business applications. This work identifies and proposes architecture, mechanisms, and policies that allow the internetworking of Grids and allows Grids to grow in a similar manner as the Internet. We term the structure resulting from such internetworking between Grids as the InterGrid. The proposed InterGrid architecture is composed of InterGrid Gateways responsible for managing peering arrangements between Grids. We discuss the main components of the architecture and present a research agenda to enable the InterGrid vision. Copyright © 2007 John Wiley & Sons, Ltd. 相似文献
19.
Combining Grid and P2P technologies can be exploited to provide high-level data sharing in large-scale distributed environments.
However, this combination must deal with two hard problems: the scale of the network and the dynamic behavior of the nodes.
In this paper, we present our solution in APPA (Atlas Peer-to-Peer Architecture), a data management system with high-level
services for building large-scale distributed applications. We focus on data availability and data discovery which are two
main requirements for implementing large-scale Grids. We have validated APPA’s services through a combination of experimentation
over Grid5000, which is a very large Grid experimental platform, and simulation using SimJava. The results show very good
performance in terms of communication cost and response time.
Work partially funded by ARA “Massive Data” of the French ministry of research and the European Strep Grid4All project. 相似文献
20.
A super-peer model for resource discovery services in large-scale Grids 总被引:12,自引:0,他引:12
Carlo Mastroianni Domenico Talia Oreste Verta 《Future Generation Computer Systems》2005,21(8):440-1248
As deployed Grids increase from tens to thousands of nodes, peer-to-peer (P2P) techniques and protocols can be used to implement scalable services and applications. The super-peer model is a novel approach that helps the convergence of P2P models and Grid environments and can be used to deploy a P2P information service in Grids. A super-peer serves a single physical organization in a Grid, and manages metadata associated to the resources provided by the nodes of that organization. Super-peers connect to each other to form a peer network at a higher level. This paper examines how the super-peer model can handle membership management and resource discovery services in a multi-organizational Grid. A simulation analysis evaluates the performance of a resource discovery protocol; simulation results can be used to tune protocol parameters in order to increase search efficiency. 相似文献