Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows |
| |
Affiliation: | Indian Institute of Technology Delhi, India;Department of Computing Science, Umeå University, Sweden;Department of Computer Science and Information Engineering, National Pingtung University, Pingtung 900, Taiwan;Faculty of Pharmacy, Zanjan University of Medical Sciences, Gavazang Road, Mahdavi St., Zanjan 45139, Iran;School of Engineering and Computer Science, Victoria University of Wellington, New Zealand;College of Information Systems and Management at National University of Defense Technology, Changsha, China;St. Francis Xavier University, Canada |
| |
Abstract: | End-to-end scientific application workflows that integrate high-end experiments and instruments with large scale simulations and end-user displays are becoming increasingly important. These workflows require complex couplings and data sharing between distributed components involving large data volumes and present varying hard (in-time data delivery) and soft (in-transit processing) quality of service (QoS) requirements. As a result, supporting efficient data transport is critical for such workflows. In this paper, we leverage software-defined networking (SDN) to address issues of data transport service control and resource provisioning to meet varying QoS requirements from multiple coupled workflows sharing the same service medium. Specifically, we present a flexible control and a disciplined resource scheduling approach for data transport services for science networks. Furthermore, we emulate an SDN testbed on top of the FutureGrid virtualized testbed and use it to evaluate our approach for a realistic scientific workflow. Our results show that SDN-based control and resource scheduling based on simple intuitive models can meet the requirements of the targeted workflows with high resource utilization. |
| |
Keywords: | Advance scheduling Data transport SDN In-transit processing Distributed-area coupled simulation workflows |
本文献已被 ScienceDirect 等数据库收录! |
|