Beyond Music Sharing: An Evaluation of Peer-to-Peer Data Dissemination Techniques in Large Scientific Collaborations |
| |
Authors: | Samer Al-Kiswany Matei Ripeanu Adriana Iamnitchi Sudharshan Vazhkudai |
| |
Affiliation: | (1) Electrical and Computer Engineering Department, The University of British Columbia, Vancouver, Canada;(2) Computer Science and Engineering, University of South Florida, Tampa, FL, USA;(3) Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN, USA |
| |
Abstract: | The avalanche of data from scientific instruments and the ensuing interest from geographically distributed users to analyze
and interpret it accentuates the need for efficient data dissemination. A suitable data distribution scheme will find the
delicate balance between conflicting requirements of minimizing transfer times, minimizing the impact on the network, and
uniformly distributing load among participants. We identify several data distribution techniques, some successfully employed
by today’s peer-to-peer networks: staging, data partitioning, orthogonal bandwidth exploitation, and combinations of the above.
We use simulations to explore the performance of these techniques in contexts similar to those used by today’s data-centric
scientific collaborations and derive several recommendations for efficient data dissemination. Our experimental results show
that the peer-to-peer solutions that offer load balancing and good fault tolerance properties and have embedded participation
incentives lead to unjustified costs in today’s scientific data collaborations deployed on over-provisioned network cores.
However, as user communities grow and these deployments scale, peer-to-peer data delivery mechanisms will likely outperform
other techniques. |
| |
Keywords: | Data dissemination Application level multicast Peer-to-peer Performance evaluation |
本文献已被 SpringerLink 等数据库收录! |
|