Scheduling divisible MapReduce computations |
| |
Authors: | J. BerlińskaAuthor Vitae |
| |
Affiliation: | a Faculty of Mathematics and Computer Science, Adam Mickiewicz University, Umultowska 87, 61-614 Poznań, Polandb Institute of Computing Science, Poznań University of Technology, Piotrowo 2, 60-965 Poznań, Poland |
| |
Abstract: | In this paper we analyze MapReduce distributed computations as a divisible load scheduling problem. The two operations of mapping and reducing can be understood as two divisible applications with precedence constraints. A divisible load model of the computation, and two load partitioning algorithms are proposed. Performance limits of MapReduce computations are investigated. To our best knowledge this is the first time that processing applications with precedence constraints have been considered on the grounds of divisible load theory. |
| |
Keywords: | Parallel processing MapReduce Scheduling Divisible loads Performance evaluation |
本文献已被 ScienceDirect 等数据库收录! |
|