Mapping functions and data redistribution for parallel files |
| |
Authors: | Florin Isaila Walter F Tichy |
| |
Affiliation: | (1) Departement of Computer Science, University Carlos III, Madrid, Spain;(2) Department of Computer Science, University of Karlsruhe, Karlsruhe, Germany |
| |
Abstract: | Data distribution in memory or on disks is an important factor influencing the performance of parallel applications. On the
other hand, programs or systems, like a parallel file system, frequently redistribute data between memory and disks.
This paper presents a generalization of previous approaches of the redistribution problem. We introduce algorithms for mapping
between two arbitrary distributions of a data set. The algorithms are optimized for multidimensional array partitions. We
motivate our approach and present potential utilizations. The paper also presents a case study, the employment of mapping
functions, and redistribution algorithms in a parallel file system.
|
| |
Keywords: | Parallel file systems Parallel I/O Noncontiguous I/O Multi-dimensional array redistribution Mapping functions |
本文献已被 SpringerLink 等数据库收录! |
|