A complete and efficient CUDA-sharing solution for HPC clusters |
| |
Authors: | Antonio J. Peñ a,Carlos Reañ o,Federico Silla,Rafael Mayo,Enrique S. Quintana-Ortí ,José Duato |
| |
Affiliation: | 1. MCS, Argonne National Laboratory, Argonne, IL 60439, USA;2. DISCA, Universitat Politècnica de València, 46022 Valencia, Spain;3. DICC, Universitat Jaume I, 12071 Castellón, Spain |
| |
Abstract: | In this paper we detail the key features, architectural design, and implementation of rCUDA, an advanced framework to enable remote and transparent GPGPU acceleration in HPC clusters. rCUDA allows decoupling GPUs from nodes, forming pools of shared accelerators, which brings enhanced flexibility to cluster configurations. This opens the door to configurations with fewer accelerators than nodes, as well as permits a single node to exploit the whole set of GPUs installed in the cluster. In our proposal, CUDA applications can seamlessly interact with any GPU in the cluster, independently of its physical location. Thus, GPUs can be either distributed among compute nodes or concentrated in dedicated GPGPU servers, depending on the cluster administrator’s policy. This proposal leads to savings not only in space but also in energy, acquisition, and maintenance costs. The performance evaluation in this paper with a series of benchmarks and a production application clearly demonstrates the viability of this proposal. Concretely, experiments with the matrix–matrix product reveal excellent performance compared with regular executions on the local GPU; on a much more complex application, the GPU-accelerated LAMMPS, we attain up to 11x speedup employing 8 remote accelerators from a single node with respect to a 12-core CPU-only execution. GPGPU service interaction in compute nodes, remote acceleration in dedicated GPGPU servers, and data transfer performance of similar GPU virtualization frameworks are also evaluated. |
| |
Keywords: | Graphics processors Virtualization High performance computing Clusters |
本文献已被 ScienceDirect 等数据库收录! |
|