A New Data Layout Scheme for Energy-Efficient MapReduce Processing Tasks |
| |
| Authors: | Xuan T. Tran Tien Van Do Csaba Rotter Dosam Hwang |
| |
| Affiliation: | 1.Division of Knowledge and System Engineering for ICT, Faculty of Information Technology,Ton Duc Thang University,Ho Chi Minh City,Vietnam;2.Department of Networked Systems and Services,Budapest University of Technology and Economics,Budapest,Hungary;3.Nokia Bell Labs,Budapest,Hungary;4.Department of Computer Engineering,Yeungnam University,Gyeongsan,Korea |
| |
| Abstract: | Yet Another Resource Negotiator (YARN) is a framework to manage and allocate resource requests from applications that process big data stored in HDFS. However, dynamic power management methods are not efficient when YARN manage applications to process big data stored in the default data layout of HDFS. In this paper, we propose a new data layout scheme that can be implemented for HDFS. A comparison between our proposal and the existing HDFS data layout scheme shows that the new data layout algorithm significantly reduces the energy consumption at the slight expense of the mean response time of jobs. |
| |
| Keywords: | |
| 本文献已被 SpringerLink 等数据库收录！ |
|
