| Hadoop平台下改进的LATE调度算法 |
| |
| 引用本文： | 胡 丹,于 炯,英昌甜,邹伟明.Hadoop平台下改进的LATE调度算法[J].计算机工程与应用,2014(4):86-89,131. |
| |
| 作者姓名： | 胡 丹 于 炯 英昌甜 邹伟明 |
| |
| 作者单位： | 新疆大学信息科学与工程学院,乌鲁木齐830046 |
| |
| 基金项目： | 国家自然科学基金（No.60863003，No.61063042）；新疆维吾尔自治区自然科学基金（No.2011211A011）。 |
| |
| 摘 要： | 对Hadoop平台下的MapReduce现有的调度器进行分析研究。针对LATE调度算法在分配节点执行落后任务的备份任务时的不足,结合Hadoop集群的异构性和工作负载的特殊性,在LATE调度算法的基础上提出了一种改进的LATE调度算法。对该算法进行实验和性能分析,表明该算法在完成时间和负载均衡方面有很大改进。
|
| 关 键 词： | Hadoop MapReduce LATE 落后任务 |
Improved LATE scheduling algorithm on Hadoop paltform |
| |
| HU Dan,YU Jiong,YING Changtian,ZOU Weiming.Improved LATE scheduling algorithm on Hadoop paltform[J].Computer Engineering and Applications,2014(4):86-89,131. |
| |
| Authors: | HU Dan YU Jiong YING Changtian ZOU Weiming |
| |
| Affiliation: | College of Information Science and Technology, Xinjiang University, Urumqi 830046, China |
| |
| Abstract: | The existing schedulers of MapReduce on the Hadoop platform are analyzed. To consider the lack of LATE scheduling algorithm in allocating TaskTracker to execute backup tasks for backward tasks, combining with the particularity of Hadoop cluster heterogeneity and workload, an improved scheduling algorithm is proposed based on LATE scheduling algorithm. The experiments and performance analysis for the algorithm show that it has significantly improved in the com-pletion time and load balancing. |
| |
| Keywords: | Hadoop MapReduce LATE backward task |
| 本文献已被 CNKI 维普 等数据库收录！ |
|
