| Hadoop平台的性能优化研究 |
| |
| 引用本文： | 栾亚建,黄翀民,龚高晟,赵铁柱. Hadoop平台的性能优化研究[J]. 计算机工程, 2010, 36(14): 262-263 |
| |
| 作者姓名： | 栾亚建 黄翀民 龚高晟 赵铁柱 |
| |
| 作者单位： | 华南理工大学广东省计算机网络重点实验室,广州,510640 |
| |
| 基金项目： | Sun Microsystems公司研究基金 |
| |
| 摘 要： | 随着基于MapReduce模型的应用程序越来越多，Hadoop性能取决于应用程序。针对上述特性，从应用着手剖析Hadoop存在的局限和不足，提出解决方案，利用作业和任务的多重并发平衡磁盘和网络带宽，减小瓶颈出现的可能性，提高系统性能。
|
| 关 键 词： | 分布式计算 存储 并发I/O 性能优化 |
Research on Performance Optimization of Hadoop Platform |
| |
| LUAN Ya-jian,HUANG Chong-min,GONG Gao-sheng,ZHAO Tie-zhu. Research on Performance Optimization of Hadoop Platform[J]. Computer Engineering, 2010, 36(14): 262-263 |
| |
| Authors: | LUAN Ya-jian HUANG Chong-min GONG Gao-sheng ZHAO Tie-zhu |
| |
| Affiliation: | (Key Lab of Computer Network of Guangdong Province, South China University of Technology, Guangzhou 510640) |
| |
| Abstract: | As applications programs based on MapReduce model growing up, Hadoop’s performance depends on applications. From applications, this paper analyzes the limitations and shortcomings of Hadoop architecture and storage technology, and proposes a feasible and cost-effective solution to address the problem. It builds a series tests to convince the idea. The solution is multi-level parallel, both on job and I/O levels, which makes full use of disk and network bandwidth, reduces I/O bottlenecks and improves performance. |
| |
| Keywords: | distributed computing storage concurrent I/O performance optimization |
| 本文献已被 维普 万方数据 等数据库收录！ |
| 点击此处可从《计算机工程》浏览原始摘要信息 |
|
点击此处可从《计算机工程》下载免费的PDF全文 |
|
