首页 | 本学科首页   官方微博 | 高级检索  
     

适应大规模数据处理的动态服务私有云系统
引用本文:汪竹,梅林,李磊,赵太银,胡光岷.适应大规模数据处理的动态服务私有云系统[J].计算机应用,2012,32(4):1009-1012.
作者姓名:汪竹  梅林  李磊  赵太银  胡光岷
作者单位:1. 电子科技大学 光纤传感与通信教育部重点实验室,成都 6117312. 川庆钻探工程有限公司 地球物理勘探公司,成都 610213
基金项目:新世纪优秀人才计划支持项目(NCET-07-0148)
摘    要:为适应私有云环境下数据量大、计算密集、流程复杂的计算任务需求,借鉴公有云计算的相关理论与技术,结合私有云环境的特点,提出了一种适应大规模数据处理的动态服务私有云系统实现方案。该方案使用作业文件描述计算任务,以作业逻辑结构动态构建处理工作流程;通过数据流驱动服务请求,引入MapReduce并行框架进行大规模数据处理。实验结果表明:该方案能够正确有效地处理数据量大、计算密集、流程复杂的计算任务,显著提升处理效率,具有很高的实用性。

关 键 词:云计算    私有云计算    数据流驱动    动态服务    并行处理
收稿时间:2011-09-14
修稿时间:2011-11-16

Private cloud computing system based on dynamic service adaptable to large-scale data processing
WANG Zhu,MEI Lin,LI Lei,ZHAO Tai-yin,HU Guang-min.Private cloud computing system based on dynamic service adaptable to large-scale data processing[J].journal of Computer Applications,2012,32(4):1009-1012.
Authors:WANG Zhu  MEI Lin  LI Lei  ZHAO Tai-yin  HU Guang-min
Affiliation:1. Key Laboratory of Optical Fiber Sensing and Communication Ministry of Education,University of Electronic Science and Technology of China, Chengdu Sichuan 611731, China2. Geophysical Exploration Company, Chuanqing Drilling Engineering Company Limited, Chengdu Sichuan 610213, China
Abstract:In order to deal with problem in private cloud environment caused by computing tasks with large amount of data,intensive computing and complex processing,an implementation of private cloud system based on dynamic service was proposed on the basis of public cloud computing and the characteristics of private cloud environment,which was able to adapt large-scale data processing.In this implementation,computing tasks were described by job files,processing workflows were constructed dynamically by job logic,service requests were driven by data streams and the large-scale data processing could be reflected more efficiently in MapReduce parallel framework.The experimental results show that this implementation offers a high practical value,can deal with computing tasks with large amount of data,intensive computing and complex processing correctly and efficiently.
Keywords:cloud computing  private cloud computing  data-flow driven  dynamic service  parallel computing
本文献已被 CNKI 等数据库收录!
点击此处可从《计算机应用》浏览原始摘要信息
点击此处可从《计算机应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号