首页 | 本学科首页   官方微博 | 高级检索  
     

分布式文件系统的流式数据预读
引用本文:闫鹤,李小勇,胡鹏,刘海涛.分布式文件系统的流式数据预读[J].计算机研究与发展,2012(Z1):252-256.
作者姓名:闫鹤  李小勇  胡鹏  刘海涛
作者单位:上海交通大学信息安全工程学院
基金项目:上海市科委基金资助重大项目(10DZ1500200)
摘    要:在分布式文件系统中,网络和磁盘往往是影响IO性能的主要因素.如何最大限度地挖掘网络和磁盘的性能潜力,长期以来一直都是非常活跃的研究课题.已有研究工作主要侧重于预取策略和数据的缓存策略,而未能将网络和服务器端磁盘I/O统一进行调度.提出并设计实现了一种流式预读方法,通过在客户端改变发送预读请求和接收预读数据的顺序,交错网络传输和磁盘访问,实现了延迟隐藏.测试表明,这种方法确实显著提高了顺序读性能.

关 键 词:分布式文件系统  预读  延迟隐藏  网络传输  磁盘IO

Streaming Data Readahead on Distributed File System
Yan He, Li Xiaoyong, Hu Peng, and Liu Haitao.Streaming Data Readahead on Distributed File System[J].Journal of Computer Research and Development,2012(Z1):252-256.
Authors:Yan He  Li Xiaoyong  Hu Peng  and Liu Haitao
Affiliation:(School of Information Security Engineering, Shanghai Jiao Tong University, Shanghai 200240)
Abstract:The IO process of Distributed File System includes network transmission and disk IO on server, which tend to be the bottlenecks that affect performance. How to explore the potential of network and disk performance has long been a subject of very active research. We design and implement a distribute file system BlueOcean, but we find that BlueOcean has not paralleled up to network and disk. So we have proposed and implemented a streaming data read-ahead method, which interleaves network transmission and disk IO and achieves a delay hiding. With experimental test, we found this method has actually improved system performance.
Keywords:distribute file system  readahead  latency hiding  network transmission  disk IO
本文献已被 CNKI 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号