首页 | 本学科首页   官方微博 | 高级检索  
     

一种基于小数据同步写的回写I/O调度器
引用本文:刘星,江松,王洋,范小朋,须成忠.一种基于小数据同步写的回写I/O调度器[J].软件学报,2017,28(8):1968-1981.
作者姓名:刘星  江松  王洋  范小朋  须成忠
作者单位:中国科学院深圳先进技术研究院, 深圳 518055;中国科学院大学深圳先进技术学院, 深圳 518055,中国科学院深圳先进技术研究院, 深圳 518055;美国德州大学阿灵顿分校计算机科学和工程系, 美国,中国科学院深圳先进技术研究院, 深圳 518055,中国科学院深圳先进技术研究院, 深圳 518055,中国科学院深圳先进技术研究院, 深圳 518055;美国韦恩州立大学电子与计算机工程系, 美国
基金项目:本文的研究工作获得国家重点基础研究计划(973计划)(2015CB352400),国家自然科学基金(61572487,61672513,61572377,U1401258和61550110250),广东省自然科学基金(2015B010129011和2016A030313183),和深圳市海外高层次人才创新创业专项(孔雀计划KQCX20140521115045446)
摘    要:小数据同步写普遍存在于的各种计算机环境中,并且可以由计算机系统的不同层次软件产生,从底层操作系统一直到上层应用软件都可以生成小数据同步写请求.然而,操作系统的文件系统是以块作为最小逻辑可寻址单位,小数据写将会导致严重的写放大问题,使得系统的I/O性能大幅降低.为了解决上述问题,我们提出了一种新的I/O调度器,并将它取名为“Hitchhike”.该调度器可以识别小数据写,并通过对其他数据块中的数据进行压缩,,将小数据嵌入到压缩出来的空间中,从而将小数据和该数据块一起写入到磁盘上,以异步回写的方式完成小数据的同步写,不仅有效缓解了磁盘的写放大问题,也大大提高了小数据同步写的效率.我们基于Linux中Deadline调度器实现了Hitchhike原型系统,并利用Filebench基准测试来测试调度器在吞吐量、I/O延迟等方面的性能.通过和传统I/O调度器的性能进行比较,我们可以发现Hitchhike调度器能够显著的提高小数据同步写性能高达48.6%.

关 键 词:同步写  小数据写  I/O调度器  写放大
收稿时间:2016/8/7 0:00:00
修稿时间:2016/12/1 0:00:00

Writeback I/O Scheduler Based on Small Synchronous Writes
LIU Xing,JIANG Song,WANG Yang,FAN Xiao-Peng and XU Cheng-Zhong.Writeback I/O Scheduler Based on Small Synchronous Writes[J].Journal of Software,2017,28(8):1968-1981.
Authors:LIU Xing  JIANG Song  WANG Yang  FAN Xiao-Peng and XU Cheng-Zhong
Affiliation:Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China;Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, China,Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China;Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76010, USA,Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China,Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China and Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China;Department of Electrical and Computer Engineering, Wayne State University, Detroit, MI 48202, USA
Abstract:Small and synchronous writes are pervasive in various environments and manifest in various levels of software stack, ranging from device drivers to application software. Given a block interface, small write can cause serious write amplifications, which can substantially degrade the overall I/O performance. To address this issues, we present a novel block I/O scheduler, named Hitchhike, in this paper. Hitchhike is able to identify small writes, and embed them into other data blocks through data compression. With Hitchhike, we can enable a writeback buffer for small synchronous writes, not only removing the write amplification, but also dramatically improving the performance of small synchronous writes. We implemented Hitchhike based on the Deadline I/O schedulers in Linux 2.6.32, and evaluated it by running Filebench benchmark. Our results show that compared to traditional approaches, Hitchhike can significantly improve the performance of synchronous small writes up to 48.6%.
Keywords:synchronous writes  small writes  I/O scheduler  write amplification
点击此处可从《软件学报》浏览原始摘要信息
点击此处可从《软件学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号