Filter Cache:一种提高Lustre I/O性能的方法

高性能计算系统需要一个可靠高效的并行文件系统.Lustre集群文件系统是典型的基于对象存储的集群文件系统,它适合大数据量聚合I/O操作.大文件I/O操作能够达到很高的带宽,但是小文件I/O性能低下.针对导致Lustre的设计中不利于小文件I/O操作的两个方面,提出了Filter Cache方法.在Lustre的OST组件中设计一个存放小文件I/O数据的Cache,让OST端的小文件I/O操作异步进行,以此来减少用户感知的小文件I/O操作完成的时间,提高小文件I/O操作的性能.

Filter Cache: A Method for Improving I/O Performance of Lustre File System

It is necessary to implement a high credible and effective cluster file system for HPC systems.The Lustre cluster file system is a typical object-based storage cluster file system,which is adaptive to large mount aggregate I/O operations to achieve high bandwidth.However,the performance for small file I/O operations is very low.To resolve this problem,a scheme called Filer Cache is proposed.It is a novel cache-based method which can reduce the latency for small file I/O operations by an improved cache specially storing data of small files.The method can let I/O operations be performing asynchronously to reduce the cost of small file I/O operations.