FastBit在流量测量系统中的应用

通过对当前网络测量系统中数据存储方案的分析,引入一种新的基于位图索引的列式数据库FastBit的解决方案,通过对不同查询类型引入不同索引编码方法,可以提高查询的效率,使用WAH算法减少了索引占用的存储空间,位图索引可以在查询时快速生成,不需要时删除。通过在网络环境下的测试,证明了该解决方案比基于SQL数据库的方案有更高的效率,更适合高速网络的测量。

Apply of FastBit in Traffic Measurement System

After analyzing some defects of current data storage solution in network measurement,the paper proposes a new solution by using column-oriented databse FastBit,which has bitmap indexes and has various bitmap indexes fit for different queries.They can improve query efficiency effectively.WAH algorithm can save much space for index.Bitmap index can be generated rapidly so we can remove it when we do not execute query.The network environment tests demonstrate the solution has better efficiency,and can work very well in high speed network.