首页 | 本学科首页   官方微博 | 高级检索  
     

高速网络环境下数据的压缩存储
引用本文:张宝军,平玲娣,潘雪增,王界兵.高速网络环境下数据的压缩存储[J].浙江大学学报(自然科学版 ),2009,43(9):1585-1590.
作者姓名:张宝军  平玲娣  潘雪增  王界兵
作者单位:(1.浙江大学 计算机科学与技术学院,浙江 杭州 310027;2. 汉帆(杭州)信息技术有限公司,浙江 杭州 310012)
基金项目:浙江省重大专项重点资助项目(2007C11068,2007C11088);国家“863”高技术研究发展计划资助项目(2006AA01Z431).
摘    要:针对高速网络环境下数据的压缩存储问题,提出一种实用的解决方案,该方案采用软硬件相结合的压缩存储方法,在不影响网络速度的前提下,可以对数据进行实时的压缩存储.方案在硬件上使用汉帆公司(HIFN)的DR系列高性能无损数据压缩卡,该卡由多个9 630压缩芯片组成,采用拥有汉帆自主专利的增强型LZS技术,能够在满足压缩比的前提下提供快速的数据加解压功能.当硬件出现故障时,该方案将采用设备驱动程序中内嵌的eLZS软件模块对数据进行无缝的加解压处理,以保障系统的正常运行.为了使DR压缩卡在Windows环境下有效工作,开发DR压缩卡的Windows驱动程序.该方案在Linux及Windows环境下得到实现,在测试过程中表现出较好的性能.

关 键 词:虚拟磁带库  压缩比  吞吐量  增强型LZS  核心模式驱动程式架构  输入/输出请求包

Data compression and storage under high speed network
ZHANG Bao-jun,PING Ling-di,PAN Xue-zeng,WANG Jie-bing.Data compression and storage under high speed network[J].Journal of Zhejiang University(Engineering Science),2009,43(9):1585-1590.
Authors:ZHANG Bao-jun  PING Ling-di  PAN Xue-zeng  WANG Jie-bing
Affiliation:(1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China; 2.Hifn (Hangzhou) Information Technology Limited Company, Hangzhou 310012, China) 
Abstract:A practical scheme was proposed aiming at the problem of data compression and storage under  high speed network. The scheme compressed the data with hardware and software, and without any performance affection to the network speed. HIFN data reduction (DR) series high performance lossless data compression card was used in hardware. The card had multi 9630 compression chips and used the eLZS compression algorithm to provide fast data compression and decompression with satisfactory compression ratio. An eLZS module embedded in the DR device driver  compressed and decompressed the data seamlessly when the hardware was failure in order to make the system run normally. The Windows driver of DR was developed in order to make DR compression card work on Windows effectively. The scheme was realized on both Linux and Windows platform and showed good performance under the test.
Keywords:virtual tape library(VTL)  compression ratio  throughput  enhanced Lempel Ziv Stac (eLZS)  kernel mode driver framework (KMDF)  I/O request packet (IRP)
点击此处可从《浙江大学学报(自然科学版 )》浏览原始摘要信息
点击此处可从《浙江大学学报(自然科学版 )》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号