首页 | 本学科首页   官方微博 | 高级检索  
     

基于重复数据删除技术的雾存储数据去冗余方案
引用本文:陈思佳,温蜜,陈珊.基于重复数据删除技术的雾存储数据去冗余方案[J].计算机应用与软件,2020,37(2):18-24,98.
作者姓名:陈思佳  温蜜  陈珊
作者单位:上海电力大学计算机科学与技术学院 上海 200090;上海电力大学计算机科学与技术学院 上海 200090;上海电力大学计算机科学与技术学院 上海 200090
摘    要:雾计算作为云中心在网络边缘的延伸,将不需要放在云端的数据直接进行存储和处理,从而可以快速响应底端设备的需求。为了解决现有方案中频繁的磁盘输入和输出(I/O),针对雾节点中存储数据的冗余问题,提出重复数据删除方案(DeFog)。利用红黑树的快速查找机制,在内存中构建数据指纹表,通过二次Hash获得索引表。固定时刻刷新内存中的指纹表保存在磁盘中,日志文件记录每次数据更新,这样在系统发生崩溃机器重启时,磁盘中的指纹表会与日志文件合并构建更新后的指纹表。通过在标准数据集中的实验与其他方案进行对比,证明了DeFog在查询效率上提高了54.1%,运行时间降低了42.1%。

关 键 词:重复数据删除  雾计算  数据冗余  红黑树  索引表  内存  I/O优化

DATA DE-REDUNDANCY SCHEME IN FOG STORAGE BASED ON DATA DE-DUPLICATION TECHNOLOGY
Chen Sijia,Wen Mi,Chen Shan.DATA DE-REDUNDANCY SCHEME IN FOG STORAGE BASED ON DATA DE-DUPLICATION TECHNOLOGY[J].Computer Applications and Software,2020,37(2):18-24,98.
Authors:Chen Sijia  Wen Mi  Chen Shan
Affiliation:(College of Computer Science and Technology,Shanghai University of Electric Power,Shanghai 200090,China)
Abstract:As an extension of the cloud data center at the edge of the network,fog computing will directly store and process data that does not need to be placed in the cloud,so as to quickly respond to the needs of the bottom devices.In order to solve the frequent disk input and output(I/0)in the existing scheme,a de-duplication scheme(DeFog)is proposed for the redundancy problem of storing data in the fog node.Using the fast search mechanism of the RB tree,a data fingerprint table was built in the memory,and an index table was obtained through the secondary hash.The fingerprint table in the memory was saved at a fixed time in the disk,and the log file recorded every data update,When the system crashed and the machine restarted,the fingerprint table on the disk would be merged with the log file to construct the updated fingerprint table.Through the experiments in the standard datasets and the comparison with other schemes,it is proved that DeFog improves the query efficiency by 54.1%and reduces the running time by 42.1%.
Keywords:De-duplication  Fog computing  Redundant data  RB tree  Indexing table  Memory  I/0 optimization
本文献已被 维普 万方数据 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号