大规模数据集的分布式索引机制研究

对大规模结构化半结构化数据集分布式存储环境下索引结构的建立进行了研究,提出了一种基于聚簇索引与分布式B 树的混合索引结构.该结构对数据集的输入,存储及查询等操作进行了定义,并分析了索引服务器与客户端的通信模型建立.由于对记录的主关键字与其他属性进行了不同处理,在各种记录检索情况下具有良好的性能.

Research on Distributed Index Mechanism for Large Dataset

In this paper we focus on index structure of distributed storage system for large-scale structured/semi-structured dataset. We propose a hybrid index structure based on clustering index and B tree, which defines the input, storage and query operation on the dataset, and analyze the communication model between index server and client. Because of different handling policy on record's primary keyword and other attributes, our architecture obtains good performance under different retrieval conditions.