首页 | 本学科首页   官方微博 | 高级检索  
     

基于Hadoop的大数据查询系统简述
引用本文:陈梦杰,陈勇旭,贾益斌,张一川,宋杰.基于Hadoop的大数据查询系统简述[J].计算机与数字工程,2013(12):1939-1942.
作者姓名:陈梦杰  陈勇旭  贾益斌  张一川  宋杰
作者单位:东北大学软件学院,沈阳110819
摘    要:近年来,随着计算机技术的迅猛发展,其领域迎来了大数据时代。随着大数据的出现,传统的关系型数据库已经不能满足高储存量的要求,此时成本低廉、有着良好并行性和伸缩性的云数据库应运而生,它采用键值对数据模型和分布式的计算环境。但是海量数据在Key-value数据库中的查询效率低下、实时性差等问题又普遍存在。为了解决查询效率低下这一问题,将多维数据模型和索引技术应用于Key-value数据库,将事实数据以多维的形式进行存储并在多维模型上建立索引以加快查询速度。论文将系统地描述多维数据模型的建立和索引技术的实现,最后简单地和主流Key-value数据库进行优缺点对比。

关 键 词:大数据  Key-value数据库  多维模型  Z-ordering  K—d  tree

A Brief Introduction Hadoop-based Big Data Query System
CHEN Mengjie,CHEN Yongxu,ZHANG Yichuan,SONG Jie.A Brief Introduction Hadoop-based Big Data Query System[J].Computer and Digital Engineering,2013(12):1939-1942.
Authors:CHEN Mengjie  CHEN Yongxu  ZHANG Yichuan  SONG Jie
Affiliation:(Software College, Northeastern University, Shenyang 110004)
Abstract:In recent years, with the rapid development of computer technology, its area ushers in the era of big data. With the emer- gence of big data, the traditional relational database connot meet the needs of high storage capacity when the low cost cloud database with good parallelism and scalability comes into being at the historic moment. It uses a Key-value data model and the distributed computing envi- ronment. But the problem that query of huge amounts of data in the Key-value database lacks efficiency and has bad real-time performance is universal. To solve low efficiency in query, this system applies multidimensional data model and the indexing technology to the Key-value da- tabase, storing fact data in forms of multidimensional data and indexing on the multidimensional model in order to speed up the query. The establishment of multidimensional data model and the implementation of indexing technology is systematically described. Finally the thesis briefly compares it to the mainstream Key-value database in terms of advantages and disadvantages.
Keywords:big data  Key-value database  multidimensional data model  Z-ordering  K-d tree
本文献已被 维普 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号