用搜索管理海量数据

“上次出去玩的照片放到哪里去了,怎么找不到呢？”如今硬盘大了,文件一多就像迷宫,完全记不起来要找的文件放在哪里,即使想要重新整理,也是有心无力,因为文件分散在不同的文件夹,到底藏在哪儿？自己也不知道。     

数据分片技术在数据访问控制中的应用

文章指分析了基于角色的访问控制方法的局限性,简单介绍了基于角色的数据访问控制模型、数据分片技术的类型和原则。在．此基础上提出了将数据分片技术与角色权限控制相结合的访问控制思想,并应用于教务管理系统中。     

基于人工智能技术的海量数据自动检索系统设计

常规的海量数据自动检索系统功能模块多设定为独立结构,自动检索的覆盖范围较小,导致最终得出的自动检索的F1值小于0.5。针对此问题,设计基于人工智能技术的海量数据自动检索系统。根据当前系统构建需求,构建现场可编程逻辑门阵列（Field Programmable Gate Array,FPGA）数据采集模块,接入Spartan-6 FPGA逻辑主控装置,完成系统硬件设计;采用多层级的方式,扩大自动检索的覆盖范围,设计多层级人工智能快速分级索引功能模块,并关联人工智能分类数据库,完成系统软件设计。测试结果表明,在3个测试阶段内,针对选定的5个测试周期,该系统最终得出的自动检索的F1值均可超过0.5。     

海量图像数据快速显示技术

在图像处理领域，由于图像数据的数据量在不断地增大，计算机硬件环境的发展已经不能满足图像处理的需要。为了海量图像数据快速处理和显示的需要，提出了利用数据分块、建立影像金字塔、采用高速缓存等技术，提高海量图像数据的显示速度。     

经济、安全的海量数据生命周期管理方案

介绍了一种海量数据生命周期管理的解决方案.该方案采用三级存储架构,以数据库与文件相结合的方式存储数据.该方案自主管理数据备份、数据恢复、数据迁移、介质检查、介质修复等任务,并将生命周期管理的压力从服务器分解到工作站,使硬件配置更灵活.该方案节省了开发成本,提高了数据的安全性.该方案正应用于某军工项目,性能稳定运行良好.详细介绍了自主管理过程的设计与实现.     

海量数据处理中的网格技术应用

网格是继Internet和Web之后第三次信息技术革命,最终将改变分布式资源的共享和服务方式。该文主要讨论了海量数据的产生、存储、处理,以及其对数据网格技术的需求,分析了欧洲数据网格和LHC计算网格的功能,并探讨了网格技术研究的最新情况。     

一种有效的数据管理技术

本文在传统的数据库查询方法的基础上介绍了数据库的查询方法;借鉴Ｈａｓｈ 表和Ｈａｓｋ 树的一些基本思想,对数据查询的方法进行了改进;提出了对大数据量的数据库进行快速查询的一种方法。     

基于海量数据的集群服务管理模型

针对海量数据Web服务器并行方式下的数据表管理问题,引入集群服务管理模型(CSM)。对该模型从体系结构、管理流程进行详细的分析和论述,通过实际测试,与现有非集群模型的对比,得出此集群管理模型在解决了并行方式下的数据表管理问题的同时,没有增加系统开销和降低系统响应时间。     

基于LOD的海量地形数据并行渲染技术

随着地球空间信息技术的发展,建立具有海量空间数据的大规模虚拟地形场景越来越重要. 然而,面对海量的地形数据,如何简化地形,提升绘制与渲染效率,是地形渲染的关键. 本文对LOD地形渲染技术、大规模数据集的分析与处理、并行计算等相关技术进行了研究,提出了基于LOD的海量地形数据并行渲染技术. 该技术首先使用LOD四叉树简化地形,其次结合多核CPU并行计算的方法提升效率,最后结合大规模数据调度策略,实现了海量地形数据的并行渲染,并分析对比了非并行和并行情况下的实验结果. 本文所取得的理论与技术方面的成果可为大规模场景渲染提供新的技术思路.     

数据库加速引擎中数据垂直分片技术研究

探讨了企业级数据库加速引擎(EDAE)中数据分布器(DDT)的实现。DDT基于两种分片技术：Hash散列水平分片和垂直分片。提出了一种基于图形技术的垂直分片算法VFG，它能很好地适用于OLTP应用。最后在理论和实验上对引擎的分片方案进行了分析和研究。     

Using Wide Table to manage web data: a survey

With the development of World Wide Web (www), storage and utilization of web data has become a big challenge for data management research community. Web data are essentially heterogeneous data, and may change schema frequently, traditional relational data model is inappropriate for web data management. A new data model, called Wide Table (or WT for simplicity), was introduced for this task. There are several characteristics of the WT model. First, WT is usually highly sparsely populated so that most data can be fit into a line or record. Second, queries are composed on only a small subset of the attributes. Thus, existing query processing and optimization techniques for relational database with normalized tables will not work efficiently anymore. Furthermore, WT is usually of extremely large volume. It is thought that only large-scale distributed storage can accommodate themassive data set. In this paper, requirements and challenges to web data management are discussed. Existing techniques for WT, including logical presentation, physical storage, and query processing, are introduced and analyzed in detail.     

Using metrics to manage software projects

Five years ago, Bull's Enterprise Servers Operation in Phoenix, Arizona, used a software process that, although understandable, was unpredictable in terms of product quality and delivery schedule. The process generated products with unsatisfactory quality levels and required significant extra effort to avoid major schedule slips. All but the smallest software projects require metrics for effective project management. Hence, as part of a program designed to improve the quality, productivity, and predictability of software development projects, the Phoenix operation launched a series of improvements in 1989. One improvement based software project management on additional software measures. Another introduced an inspection program, since inspection data was essential to project management improvements. Project sizes varied from several thousand lines of code (KLOC) to more than 300 KLOC. The improvement projects enhanced quality and productivity. In essence, Bull now has a process that is repeatable and manageable, and that delivers higher quality products at lower cost. We describe the metrics we selected and implemented, illustrating with examples drawn from several development projects     

Using intelligent agents to manage fuzzy business processes

Businesses are undergoing a major paradigm shift, moving from traditional management into a world of agile organizations and processes. An agile corporation should be able to rapidly respond to market changes. For this reason, corporations have been seeking to develop numerous information technology (IT) systems to assist with the management of their business processes. Many of the coming new business processes may contain embedded intelligent agent-based systems. Agent technology looks set to radically alter not only the way in which computers are interacted, but also the way complex processes, e.g., product development, are conceptualized and built. The paper presents a fuzzy approach based on an intelligent agent framework to develop modular products. This approach aims to address the research issue: "How can modular design be carried out through intelligent agents to meet a customer's fuzzy requirements using modules that come from suppliers that are geographically separated and operate on differing computer platforms?" The proposed methodology is applied to a real-world case that involves module-based synthesis at one of largest distribution centers in the world     

使用IBM Rational Test RealTime进行嵌入式软件测试

介绍IBM Rational Test RealTime测试工具,并以单元测试为重点说明其在嵌入式软件测试中的应用。     

Informix向Oracle迁移的关键技术研究

Informix公司被收购后存在原有数据库升级维护困难的问题,为提高数据库性能与稳定性及满足公司信息系统集中的需要,提出一种从Informix向Oracle数据库迁移的方法,其包括数据迁移和程序转换,采用Oracle数据库迁移工具包、存储过程和嵌入式结构化查询语言编程技术。项目试运行结果表明,基于该方法迁移的应用系统运行稳定、处理高效,能满足业务管理人员需求。