基于供应链数据仓库的OLAP数据挖掘

在供应链数据仓库的基础之上开发OLAP数据挖掘系统,可以使供应链数据仓库更好地适应物流企业决策的需求。OLAP系统不仅具有极高的灵活性,而且能够协助用户发现期望获取的知识和部分未知的有用信息。本文将介绍基于供应链数据仓库的OLAP数据挖掘应用技术,并讨论OLAP数据挖掘系统的工作模式。     

基于供应链数据仓库的OLAP数据挖掘

现代企业的竞争已经转变为供应链之间的竞争, 供应链管理是经济全球化发展的产物.在供应链系统的数据库或数据仓库之中存储了大量的数据,如果在供应链数据仓库的基础之上开发OLAP数据挖掘系统,可以使供应链数据仓库更好地适应物流企业决策的需求.文中介绍了基于供应链数据仓库的OLAP数据挖掘应用技术,最后给出了应用实例,并讨论供应链数据仓库的OLAP数据挖掘系统的工作模式及其今后的研究方向.     

基于供应链数据仓库的OLAP数据挖掘

现代企业的竞争已经转变为供应链之间的竞争，供应链管理是经济全球化发展的产物。在供应链系统的数据库或数据仓库之中存储了大量的数据，如果在供应链数据仓库的基础之上开发OLAP数据挖掘系统，可以使供应链数据仓库更好地适应物流企业决策的需求。文中介绍了基于供应链数据仓库的OLAP数据挖掘应用技术，最后给出了应用实例，并讨论供应链数据仓库的OLPA数据挖掘系统的工作模式及其今后的研究方向。     

OLAP技术在油田开发中的研究与应用

基于数据仓库的OLAP数据分析技术可以辅助油田决策的需要,给出了OLAP分析模型的形式定义和OLAP分析模型上的多维操作,讨论了OLAP分析模型设计思想,设计了油田开发数据的OLAP分析模型,并给出了油田开发数据的OLAP分析结果。实践表明,OLAP技术较好地满足了油田生产开发的决策需要。     

数据仓库的OLAP技术研究

本文主要介绍数据仓库基本理论以及其应用之一的OLAP技术,OLAP技术是数据仓库的主要应用技术之一,OLAP能够提供很好的决策支持,并能进行数据的多维分析。     

基于OLAP的矿井局部通风系统故障数据仓库的建立

文章介绍了一种基于OLAP的矿井局部通风系统的故障数据仓库的设计,阐述了数据仓库的总体结构、数据模型的建立、数据仓库的实现以及数据仓库的功能。该数据仓库的建立可有效地预防通风故障,并提供有效的决策辅助。     

数据仓库的OLAP技术研究

本文主要介绍数据仓库基本理论以及其应用之一的OLAP技术，OLAP技术是数据仓库的主要应用技术之一，OLAP能够提供很好的决策支持，并能进行数据的多维分析。     

基于数据仓库和OLAP技术的证券交易系统的实现方案研究

数据仓库和联机分析处理(OLAP)技术是信息技术领域的新兴技术,而如何应用到证券交易中是证券业面临的问题。建立证券交易数据仓库并使用OLAP技术,可以将大量源数据有效地转化为有用的知识信息,并服务于决策过程。基于数据仓库的证券交易系统就是在面向信息处理的联机事务处理(OLTP)系统的基础上并引入数据仓库和OLAP技术而发展起来的。论文结合证券交易业务提出了系统实现的解决方案,并给出了基于证券交易业务的数据仓库的体系结构、逻辑模型、粒度模型,以及基于证券交易业务的联机分析处理(OLAP)系统的实现方法。     

基于数据仓库的OLAP技术的研究

随着数据处理技术在企业的成功应用,企业积累了大量的生产、科研和业务数据,为了解决企业决策人员面对浩瀚如烟的数据却很难及时获得决策支持信息的问题,许多企业已构建了数据仓库,并且通过使用联机分析处理OLAP技术可以使决策人员从数据仓库中获取有用信息。本文介绍了数据仓库技术和OLAP的基本概念,分析阐述了基于数据仓库的OLAP的三种存储机制,及联机分析处理OLAP在数据仓库应用中的作用。重点研究了基于关系型数据库的ROLAP(RelationalOLAP)技术,主要介绍了ROLAP的特点,ROLAP的两种模型:雪花模型与星型模型,以及OLAP的多维分析技术。     

基于数据仓库的OLAP技术的研究

随着数据处理技术在企业的成功应用，企业积累了大量的生产、科研和业务数据．为了解决企业决策人员面对浩瀚如烟的数据却很难及时获得决策支持信息的问题，许多企业已构建了数据仓库．并且通过使用联机分析处理OLAP技术可以使决策人员从数据仓库中获取有用信息本文介绍了数据仓库技术和OLAP的基本概念．分析阐述了基于数据仓库的OLAP的三种存储机制，及联机分析处理OLAP在数据仓库应用中的作用。重点研究了基于关系型数据库的ROLAP(Relational OLAP)技术，主要介绍了ROLAP的特点，ROLAP的两种模型。雪花模型与星型模型．以及OLAP的多维分析技术。     

电信网络管理的数据仓库解决方案

数据仓库技术是近几年迅速发展起来的一种技术,国际上许多电信运营企业都积极关注于数据仓库技术在电信运营部门和网络操作上的应用。本文对数据仓库技术在电信管理网(TMN)中的应用作了一些探讨,并提出了一种具体的应用方案。     

基于数据仓库技术的银行个人征信系统研究和设计

数据仓库和OLAP是决策支持系统的重要组成部分,它们能够帮助决策者有效的分析和理解问题.本文通过对数据仓库和OLAP概念及体系结构的分析,结合具体的需求,给出了银行个人征信系统的结构设计和实现过程,并对设计过程中用到的技术特点进行分析.     

Extending OCL for OLAP querying on conceptual multidimensional models of data warehouses

The development of data warehouses begins with the definition of multidimensional models at the conceptual level in order to structure data, which will facilitate decision makers with an easier data analysis. Current proposals for conceptual multidimensional modelling focus on the design of static data warehouse structures, but few approaches model the queries which the data warehouse should support by means of OLAP (on-line analytical processing) tools. OLAP queries are, therefore, only defined once the rest of the data warehouse has been implemented, which prevents designers from verifying from the very beginning of the development whether the decision maker will be able to obtain the required information from the data warehouse. This article presents a solution to this drawback consisting of an extension to the object constraint language (OCL), which has been developed to include a set of predefined OLAP operators. These operators can be used to define platform-independent OLAP queries as a part of the specification of the data warehouse conceptual multidimensional model. Furthermore, OLAP tools require the implementation of queries to assure performance optimisations based on pre-aggregation. It is interesting to note that the OLAP queries defined by our approach can be automatically implemented in the rest of the data warehouse, in a coherent and integrated manner. This implementation is supported by a code-generation architecture aligned with model-driven technologies, in particular the MDA (model-driven architecture) proposal. Finally, our proposal has been validated by means of a set of sample data sets from a well-known case study.     

Development of Secure XML Data Warehouses with QVT

ContextData warehouses are systems which integrate heterogeneous sources to support the decision making process. Data from the Web is becoming increasingly more important as sources for these systems, which has motivated the extensive use of XML to facilitate data and metadata interchange among heterogeneous data sources from the Web and the data warehouse. However, the business information that data warehouses manage is highly sensitive and must, therefore, be carefully protected. Security is thus a key issue in the design of data warehouses, regardless of the implementation technology. It is important to note that the idiosyncrasy of the unstructured and semi-structured data requires particular security rules that have been specifically tailored to these systems in order to permit their particularities to be captured correctly. Unfortunately, although security issues have been considered in the development of traditional data warehouses, current research lacks approaches with which to consider security when the target platform is based on XML technology.ObjectiveWe shall focus on defining transformations to obtain a secure XML Schema from the conceptual multidimensional model of a data warehouse.MethodWe have first defined the rationale behind the transformation rules and how they have been developed in natural language, and we have then established them clearly and formally by using the QVT language. Finally, in order to validate our proposal we have carried out a case study.ResultsWe have proposed an approach for the model driven development of Secure XML Data Warehouses, defining a set of QVT transformation rules.ConclusionThe main benefit of our proposal is that it is possible to model security requirements together with the conceptual model of the data warehouse during the early stages of a project, and automatically obtain the corresponding implementation for XML.     

Efficient query processing framework for big data warehouse: an almost join-free approach

The rapidly increasing scale of data warehouses is challenging today’s data analytical technologies. A conventional data analytical platform processes data warehouse queries using a star schema — it normalizes the data into a fact table and a number of dimension tables, and during query processing it selectively joins the tables according to users’ demands. This model is space economical. However, it faces two problems when applied to big data. First, join is an expensive operation, which prohibits a parallel database or a MapReduce-based system from achieving efficiency and scalability simultaneously. Second, join operations have to be executed repeatedly, while numerous join results can actually be reused by different queries. In this paper, we propose a new query processing framework for data warehouses. It pushes the join operations partially to the pre-processing phase and partially to the postprocessing phase, so that data warehouse queries can be transformed into massive parallelized filter-aggregation operations on the fact table. In contrast to the conventional query processing models, our approach is efficient, scalable and stable despite of the large number of tables involved in the join. It is especially suitable for a large-scale parallel data warehouse. Our empirical evaluation on Hadoop shows that our framework exhibits linear scalability and outperforms some existing approaches by an order of magnitude.     

Incremental maintenance of object-oriented data warehouses

Incremental maintenance of data warehouses has attracted a lot of research attention for the past few years. Nevertheless, most of the previous work is confined to the relational setting. Recently, object-oriented data warehouses have been regarded as a better means to integrate data from modern heterogeneous data sources. However, existing approaches to incremental maintenance of data warehouses do not directly apply to object-oriented data warehouses. In this paper, therefore, we propose an approach to incremental maintenance of object-oriented data warehouses. We focus on two primary issues specifically. First, we identify six categories of potential updates to an object-oriented view and propose an algorithm to find potential updates from the definition of the view. Second, we propose an incremental view maintenance algorithm for maintaining object-oriented data warehouses. We have implemented a prototype system for incremental maintenance of object-oriented data warehouses. Performance evaluation has been conducted, which indicates that our approach is correct and efficient.     

基于数据仓库技术的决策分析系统概念设计

以数据仓库技术为基础的决策分析是数据处理的发展方向,目前正得到很多行业的应用。为提高科学决策能力,增强在市场经营等方面的正确判断能力,需要充分利用已经积累的大量的业务数据,以数据仓库技术为基础,构建数据处理和决策分析平台,进一步开发数据中蕴涵的信息,形成决策需要的对策方案和应对市场的反应策略。本文从数据仓库技术及数据分析技术出发,概念性地构建了可应用的数据仓库和分析系统,为今后在相关领域应用奠定了基础。     

A UML profile for multidimensional modeling in data warehouses

The multidimensional (MD) modeling, which is the foundation of data warehouses (DWs), MD databases, and On-Line Analytical Processing (OLAP) applications, is based on several properties different from those in traditional database modeling. In the past few years, there have been some proposals, providing their own formal and graphical notations, for representing the main MD properties at the conceptual level. However, unfortunately none of them has been accepted as a standard for conceptual MD modeling.

In this paper, we present an extension of the Unified Modeling Language (UML) using a UML profile. This profile is defined by a set of stereotypes, constraints and tagged values to elegantly represent main MD properties at the conceptual level. We make use of the Object Constraint Language (OCL) to specify the constraints attached to the defined stereotypes, thereby avoiding an arbitrary use of these stereotypes. We have based our proposal in UML for two main reasons: (i) UML is a well known standard modeling language known by most database designers, thereby designers can avoid learning a new notation, and (ii) UML can be easily extended so that it can be tailored for a specific domain with concrete peculiarities such as the multidimensional modeling for data warehouses. Moreover, our proposal is Model Driven Architecture (MDA) compliant and we use the Query View Transformation (QVT) approach for an automatic generation of the implementation in a target platform. Throughout the paper, we will describe how to easily accomplish the MD modeling of DWs at the conceptual level. Finally, we show how to use our extension in Rational Rose for MD modeling.     

Converting XML DTDs to UML diagrams for conceptual data integration

Extensible Markup Language (XML) is fast becoming the new standard for data representation and exchange on the World Wide Web, e.g., in B2B e-commerce. Modern enterprises need to combine data from many sources in order to answer important business questions, creating a need for integration of web-based XML data. Previous web-based data integration efforts have focused almost exclusively on the logical level of data models, creating a need for techniques that focus on the conceptual level in order to communicate the structure and properties of the available data to users at a higher level of abstraction. The most widely used conceptual model at the moment is the Unified Modeling Language (UML).

This paper presents algorithms for automatically constructing UML diagrams from XML DTDs, enabling fast and easy graphical browsing of XML data sources on the web. The algorithms capture important semantic properties of the XML data such as precise cardinalities and aggregation (containment) relationships between the data elements. As a motivating application, it is shown how the generated diagrams can be used for the conceptual design of data warehouses based on web data, and an integration architecture is presented. The choice of data warehouses and On-Line Analytical Processing as the motivating application is another distinguishing feature of the presented approach.     

OLAP与数据挖掘一体化模型的分析与讨论

OLAP(On-Line Analytical Processing)与数据挖掘工具由于内在技术以及适用范围的不同,在决策分析中必须协调使用才能发挥最佳的作用.本文提出基于影响域的OLAM(OLAP Mining)模型,将数据挖掘和OLAP技术结合在一个统一的框架之中,使得数据挖掘能够在数据库或数据仓库的不同部位、或在不同的抽象级别上进行,加强了决策分析的功能和灵活性.该模型有助于在大型数据库和数据仓库中交互式地挖掘多层次的知识.