数据挖掘方法与可视化

迄今为止,数据挖掘与知识发现软件的功能不再停留在“挖掘”这个单一功能的实现,而已延伸到数据挖掘与知识发现的过程．即包括数据的预处理、数据挖掘、模型评估与可视化;在单纯的模型可视化基础上扩充了数据可视化与数据挖掘过程可视化：本文着重讨论了数据挖掘的方法与可视化技术,最后提出了未来的研究方向。     

数据挖掘在CRM中的应用

数据挖掘可以通过挖掘数据仓库中存储的大量数据,从中发现有意义的新的关联模式和趋势的过程。数据挖掘最吸引人的地方是它能建立预测模型而不是回顾型的模型。数据挖掘可以用来:发现知识、使数据可视化和纠正数据。     

数据可视化在数据挖掘中的应用

数据挖掘是从大量历史数据中抽取潜在的、有价值的知识或规则的过程。数据可视化对于快速分析数据，表示高维数据方面非常直观、有效。本文首先讨论了几种可视化技术，随后就数据可视化在数据挖掘的模型、过程中的应用进行探讨。     

可视化驱动的交互式数据挖掘方法综述

数据挖掘是一种从大量数据中发现信息的过程,其大量依赖自动算法的特质,使得用户难以对数据和算法过程本身直观地进行理解、探索和优化.近年来,随着可视化领域的蓬勃发展,有很多工作开始探究如何使用可视化方法辅助数据挖掘过程,使用户更加直观地理解数据,并对数据和算法和进行探索.文中首先对数据挖掘和可视化在知识提取流程进行比较分析,并从可视化增强的通用数据挖掘方法和面向应用场景的方法 2个方面对近年相关技术进行梳理总结,并依托一些相关主题的国际会议内容指出需要进一步探索的方向.     

电子商务数据挖掘可视化系统模型研究及应用

将数据挖掘与相关的数据可视化技术和联机分析处理技术集成,构造一个应用于电子商务Web环境中的以数据挖掘技术为基础的数据可视化分析系统模型——电子商务数据挖掘可视化模型(EDVM),并技术实现主要模块功能,使之能够进行挖掘结果的动态更新与可视化输出,并通过实验初步验证了EDVM模型的有效性。     

数据挖掘技术在入侵检测中的应用

提出一个基于数据挖掘的入侵检测模型框架。在模型中,数据挖掘贯穿于检测过程之中,通过数据采集、数据预处理、数据挖掘、知识发现等过程,使得入侵检测成为一个完整的知识发现过程。     

Web架构驱动的石油工业知识挖掘系统

石油工业大数据具有无限潜力与价值,将大数据与数据挖掘技术应用其中,不仅可以提升石油行业工业化水平,而且对石油行业智慧化发展起到强有力地推动作用.由此提出了一个Web架构驱动的、集成了数据挖掘五大模块的新型工业知识挖掘系统-即石油工业数据挖掘系统,包含：数据集管理、预处理算法管理、数据挖掘算法管理以及数据挖掘流程管理和数据结果可视化五大模块.本系统实现了完全自助式的数据提取、数据预处理、数据分析与知识挖掘和结果可视化展示的完整知识挖掘流程.通过以Web的形式满足油田不同层级的用户在不同场景下的即时使用需求,极大提高了系统的灵活性.通过本系统,油田的技术开发人员可忽略大数据的搭建以及其他复杂构建过程,更好的服务于油田数据建模和分析.     

基于数据抽取器的知识发现处理模型

提出了基于数据抽取器的知识发现模型。在模型中,将知识发现过程分成数据预处理、数据抽取、数据挖掘和结果分析四个阶段。该模型利用标准的SQL语言构造数据抽取器,为不同的学习算法准备数据,减少数据挖掘算法对数据库直接调用的次数,避免了直接对大型数据库的数据进行调用,使得对大型数据库进行快速数据挖掘成为可能。可以加快知识发现过程,提高数据挖掘效率,实现对于大型数据库的知识发现。最后设计了SQL-C4．5算法,该算法实现了利用数据抽取器为决策树算法C4．5抽取必要的统计数据,实现了C4．5决策树的构建。     

可视化数据挖掘方法与技术

可视化数据挖掘技术是可视化技术和数据挖掘技术的有机结合,是数据挖掘技术发展的必然,它涉及到计算机图形学、图像处理、计算机辅助设计、计算机视觉及人机交互技术等多个领域：数据挖掘的可视化已由单纯的模型可视化发展到数据可视化与数据挖掘过程和结果的可视化;本文着重讨论了可视化数据挖掘的分类和相关技术,最后提出了未来的研究方向。     

基于小波分析的时间序列数据挖掘模型

论文提出一个基于小波分析的时间序列挖掘模型TSMiner,它支持时间序列数据挖掘的整个过程。该模型由5部分组成:原始数据的可视化、数据预处理、数据约简,模式发现和结果模式可视化。该模型应用小波实现数据的多层次可视化表示、数据约简和多尺度模式发现。它可以帮助用户观察高维数据,理解中间结果和解释发现的模式。     

Information visualization and visual data mining

Never before in history has data been generated at such high volumes as it is today. Exploring and analyzing the vast volumes of data is becoming increasingly difficult. Information visualization and visual data mining can help to deal with the flood of information. The advantage of visual data exploration is that the user is directly involved in the data mining process. There are a large number of information visualization techniques which have been developed over the last decade to support the exploration of large data sets. In this paper, we propose a classification of information visualization and visual data mining techniques which is based on the data type to be visualized, the visualization technique, and the interaction and distortion technique. We exemplify the classification using a few examples, most of them referring to techniques and systems presented in this special section     

From visual data exploration to visual data mining: a survey

We survey work on the different uses of graphical mapping and interaction techniques for visual data mining of large data sets represented as table data. Basic terminology related to data mining, data sets, and visualization is introduced. Previous work on information visualization is reviewed in light of different categorizations of techniques and systems. The role of interaction techniques is discussed, in addition to work addressing the question of selecting and evaluating visualization techniques. We review some representative work on the use of information visualization techniques in the context of mining data. This includes both visual data exploration and visually expressing the outcome of specific mining algorithms. We also review recent innovative approaches that attempt to integrate visualization into the DM/KDD process, using it to enhance user interaction and comprehension.     

一个基于OLAM的可视化数据挖掘系统原型

基于OLAM的可视化数据挖掘系统将可视化工具和数据挖掘工具融为一体，它与一般的数据挖掘系统不同，充分利用了OLAM模型沿着多个维进行挖掘，并以智能的方式与用户进行交互，可以在多维数据库的不同部位和不同的抽象级别交互地执行挖掘，以图形的方式输出结果。     

Visual mining of time series using a tubular visualization

In this paper, we study the visual mining of time series, and we contribute to the study and evaluation of 3D tubular visualizations. We describe the state of the art in the visual mining of time-dependent data, and we concentrate on visualizations that use a tubular shape to represent data. After analyzing the motivations for studying such a representation, we present an extended tubular visualization. We propose new visual encodings of the time and data, new interactions for knowledge discovery, and the use of rearrangement clustering. We show how this visualization can be used in several real-world domains and that it can address large datasets. We present a comparative user study. We conclude with the advantages and the drawbacks of our method (especially the tubular shape).     

The shaping of information by visual metaphors

The nature of an information visualization can be considered to lie in the visual metaphors it uses to structure information. The process of understanding a visualization therefore involves an interaction between these external visual metaphors and the user's internal knowledge representations. To investigate this claim, we conducted an experiment to test the effects of visual metaphor and verbal metaphor on the understanding of tree visualizations. Participants answered simple data comprehension questions while viewing either a treemap or a node-link diagram. Questions were worded to reflect a verbal metaphor that was either compatible or incompatible with the visualization a participant was using. The results suggest that the visual metaphor indeed affects how a user derives information from a visualization. Additionally, we found that the degree to which a user is affected by the metaphor is strongly correlated with the user's ability to answer task questions correctly. These findings are a first step towards illuminating how visual metaphors shape user understanding, and have significant implications for the evaluation, application, and theory of visualization.     

基于用户模型匹配的水情信息可视化研究与实现

水利信息化平台发展迅速,但水情信息具有来源广泛、类型丰富的特点,用户难以在多而复杂的水情信息中快速找到自己想要的水情信息。通过水情信息可视化的方法,将水情数据转化为用户可以直观理解的视觉形式,定制个性化的地图、设计不同用户界面风格。为解决大量水情信息可视化产生的视觉混淆问题,采用基于用户模型匹配的推荐算法分别对水情站点进行推荐、实现水情信息的过滤,对推荐站点重点可视化。同时,为了增强个性化展示的效果,还采用基于概率的用户模型匹配算法为不同的用户匹配个性化水情信息可视化界面。     

基于平行坐标法的可视数据挖掘

数据挖掘和数据可视化技术的结合形成可视数据挖掘。通过可视化技术的运用,数据挖掘可以增加其数据的针对性和结果的可信度。平行坐标法是数据可视化的代表方法之一,该文在平行坐标法的基础上,探讨了在其中实现可视化数据挖掘的基本方法,是进一步开发可视数据挖掘系统的初步研究。     

VizAssist: an interactive user assistant for visual data mining

We study in this work how a user can be guided to find a relevant visualization in the context of visual data mining. We present a state of the art on the user assistance in visual and interactive methods. We propose a user assistant called VizAssist, which aims at improving the existing approaches along three directions: it uses simpler computational models of the visualizations and the visual perception guidelines, in order to facilitate the integration of new visualizations and the definition of a mapping heuristic. VizAssist allows the user to provide feedback in a visual and interactive way, with the aim of improving the data to visualization mapping. This step is performed with an interactive genetic algorithm. Finally, VizAssist aims at proposing a free on-line tool (www.vizassist.fr) that respects the privacy of the user data. This assistant can be viewed as a global interface between the user and some of the many visualizations that are implemented with D3js.     

Visual signatures in video visualization

Video visualization is a computation process that extracts meaningful information from original video data sets and conveys the extracted information to users in appropriate visual representations. This paper presents a broad treatment of the subject, following a typical research pipeline involving concept formulation, system development, a path-finding user study, and a field trial with real application data. In particular, we have conducted a fundamental study on the visualization of motion events in videos. We have, for the first time, deployed flow visualization techniques in video visualization. We have compared the effectiveness of different abstract visual representations of videos. We have conducted a user study to examine whether users are able to learn to recognize visual signatures of motions, and to assist in the evaluation of different visualization techniques. We have applied our understanding and the developed techniques to a set of application video clips. Our study has demonstrated that video visualization is both technically feasible and cost-effective. It has provided the first set of evidence confirming that ordinary users can be accustomed to the visual features depicted in video visualizations, and can learn to recognize visual signatures of a variety of motion events.     

Classifying high dimensional data by interactive visual analysis

Data mining techniques such as classification algorithms are applied to data which are usually high dimensional and very large. In order to assist the user to perform a classification task, visual techniques can be employed to represent high dimensional data in a more comprehensible 2D or 3D space. However, such representation of high dimensional data in the 2D or 3D space may unavoidably cause overlapping data and information loss. This issue can be addressed by interactive visualization. With expert domain knowledge, the user can build classifiers that are as competitive as automated ones using a 2D or 3D visual interface interactively. Several visual techniques have been proposed for classifying high dimensional data. However, the user׳s interaction with those techniques is highly dependent on the experience of the user in the visual identification of classifying data, and as a result, the classification results of those techniques may vary and may not be repeatable. To address this deficiency, this article presents an interactive visual approach to the classification of high dimensional data. Our approach employs the enhanced separation feature of a visual technique called HOV³ by which the user plots the training dataset by applying statistical measurements on a 2D space in order to separate data points into groups with the same class labels. A data group with its corresponding statistical measurement which separated it from the others is taken as a visual classifier. Then the user mixes the data points in a classifier with the unlabeled dataset and plots them in HOV³ by the measurement of the classifier. The data points which overlap the labeled ones in the 2D space are assigned the corresponding label. Our approach avoids the randomness in the existing interactive visual classification techniques, as the visual classifier in this approach only depends on the training dataset and its statistical measurement. As a result, this work provides an intuitive and effective approach to classify high dimensional data by interactive visualization.