Python技术在数据可视化中的应用研究

在数据科学飞速发展的今天,传统数据分析已经不能满足大数据时代的需求。为了能够对数据进行更有效的分析,利用拥有强大绘图功能的Python语言处理数据可视化是十分必要的。本文利用Python包含的基本库进行实例数据可视化,对数据以柱状图、折线图、词云等形式插入呈现。同时对Python在数据可视化中的优势进行分析,展示利用Python进行数据可视化的优势。研究结果表明,利用Python将数据用图表及其他更直观的方式等能够帮助人们快速处理和理解数据。     

基于Python+ECharts的手机销售数据可视化系统

电商平台为人们带来极大便利的同时,其大量繁杂的电商数据也给人们购物带来了困扰。针对上述问题,设计开发了一个京东手机销售数据可视化系统,系统通过爬虫技术,对京东手机销售数据进行分类爬取,利用Python中的Pandas库对数据进行清洗和分析,将清洗完的数据迁移进MySQL中,利用Flask搭建销售数据可视化界面,通过Flask+ECharts的方式制作可视化大屏,将Flask的网站所有功能集结一起,系统让用户更加直观明确地查看数据分析结果,帮助消费者更好地了解个人需求;帮助销售公司更直观地了解市场需求,进而推动产品销量。系统通过对用户产生的大量购物数据进行数据分析和挖掘,为公司发展及市场竞争提供更多有价值的策略支持。     

基于大数据技术的房价数据采集及可视化分析应用

在"房住不炒"定位下,住房选购成了广大市民比较关心的问题.把大数据分析技术引入到房价分析,利用Scrapy爬虫框架对广州房价线上数据的爬取,经清洗和可视化,把影响房价的要素以可视化的形式予以呈现.与传统方法相比,大数据分析技术在数据采集及可视化分析应用方面优势明显.     

浅谈数据挖掘技术在机组能效分析中的应用

数据挖掘技术是一门跨学科的综合研究领域,集计算机机器学习、统计学、数据库管理、数据仓库、可视化、并行计算、决策支持为一体,利用数据库、数据仓库技术存储和管理数据,利用机器学习和统计方法分析数据。在当前社会节能减排的大环境下,电力从业者利用数据挖掘技术对机组发电过程中所产生的各种数据进行深入的分析和研究,并以此来采取相关措施,可以更有效利用现有电力资源,优化整合大型发电设备,不断提高发电的可靠性和经济性。本文将对数据挖掘技术在机组能效分析中的具体应用加以归纳和总结。     

基于径向坐标可视化的高维数据分析方法

针对模式分类算法不直观的问题,提出一种基于径向坐标可视化分析高维数据的方法。由最大似然原理估计高维数据的本征维数,用较少的变量结合径向坐标可视化方法对高维数据进行可视化降维分析。在径向坐标中揭示高维数据集中类别和特征间的关系,寻找基于不同特征排列顺序的最优映射,并结合多种机器学习方法对数据集进行分类。应用于UCI数据库中的6个数据集的结果表明,该方法具有较好的可视化和分类效果。     

房产数据的Web抓取、地理空间化及可视化

提出了在地理空间系统Web开放平台的基础上,利用抓取互联网房产数据,抓取集成在线地理信息数据查询服务,实现了一种对在线房产数据获取、空间化及其可视化的方法.该方法主要通过地理热力图可视化和柱状图表可视化房产数据.地理热力图直观地将房产价格数据分布情况通过不同颜色地理区块呈现,给在城市区域内购房者提供了有力的与空间位置集成的房价参考依据.利用地理空间化方法表达房产数据,能够提高用户获取数据中有用和关键信息的效率.该方法也是利用地理空间数据分析和开发工具挖掘隐含信息的地理空间处理过程.实现了房产数据的抓取、空间化及可视化整个功能,并采用实际的在线房产数据对功能进行了检验,最终结果验证了房产数据抓取、空间化及可视化的可用性与有效性,同时也对可视化所得的结果进行了简单的分析和分类.     

利用自组织特征映射神经网络进行可视化聚类

自组织特征映射作为一种神经网络方法,在数据挖掘、机器学习和模式分类中得到了广泛的应用。它将高维输人空间的数据映射到一个低维、规则的栅格上,从而可以利用可视化技术探测数据的固有特性。该文说明了自组织特征映射神经网络的工作原理和具体实现算法,同时利用一个算例展示了利用自组织特征映射进行聚类时的可视化特性,包括聚类过程的可视化和聚类结果的可视化,这也是自组织特征映射得到广泛应用的原因之一。     

南海舰船数据可视化分析系统设计与实现

为了更好地对南海舰船数据进行展现和分析,基于百度地图API,以南海舰船数据为基础数据,采用B/S架构,结合数据可视化图表库Echarts、百度地图大数据可视化库、百度地图热力图库,采用数据库等技术对舰船数据进行管理,在时间和空间上对舰船数据进行可视化和分析。设计并实现具有舰船位置和轨迹可视化、舰船统计分析、舰船轨迹查询、舰船热力图为核心功能的Web应用。该系统能够更加直观高效地对舰船数据进行管理分析,对航道安全的提升具有分析参考作用。     

基于Spark的流程化机器学习分析方法

Spark通过使用内存分布数据集,更加适合负载数据挖掘与机器学习等需要大量迭代的工作.但是数据分析师直接使用Spark进行开发十分复杂,包括scala学习门槛高,代码优化与系统部署需要丰富的经验,同时代码的复用度低导致重复工作繁多.本文设计并实现了一种基于Spark的可视化流程式机器学习的方法,一方面设计组件模型来刻画机器学习的基本步骤,包括数据预处理、特征处理、模型训练及验证评估,另一方面提供可视化的流程建模工具,支持分析者设计机器学习流程,由工具自动翻译为Spark平台代码高效执行.本工具可以极大的提高Spark平台机器学习应用开发的效率.论文介绍了工具的方法理论和关键技术,并通过案例表明工具的有效性.     

面向统计数据的三位一体可视化关联分析

根据社会经济统计数据的特点,借鉴地理信息系统的空间表达方法,利用Flash技术提出属性、图形和图表三位一体可视化关联分析系统。设计行政区空间图形库和社会经济数据库,以组件方式构建图表对组件库和模型库进行分析,实现系统在线即时可视化表达与分析功能。应用结果表明,该系统能提高对社会经济等相关数据的分析效率。     

Only connect: teaching, technology and telesis

Abstract This paper describes an approach to the design of interactive multimedia materials being developed in a European Community project. The developmental process is seen as a dialogue between technologists and teachers. This dialogue is often problematic because of the differences in training, experience and culture between them. Conditions needed for fruitful dialogue are described and the generic model for learning design used in the project is explained.     

European Community policy and the market

Abstract This paper starts with some reflections on the policy considerations and priorities which are shaping European Commission (EC) research programmes. Then it attempts to position the current projects which seek to capitalise on information and communications technologies for learning in relation to these priorities and the apparent realities of the marketplace. It concludes that while there are grounds to be optimistic about the contribution EC programmes can make to the efficiency and standard of education and training, they are still too technology driven.     

一种自适应子融合集成多分类器方法

融合集成方法已经广泛应用在模式识别领域,然而一些基分类器实时性能稳定性较差,导致多分类器融合性能差,针对上述问题本文提出了一种新的基于多分类器的子融合集成分类器系统。该方法考虑在度量层融合层次之上通过对各类基多分类器进行动态选择,票数最多的类别作为融合系统中对特征向量识别的类别,构成一种新的自适应子融合集成分类器方法。实验表明,该方法比传统的分类器以及分类融合方法识别准确率明显更高,具有更好的鲁棒性。     

Avoiding semantic and temporal gaps in developing software intensive systems

Development of software intensive systems (systems) in practice involves a series of self-contained phases for the lifecycle of a system. Semantic and temporal gaps, which occur among phases and among developer disciplines within and across phases, hinder the ongoing development of a system because of the interdependencies among phases and among disciplines. Such gaps are magnified among systems that are developed at different times by different development teams, which may limit reuse of artifacts of systems development and interoperability among the systems. This article discusses such gaps and a systems development process for avoiding them.     

Designing economic np control charts: A programmed simulation approach

This paper presents control charts models and the necessary simulation software for the location of economic values of the control parameters. The simulation program is written in FORTRAN, requires only 10K of main storage, and can run on most mini and micro computers. Two models are presented - one describes the process when it is operating at full capacity and the other when the process is operating under capacity. The models allow the product quality to deteriorate to a further level before an existing out-of-control state is detected, and they can also be used in situations where no prior knowledge exists of the out-of-control causes and the resulting proportion defectives.     

The development of robot art

Going through a few examples of robot artists who are recognized worldwide, we try to analyze the deepest meaning of what is called “robot art” and the related art field definition. We also try to highlight its well-marked borders, such as kinetic sculptures, kinetic art, cyber art, and cyberpunk. A brief excursion into the importance of the context, the message, and its semiotics is also provided, case by case, together with a few hints on the history of this discipline in the light of an artistic perspective. Therefore, the aim of this article is to try to summarize the main characteristics that might classify robot art as a unique and innovative discipline, and to track down some of the principles by which a robotic artifact can or cannot be considered an art piece in terms of social, cultural, and strictly artistic interest. This work was presented in part at the 13th International Symposium on Artificial Life and Robotics, Oita, Japan, January 31–February 2, 2008     

Explanation and prediction: an architecture for default and abductive reasoning

Although there are many arguments that logic is an appropriate tool for artificial intelligence, there has been a perceived problem with the monotonicity of classical logic. This paper elaborates on the idea that reasoning should be viewed as theory formation where logic tells us the consequences of our assumptions. The two activities of predicting what is expected to be true and explaining observations are considered in a simple theory formation framework. Properties of each activity are discussed, along with a number of proposals as to what should be predicted or accepted as reasonable explanations. An architecture is proposed to combine explanation and prediction into one coherent framework. Algorithms used to implement the system as well as examples from a running implementation are given.     

Three Process Perspectives: Organizations, Teams, and People

This paper provides the author's personal views and perspectives on software process improvement. Starting with his first work on technology assessment in IBM over 20 years ago, Watts Humphrey describes the process improvement work he has been directly involved in. This includes the development of the early process assessment methods, the original design of the CMM, and the introduction of the Personal Software Process (PSP)^SM and Team Software Process (TSP){^SM}. In addition to describing the original motivation for this work, the author also reviews many of the problems he and his associates encountered and why they solved them the way they did. He also comments on the outstanding issues and likely directions for future work. Finally, this work has built on the experiences and contributions of many people. Mr. Humphrey only describes work that he was personally involved in and he names many of the key contributors. However, so many people have been involved in this work that a full list of the important participants would be impractical.     

基于复小波噪声方差显著修正的SAR图像去噪

提出了一种基于复小波域统计建模与噪声方差估计显著性修正相结合的合成孔径雷达(Synthetic Aperture Radar,SAR)图像斑点噪声滤波方法。该方法首先通过对数变换将乘性噪声模型转化为加性噪声模型,然后对变换后的图像进行双树复小波变换(Dualtree Complex Wavelet Transform,DCWT),并对复数小波系数的统计分布进行建模。在此先验分布的基础上,通过运用贝叶斯估计方法从含噪系数中恢复原始系数,达到滤除噪声的目的。实验结果表明该方法在去除噪声的同时保留了图像的细节信息,取得了很好的降噪效果。     

基于QTE的蒙古文显示机制研究与实现

蒙古语言是中国蒙古族使用的通用语言,由于蒙古文区别于其他文字的书写方式和其自身变形机制等特点,在很多通用的文字处理引擎中都不被支持。在嵌入式产品开发与应用领域中Linux加QTE已经成为流行方式。该文给出了一种在QTE环境上实现基于标准Unicode的蒙古文点阵显示和变形算法, 并自定义了支持蒙古文的QTE组件,扩展了QTE功能,为在Linux加QTE方式的嵌入式体系结构中处理蒙古文提供了一种解决方法。