云环境下基于数据流的k-means聚类算法

k-means算法是一种 最常用的基于划分的聚类算法。传统的集中式k-means算法已不能适应当前呈爆炸式增长的数据规模,设计分布式k-means算法成为了目前亟需解决的问题。现有分布式k-means算法基于MapReduce计算框架且没有考虑初始聚类中心的影响。由于每个MapReduce任务均需要读写分布式文件系统,导致MapReduce不能有效表达多个任务之间的依赖关系,因此提出了一种基于数据流的计算框架,该框架建立在MapReduce之上,将数据处理过程按照数据流图建模。在该框架的基础上,提出了一种高效的k-means算法,它采用基于多次采样的初始聚类中心选取方法来实现负载均衡及减少迭代次数。实验结果表明,该算法的可扩展性较好,且效率比现有算法高。     

基于双EnKF的土壤水分与土壤属性参数同时估计

为提高土壤水分数据同化结果的精度,将基于双集合卡尔曼滤波(Dual Ensemble Kalman Filter,DEnKF)的状态-参数估计方案与简单生物圈模型(simple biosphere model 2,SiB2)相结合,同时更新土壤水分和优化模型参数(土壤属性参数)。选用2008年6月1日~10月29日黑河上游阿柔冻融观测站为参考站,开展了同化表层土壤水分观测数据的实验。研究结果表明:DEnKF可同时优化土壤属性参数和改进土壤水分估计,该方法对表层土壤水分估计的精度0.04高于EnKF算法的精度0.05。当观测数据稀少时,DEnKF算法仍然可以得到较高精度的土壤水分估计,3层土壤水分的估计精度在0.02~0.05之间。     

遥感网格的数据压缩与任务分配方法研究

网格计算作为分布式计算在科学计算领域的发展方向,可以为对地观测数据的处理提供强大的计算力。在分析遥感信息服务网格节点(Remote Sensing Information Service Grid Nodes,RSSN)中网络数据传输和负载均衡两个关键问题的基础上,提出了一种有效的基于游程编码和Huffman编码的数据压缩方法和基于"计算端元"的任务分配策略,该方法针对遥感影像特点进行有效数据压缩,具有较好的压缩比,达到了17%,且能实现任务负载均衡。并在遥感信息服务网格节点计算平台上,以中国范围内1km分辨率气溶胶光学厚度(Aerosol Optical Depth,AOD)反演计算为例,从压缩率和计算时间效率方面验证和分析了上述方法的有效性。     

A dimension map for molecular aggregates

A pair of gyradius ratios, defined from the principal radii of gyration, are used to generate a dimension map that describes the geometry of molecular aggregates in water and in organic solvents. Molecular dynamics simulations were performed on the aggregation of representative biomolecules and polyaromatic compounds to demonstrate application of the dimension map. It was shown that molecular aggregate data on the dimension map were bounded by two boundary curves, and that the map could be separated into three regions representing three groups of structures: one-dimensional rod-like structures; two-dimensional planar structures or short-cylinder-like structures; and three-dimensional sphere-like structures. Examining the location of the aggregates on the dimension map and how the location changes with solvent type and solute material parameter provides a simple yet effective way to infer the aggregation manner and to study solubility and mechanism of aggregation.     

Fuzzy utility mining with upper-bound measure

Fuzzy utility mining has been an emerging research issue because of its simplicity and comprehensibility. Different from traditional fuzzy data mining, fuzzy utility mining considers not only quantities of items in transactions but also their profits for deriving high fuzzy utility itemsets. In this paper, we introduce a new fuzzy utility measure with the fuzzy minimum operator to evaluate the fuzzy utilities of itemsets. Besides, an effective fuzzy utility upper-bound model based on the proposed measure is designed to provide the downward-closure property in fuzzy sets, thus reducing the search space of finding high fuzzy utility itemsets. A two-phase fuzzy utility mining algorithm, named TPFU, is also proposed and described for solving the problem of fuzzy utility mining. At last, the experimental results on both synthetic and real datasets show that the proposed algorithm has good performance.     

大数据时代对高校人才培养模式的影响——以信息系统专业为例

大数据具有数据量巨大、数据形式多样化等特点,大数据时代为教育和学习提供了丰富的信息资源,但也给教育模式和人才培养带来挑战。首先具体说明大数据时代的特点及对高校人才培养的影响,分析大数据时代对信息系统及相应人才的要求,结合教学实践研究大数据背景下信息系统专业的人才培养模式。     

Data Center as a Key Player of a District Electric Power and Heat Network System： A Comparison in Urban and Suburb Regions

A DC （data center） demands air-conditioning power as large as the 1/3-1/2 of total electricity consumption. Thus, energy saving of cooling power of DC yields considerable effect on both economic and environmental views. PV （Photovoltaic） and absorption refrigerator with CGS （cogeneration systems） or gas boiler are possible power saving options. The waste warm air from DC would be utilized for greenhouse heating when DC and greenhouse locate near in the suburbs. In this study, the authors develop an energy network model to assess the potential contribution of DC as a major electric power and chilled air consumer as well as the warm air supplier in a district to the energy efficiency improvement. The evaporation heat of LNG （liquefied natural gas） utilization is also considered as well as PV, CGS. This model is applied to the cases of the urban area in Tokyo which involves athletic center, shops and hospital and the suburbs including greenhouse and then compared.