Probabilistic learning on manifolds (PLoM) with partition

The probabilistic learning on manifolds (PLoM) introduced in 2016 has solved difficult supervised problems for the “small data” limit where the number N of points in the training set is small. Many extensions have since been proposed, making it possible to deal with increasingly complex cases. However, the performance limit has been observed and explained for applications for which N is very small and for which the dimension of the diffusion-map basis is close to N. For these cases, we propose a novel extension based on the introduction of a partition in independent random vectors. We take advantage of this development to present improvements of the PLoM such as a simplified algorithm for constructing the diffusion-map basis and a new mathematical result for quantifying the concentration of the probability measure in terms of a probability upper bound. The analysis of the efficiency of this extension is presented through two applications.     

机器翻译译文质量估计综述

机器翻译译文质量估计(Quality Estimation,QE)是指在不需要人工参考译文的条件下,估计机器翻译系统产生的译文的质量,对机器翻译研究和应用具有很重要的价值。机器翻译译文质量估计经过最近几年的发展,取得了丰富的研究成果。该文首先介绍了机器翻译译文质量估计的背景与意义;然后详细介绍了句子级QE、单词级QE、文档级QE的具体任务目标、评价指标等内容,进一步概括了QE方法发展的三个阶段: 基于特征工程和机器学习的QE方法阶段,基于深度学习的QE方法阶段,融入预训练模型的QE方法阶段,并介绍了每一阶段中的代表性研究工作;最后分析了目前的研究现状及不足,并对未来QE方法的研究及发展方向进行了展望。     

快速近似计算Shapley值的归因解释方法

Shapley值归因解释方法虽然能更准确量化解释结果, 但过高的计算复杂度严重影响了该方法的实用性. 本文引入KD树重新整理待解释模型的预测数据, 通过在KD树上插入虚节点, 使之满足TreeSHAP算法的使用条件, 在此基础上提出了KDSHAP方法. 该方法解除了TreeSHAP算法仅能解释树结构模型的限制, 将该算法计算Shapley值的高效性放宽到对所有的黑盒模型的解释中, 同时保证了计算准确度. 通过实验对比分析, KDSHAP方法的可靠性, 以及在解释高维输入模型时的适用性.     

Automated prediction system of household energy consumption in cities using web crawler and optimized artificial intelligence

The supply of electrical energy is critical to convenient and comfortable living. However, people consume a large amount of energy, contributing to an energy crisis and global warming, and damaging some ecological cycles. Residential electricity consumption has greater elasticity than industrial and business consumption; it therefore has high energy-saving potential. This work establishes an automated platform, which provides information about residential electricity consumption in each city in Taiwan. Machine learning was used to forecast future residential electricity demand. A nature-inspired optimization method was applied to enhance the accuracy of the best machine learner, yielding an even better hybrid ensemble model. Performance measures indicate that the resulting model is accurate and provides effective information for reference. An automatic web-based system based on the model was combined with a web crawler and scheduled to run automatically to provide information on monthly residential electricity consumption in each county and city. By providing energy consumption information across the country, power providers and government can discuss policy and set different goals for energy use. The results of this study can facilitate the early implementation of energy-saving and carbon emission-reducing in cities and aid utility companies in establishing energy conservation guidelines.     

Prediction of fish quality level with machine learning

In this study, sea bream, sea bass, anchovy and trout were captured and recorded using a digital camera during refrigerated storage for 7 days. In addition, their total viable counts (TVC) were determined on a daily basis. Based on the TVC, each fish was classified as ‘fresh’ when it was <5 log cfu per g, and as ‘not fresh’ when it was >7 log cfu per g. They were uploaded on a web-based machine learning software called Teachable Machine (TM), which was trained about the pupils and heads of the fish. In addition, images of each species from different angles were uploaded to the software in order to ensure the recognition of fish species by TM. The data of the study indicated that the TM was able to distinguish fish species with high accuracy rates and achieved over 86% success in estimating the freshness of the fish species tested.     

面向小语种机器翻译的平行语料库构建方法

神经机器翻译模型的训练效果在很大程度上取决于平行语料库的规模和质量。除了一些常见语言外,汉语与小语种间高质量平行语料库的建设一直处于滞后状态。现有小语种平行语料库多采用自动句子对齐技术利用网络资源构建而成,在文本质量和领域等方面有诸多局限性。采用人工翻译的方式可以构建高质量平行语料库,但是缺乏相关经验和方法。文中从机器翻译实践者和研究者角度出发,介绍了经济高效的人工构建小语种平行语料库的工作,包括其总体目标、实施过程、流程细节和最后结果。在构建过程中尝试并积累了各种经验,形成了小语种到汉语平行语料库构建方法、建议的总结。最终,成功构建了波斯语到汉语、印地语到汉语、印度尼西亚语到汉语各50万条高质量平行语料。实验结果表明,所构建的平行语料库有较好的质量,提高了小语种神经机器翻译模型的训练效果。     

火花放电原子发射光谱类型标准化校正方式的探讨

在国内,火花放电原子发射光谱分析广泛使用类型标准化进行方法校正。在国外,标准和文献中鲜见使用此方法的相关论述。类型标准化主要采用平移校正和转动校正两种方式,哪种方式更加合理也鲜见报道。国外设备类型标准化的默认设置优先采用转动校正方式,相关国内标准对最优校正方式的规定尚不明确,此默认设置的合理性有待探讨。实验选用低合金钢20CrNi2Mo、R407标准样品和不锈钢317L、0Cr18Ni9标准样品,引用国内相关标准,以正确度临界差为评判依据,模拟类型标准化样品和待测样品“十分接近”和“接近”两种情况下平移校正和转动校正的数据正确度。经数据统计分析,平移校正分析结果均满足要求,转动校正结果在“接近”情况下部分元素不满足要求。结合相关国家标准中元素含量范围和精密度数据进行分析,通过计算允许最大偏倚量并制作曲线图方式展开分析,得出如下结论:在满足文中类型标准化控制要点前提下,分析设置更适合于采用平移校正方式。     

智能数据分区与布局研究

大数据时代,数据规模庞大,由数据进行驱动的应用分析场景日益增多.如何快速、高效地从这些海量数据中提取出用以分析决策的信息,给数据库系统带来重大挑战.同时,现代商业分析决策对分析数据的实时性要求数据库系统能够同时快速处理ACID事务和复杂的分析查询.然而,传统的数据分区粒度太粗,且不能适应动态变化的复杂分析负载;传统的数据布局单一,不能应对现代大量增加的混合事务分析应用场景.为了解决以上问题,“智能数据分区与布局”成为当前的研究热点之一,它通过数据挖掘、机器学习等技术抽取工作负载的有效特征,设计最佳的分区策略来避免扫描大量不相关的数据,指导布局结构设计以适应不同类型的工作负载.首先介绍了智能数据分区与布局的相关背景知识,然后对智能数据分区与布局技术的研究动机、发展趋势、关键技术进行详细的阐述.最后,对智能数据分区与布局技术的研究前景做出总结与展望.     

Weighted regularized extreme learning machine to model the discharge coefficient of side slots

In the current research, a modern learning machine algorithm named “Weighted Regularized Extreme Learning Machine (WRELM)" is implemented for the first time for the simulation of the coefficient of discharge of side slots. For this purpose, an effective variable on the coefficient of discharge of side slots is firstly introduced, then five distinctive WRELM models are produced by it for the estimation of the coefficient. In the next stage, a database is created for verification of WRELM results. it should be mentioned that 70% of the data are utilized for training the WRELM models, while the rest (i.e. 30%) for testing them. After that, the optimal number of hidden layer neurons as well as the best activation function of the WRELM algorithm are chosen. In addition, the best regularization parameter and also the weight function of the WRELM are achieved. By conducting a sensitivity analysis, the most effective variable for the simulation of the coefficient of discharge along with the WRELM superior model is introduced. The WRELM superior model estimates values of the coefficient of discharge with the maximum exactness and the highest correlation. For instance, the estimations of the correlation coefficient and scatter index for this model are computed to be 0.930 and 0.051, respectively. The sensitivity analysis shows that the ratio of the side slot crest height to its length and the Froude number should be considered as the most important input variables. A comparison between the WRELM with the ELM displays that the former works much better. Furthermore, an uncertainty analysis is executed for both models. Eventually, an equation is suggested for the estimation of the coefficient of discharge and a partial derivative sensitivity analysis is performed on it.