Probabilistic learning on manifolds (PLoM) with partition

The probabilistic learning on manifolds (PLoM) introduced in 2016 has solved difficult supervised problems for the “small data” limit where the number N of points in the training set is small. Many extensions have since been proposed, making it possible to deal with increasingly complex cases. However, the performance limit has been observed and explained for applications for which N is very small and for which the dimension of the diffusion-map basis is close to N. For these cases, we propose a novel extension based on the introduction of a partition in independent random vectors. We take advantage of this development to present improvements of the PLoM such as a simplified algorithm for constructing the diffusion-map basis and a new mathematical result for quantifying the concentration of the probability measure in terms of a probability upper bound. The analysis of the efficiency of this extension is presented through two applications.     

机器翻译译文质量估计综述

机器翻译译文质量估计(Quality Estimation,QE)是指在不需要人工参考译文的条件下,估计机器翻译系统产生的译文的质量,对机器翻译研究和应用具有很重要的价值。机器翻译译文质量估计经过最近几年的发展,取得了丰富的研究成果。该文首先介绍了机器翻译译文质量估计的背景与意义;然后详细介绍了句子级QE、单词级QE、文档级QE的具体任务目标、评价指标等内容,进一步概括了QE方法发展的三个阶段: 基于特征工程和机器学习的QE方法阶段,基于深度学习的QE方法阶段,融入预训练模型的QE方法阶段,并介绍了每一阶段中的代表性研究工作;最后分析了目前的研究现状及不足,并对未来QE方法的研究及发展方向进行了展望。     

快速近似计算Shapley值的归因解释方法

Shapley值归因解释方法虽然能更准确量化解释结果, 但过高的计算复杂度严重影响了该方法的实用性. 本文引入KD树重新整理待解释模型的预测数据, 通过在KD树上插入虚节点, 使之满足TreeSHAP算法的使用条件, 在此基础上提出了KDSHAP方法. 该方法解除了TreeSHAP算法仅能解释树结构模型的限制, 将该算法计算Shapley值的高效性放宽到对所有的黑盒模型的解释中, 同时保证了计算准确度. 通过实验对比分析, KDSHAP方法的可靠性, 以及在解释高维输入模型时的适用性.     

Automated prediction system of household energy consumption in cities using web crawler and optimized artificial intelligence

The supply of electrical energy is critical to convenient and comfortable living. However, people consume a large amount of energy, contributing to an energy crisis and global warming, and damaging some ecological cycles. Residential electricity consumption has greater elasticity than industrial and business consumption; it therefore has high energy-saving potential. This work establishes an automated platform, which provides information about residential electricity consumption in each city in Taiwan. Machine learning was used to forecast future residential electricity demand. A nature-inspired optimization method was applied to enhance the accuracy of the best machine learner, yielding an even better hybrid ensemble model. Performance measures indicate that the resulting model is accurate and provides effective information for reference. An automatic web-based system based on the model was combined with a web crawler and scheduled to run automatically to provide information on monthly residential electricity consumption in each county and city. By providing energy consumption information across the country, power providers and government can discuss policy and set different goals for energy use. The results of this study can facilitate the early implementation of energy-saving and carbon emission-reducing in cities and aid utility companies in establishing energy conservation guidelines.     

Prediction of fish quality level with machine learning

In this study, sea bream, sea bass, anchovy and trout were captured and recorded using a digital camera during refrigerated storage for 7 days. In addition, their total viable counts (TVC) were determined on a daily basis. Based on the TVC, each fish was classified as ‘fresh’ when it was <5 log cfu per g, and as ‘not fresh’ when it was >7 log cfu per g. They were uploaded on a web-based machine learning software called Teachable Machine (TM), which was trained about the pupils and heads of the fish. In addition, images of each species from different angles were uploaded to the software in order to ensure the recognition of fish species by TM. The data of the study indicated that the TM was able to distinguish fish species with high accuracy rates and achieved over 86% success in estimating the freshness of the fish species tested.     

智能数据分区与布局研究

大数据时代,数据规模庞大,由数据进行驱动的应用分析场景日益增多.如何快速、高效地从这些海量数据中提取出用以分析决策的信息,给数据库系统带来重大挑战.同时,现代商业分析决策对分析数据的实时性要求数据库系统能够同时快速处理ACID事务和复杂的分析查询.然而,传统的数据分区粒度太粗,且不能适应动态变化的复杂分析负载;传统的数据布局单一,不能应对现代大量增加的混合事务分析应用场景.为了解决以上问题,“智能数据分区与布局”成为当前的研究热点之一,它通过数据挖掘、机器学习等技术抽取工作负载的有效特征,设计最佳的分区策略来避免扫描大量不相关的数据,指导布局结构设计以适应不同类型的工作负载.首先介绍了智能数据分区与布局的相关背景知识,然后对智能数据分区与布局技术的研究动机、发展趋势、关键技术进行详细的阐述.最后,对智能数据分区与布局技术的研究前景做出总结与展望.     

Weighted regularized extreme learning machine to model the discharge coefficient of side slots

In the current research, a modern learning machine algorithm named “Weighted Regularized Extreme Learning Machine (WRELM)" is implemented for the first time for the simulation of the coefficient of discharge of side slots. For this purpose, an effective variable on the coefficient of discharge of side slots is firstly introduced, then five distinctive WRELM models are produced by it for the estimation of the coefficient. In the next stage, a database is created for verification of WRELM results. it should be mentioned that 70% of the data are utilized for training the WRELM models, while the rest (i.e. 30%) for testing them. After that, the optimal number of hidden layer neurons as well as the best activation function of the WRELM algorithm are chosen. In addition, the best regularization parameter and also the weight function of the WRELM are achieved. By conducting a sensitivity analysis, the most effective variable for the simulation of the coefficient of discharge along with the WRELM superior model is introduced. The WRELM superior model estimates values of the coefficient of discharge with the maximum exactness and the highest correlation. For instance, the estimations of the correlation coefficient and scatter index for this model are computed to be 0.930 and 0.051, respectively. The sensitivity analysis shows that the ratio of the side slot crest height to its length and the Froude number should be considered as the most important input variables. A comparison between the WRELM with the ELM displays that the former works much better. Furthermore, an uncertainty analysis is executed for both models. Eventually, an equation is suggested for the estimation of the coefficient of discharge and a partial derivative sensitivity analysis is performed on it.     

Molecular fingerprint and machine learning to accelerate design of high-performance homochiral metal–organic frameworks

Computational screening was employed to calculate the enantioseparation capabilities of 45 functionalized homochiral metal–organic frameworks (FHMOFs), and machine learning (ML) and molecular fingerprint (MF) techniques were used to find new FHMOFs with high performance. With increasing temperature, the enantioselectivities for (R,S)-1,3-dimethyl-1,2-propadiene are improved. The “glove effect” in the chiral pockets was proposed to explain the correlations between the steric effect of functional groups and performance of FHMOFs. Moreover, the neighborhood component analysis and RDKit/MACCS MFs show the highest predictive effect on enantioselectivities among the four ML classification algorithms with nine MFs that were tested. Based on the importance of MF, 85 new FHMOFs were designed, and a newly designed FHMOF, NO₂-NHOH-FHMOF, with high similarity to the optimal MFs achieved improved chiral separation performance, with enantioselectivities of 85%. The design principles and new chiral pockets obtained by ML and MFs could facilitate the development of new materials for chiral separation.