基于改进随机梯度Boosting算法的软测量建模

在建立复杂化工过程软测量模型时,使用传统的随机梯度Boosting算法（SGB）建模若收缩参数v选取不当会明显降低算法收敛速度,且极易陷入过拟合,难以取得令人满意的泛化效果。为解决这一问题,提出了一种基于SGB集成学习的软测量建模方法,采用高斯过程回归作为基学习器,并针对SGB算法固有的不足,依据每一次迭代中弱学习机的反馈,自适应调整收缩参数v,改善了SGB算法的过度拟合,从而提高了集成模型的估计精度与学习效率。将该方法应用于某双酚A装置的软测量建模中,仿真结果表明,相比于传统SGB建模,该方法具有更高的泛化性能和学习效率。     

基于广义隐马尔可夫模型的PM2.5浓度预测

近年来,以PM_2.5为主要污染物的重霾污染事件频频发生,给我国国民经济和居民健康造成了严重损失。在空气质量尚未得到根本性改善的情况下,对重霾污染的准确预警不仅能使公众合理回避污染危害,还能为政府实施应急管理提供时间裕量。针对影响PM_2.5浓度的前体物及气象因素的非高斯分布特点以及传统隐马尔可夫模型（hidden Markov model,HMM）必须已知隐含状态个数的缺点,采用广义隐马尔可夫模型（generalized hidden Markov model,GHMM）对北京市除去定陵外的11个国控站点2013年1月～2017年1月的PM_2.5浓度进行了预测。结果表明：GHMM对严重污染及以上PM_2.5样本浓度预测准确率显著高于传统连续HMM,但针对中度污染及以下PM_2.5样本浓度的预测准确率接近传统HMM。     

基于差分进化粒子群混合优化算法的软测量建模

针对乙烯生产过程中,用传统方法难以直接完成对乙烯收率的在线测量的问题,提出了一种新型差分进化粒子群混合优化算法,建立了乙烯收率软测量建模。改进算法将优化过程分成两阶段,两分群分别采用粒子群算法和差分进化算法同时进行。迭代过程中引入进化速度因子进行算法局部收敛性判断,通过两个群体间的信息交流阻止算法陷入局部最优。对高维复杂函数寻优测试表明,算法的整体优化性能均强于基本粒子群算法和差分进化算法。应用结果表明,基于改进算法的软测量模型具有测量精度较高、泛化性能较好等优点。     

基于差分进化算法-最小二乘支持向量机的软测量建模

软测量技术是解决工业过程中存在的一类难以在线测量参数估计问题的有效方法,该技术的核心是建立优良的数学模型。支持向量机是基于统计学理论的一种机器学习方法,最小二乘支持向量机是一种扩展的支持向量机,相对于支持向量机具有较快求解速度。最小二乘支持向量机存在着参数选择的问题,针对这个问题,采用差分进化算法进行参数选择。提出基于差分进化算法的最小二乘支持向量机应用于软测量建模,并将其应用于对苯二甲酸中对羧基苯甲醛含量测试的软测量建模中,获得了满意的结果。     

基于辅助变量KNN分析的软测量建模方法

提出一种基于辅助变量最近邻（KNN）分析的软测量建模方法,该方法将KNN算法应用于辅助变量分类,根据分类结果,应用核主成分分析（KPCA）和支持向量回归机（SVR）相结合进行软测量建模。KNN分析独立于后继回归模型,却又直接影响模型结构,KPCA作为中间层,在KNN分类结果指导下提取不同类别包含辅助变量高阶信息的特征主元,然后使用SVR建立特征主元和主导变量之间的回归模型。用该方法建立粗汽油干点软测量模型,结果表明KNN-KPCA-SVR（KKS）模型的预测精度和泛化能力优于线性PLS、RBF核函数SVR和KPCA-SVM模型。     

基于改进差分进化和最小二乘支持向量机的铝酸钠溶液浓度软测量

针对氧化铝蒸发过程铝酸钠溶液浓度难以在线检测问题,提出了改进差分进化和最小二乘支持向量机的铝酸钠溶液浓度软测量建模方法。首先基于灰色关联分析和核主成分分析确定模型的输入变量,再用改进差分进化算法的最小二乘支持向量机构建软测量模型。并与DE-LSSVM软测量模型进行比较;最后应用蒸发过程生产数据进行验证,结果表明,新模型具有更好的学习能力和泛化性能且预测精度更高,可为蒸发过程操作优化提供必要的指导。     

浮选工艺指标KPCA-ELM软测量模型及应用

精矿品位和尾矿品位是浮选过程重要的工艺技术指标,其难以实现在线检测,且与过程控制变量具有强非线性、不确定性等综合复杂特性,难以直接采用精确的数学模型描述,主要依靠人工化验分析。人工采样化验周期较长,难以满足控制要求,使得浮选精矿品位偏低,尾矿品位偏高,因此建立浮选品位指标的软测量方法受到工业界广泛关注。在分析浮选过程工艺指标相关影响因素的基础上,建立一种基于主元分析KPCA(kernel principal component analysis)和极限学习机ELM(extreme learning machine)的软测量模型。为了消除离群点对软测量模型精度的影响,采用基于稳健位置估计的方法识别离群点,利用核主元分析对软测量模型的输入数据进行降维,提取非线性主元,然后用极限学习机进行建模。该建模方法已成功应用于中国西北某选矿厂浮选车间,工业应用结果表明该方法有很高的预报精度,对生产有一定的指导意义。     

Orthogonal nonnegative matrix factorization based local hidden Markov model for multimode process monitoring

Traditional data driven fault detection methods assume that the process operates in a single mode so that they cannot perform well in processes with multiple operating modes. To monitor multimode processes effectively, this paper proposes a novel process monitoring scheme based on orthogonal nonnegative matrix factorization (ONMF) and hidden Markov model (HMM). The new clustering technique ONMF is employed to separate data fromdifferent processmodes. ThemultipleHMMs for various operating modes lead to highermodeling accuracy. The proposed approach does not presume the distribution of data in each mode because the process uncertainty and dynamics can bewell interpreted through the hidden Markov estimation. The HMM-based monitoring indication named negative log likelihood probability is utilized for fault detection. In order to assess the proposed monitoring strategy, a numerical example and the Tennessee Eastman process are used. The results demonstrate that this method provides efficient fault detection performance.     

Soft sensor modeling method based on hybrid model of nearest neighbor and neural network

Soft-sensing modeling can effectively solve the problems of large measurement lag, high price, and complex maintenance of online analytical instruments in the production process. At present, neural network based on data-driven is one of the main tools of soft sensor. In the process of modeling data collection, the collection of dominant variables is much more difficult than that of auxiliary variables, resulting in a large amount of unlabeled data. However, traditional soft sensor modeling methods ignore these unlabeled data and only use a small amount of labeled data for modeling, which has negative effect on the prediction accuracy of the model. To solve the problem of label missing, the nearest neighbor algorithm is used to pseudo label the unlabeled data. At the same time, a network structure is designed by combining convolution operation and gated recurrent unit neural network (GRU) to further utilize the unlabeled data, extract the dynamic feature from data at different time, and improve the prediction accuracy of the neural network. Finally, the method is applied to the prediction of propane concentration on the top of propylene distillation column. The results show that the model can solve the problem of label missing in the nonlinear dynamic system and has higher prediction accuracy.     

基于最近邻与神经网络融合模型的软测量建模方法

软测量建模能够有效地解决生产过程中在线分析仪表测量滞后大、价格昂贵、维护保养复杂等问题。目前,基于数据驱动的神经网络是软测量建模的主要工具之一。而在建模数据的采集过程中,主导变量的采集相对辅助变量要困难得多,由此产生了大量缺失标签的数据。但传统的软测量建模方法却忽视了这些无标签数据,只利用少量的有标签数据建模,从而影响了模型的预测精度。为了解决标签缺失的问题,采用最近邻算法对无标签数据进行伪标记,同时设计了由卷积操作与门限循环单元神经网络(GRU)结合的网络结构来进一步利用无标签数据,提取不同时刻数据中的动态特征,提高神经网络的预测精度。最后将该方法应用于丙烯精馏塔塔顶丙烷浓度的预测,实验结果表明该模型能有效处理非线性动态系统的标签缺失问题,具有更高的预测精度。     

Soft sensor based on multi-phase stacking ensemble model with self-selected primary learner for batch processes

In batch processes, existing soft sensing methodologies encounter substantial challenges when confronted with nonlinearity and multi-phase issues. In response to these challenges, an innovative soft sensing framework known as the multi-phase stacking ensemble model with self-selected primary learner is proposed. The main innovation of this framework lies in the solution to the primary learner selection issue within the stacking model. To commence, the batch process is divided into multiple phases employing a Gaussian mixture model, thereby establishing local ensemble models for each phase. Subsequently, the iterative self-selection of primary learners strategy is proposed, which iteratively selects suitable primary learners for these models, optimizing their combination of primary learners for each local model. This primary learner selection strategy effectively enhances the accuracy of predictions in the stacking ensemble model. To further enhance the performance, Bayesian optimization is utilized to tune the hyperparameters of each local ensemble model. This step guarantees optimal performance of the model across diverse phases. Extensive simulation experiments are conducted on an industrial penicillin fermentation process to validate the effectiveness of the proposed framework. According to the findings, the model demonstrated superior performance compared to existing single-learner soft sensing methods and commonly utilized ensemble-based soft sensing methods in terms of both R² score (0.97584) and RMSE (0.0513). Overall, this framework offers a novel approach for selecting primary learners in stacking ensemble models and enhancing the predictive performance in batch processes for soft sensing.     

基于高斯过程和贝叶斯决策的组合模型软测量

为了提高化工生产过程中软测量建模的估计精度,提出了一种基于高斯过程和贝叶斯决策的组合模型建模方法。该方法在对原始数据进行分类的基础上,利用高斯过程对每个子类建立软测量子模型,通过贝叶斯决策方法实现模型的联合估计输出。将该建模方法应用于某双酚A装置的软测量建模中,仿真结果表明,相比于传统的开关切换或加权组合多模型,该组合模型能在实际生产中充分利用样本信息,使得具有更高的估计精度和更强的泛化性能。     

基于改进扩张搜索聚类算法的多流形软测量建模

针对化工生产过程工况复杂多变，单一的软测量模型难以满足系统对估计精度的要求，提出了一种基于改进的扩张搜索聚类算法的多流形软测量建模的方法。该算法采用流形距离来代替欧氏距离，自适应地确定邻域半径，并引入局部密度用于确定聚类中心，对聚类后得到的各个子流形分别采用流形学习中的核等距映射法进行特征提取，建立基于高斯过程回归的子模型。将该方法应用于某双酚A生产装置的软测量建模，仿真结果验证了该方法的有效性。     

Mixture semisupervised principal component regression model and soft sensor application

Traditionally, data‐based soft sensors are constructed upon the labeled historical dataset which contains equal numbers of input and output data samples. While it is easy to obtain input variables such as temperature, pressure, and flow rate in the chemical process, the output variables, which correspond to quality/key property variables, are much more difficult to obtain. Therefore, we may only have a small number of output data samples, and have much more input data samples. In this article, a mixture form of the semisupervised probabilistic principal component regression model is proposed for soft sensor application, which can efficiently incorporate the unlabeled data information from different operation modes. Compared to the total supervised method, both modeling efficiency and soft sensing performance are improved with the inclusion of additional unlabeled data samples. Two case studies are provided to evaluate the feasibility and efficiency of the new method. © 2013 American Institute of Chemical Engineers AIChE J 60: 533–545, 2014     

基于变异CPSO算法的LSSVM蒸发过程软测量

在分析混沌粒子群优化算法(CPSO)和最小二乘支持向量机(SVM)理论基础上,以某氧化铝厂蒸发过程为对象,采用带有末位淘汰机制的混沌粒子群优化算法优化支持向量机的参数,建立了基于变异CPSO算法的LS-SVM的氧化铝蒸发过程软测量模型,并与PSO-LSSVM、LSSVM模型比较,研究表明,ICPSO-LSSVM模型预测准确,泛化性能好,且该模型预测结果中相对误差小于5%的样本达到92.5%,最大相对误差仅为8.1%,均方差MSE为0.05153,模型具有较高的精度,其现场实施结果表明基本可以实现出口浓度的实时在线预估。     

Multiway discrete hidden Markov model‐based approach for dynamic batch process monitoring and fault classification

A new multiway discrete hidden Markov model (MDHMM)‐based approach is proposed in this article for fault detection and classification in complex batch or semibatch process with inherent dynamics and system uncertainty. The probabilistic inference along the state transitions in MDHMM can effectively extract the dynamic and stochastic patterns in the process operation. Furthermore, the used multiway analysis is able to transform the three‐dimensional (3‐D) data matrices into 2‐D measurement‐state data sets for hidden Markov model estimation and state path optimization. The proposed MDHMM approach is applied to fed‐batch penicillin fermentation process and compared to the conventional multiway principal component analysis (MPCA) and multiway dynamic principal component analysis (MDPCA) methods in three faulty scenarios. The monitoring results demonstrate that the MDHMM approach is superior to both the MPCA and MDPCA methods in terms of fault detection and false alarm rates. In addition, the supervised MDHMM approach is able to classify different types of process faults with high fidelity. © 2011 American Institute of Chemical Engineers AIChE J, 2012     

基于稳定Hammerstein模型的在线软测量建模方法及应用

针对复杂工业过程中由于存在未建模动态和不确定干扰,导致关键变量的软测量精度下降的问题,提出了一种基于稳定Hammerstein模型(H模型)的在线软测量建模方法。H模型的非线性增益采用带有时变稳定学习算法的小波神经网络模型,线性系统部分采用基于递推最小二乘的ARX模型,基于输入到状态稳定性理论证明了H模型辨识误差的有界性。其中小波神经网络具有表征强非线性的特性,稳定学习算法可抑制未建模动态和不确定干扰的影响,改善了模型的预测精度和自适应能力。以典型非线性系统和实际污水处理过程为例进行了仿真研究,结果表明,基于稳定H模型的软测量方法具有较高的在线软测量精度。     

Mixture robust L1 probabilistic principal component regression and soft sensor application

In this paper, the multivariate Laplace distribution (also called L1 distribution) is adopted to construct a robust probabilistic principal component regression model (MRPPCR-L1) under multiple operating modes. In the practical industrial chemistry process, outliers exist due to incorrect recording, disturbances, and process noises and might result in modelling distortion. To address this problem, Laplace distribution, instead of the Gaussian distribution in traditional methods, is introduced to reduce the negative influence of outliers. Moreover, probabilistic principal component regression is employed for dealing with the mixture modelling problem owing to its probabilistic property to determine the operating modes. The formulation of this approach is derived with the expectation maximum algorithm and the soft sensing model is also developed for prediction. Compared to the conventional method, a numerical example and the Tennessee Eastman process are used to demonstrate the robust modelling performance of the proposed method.     

基于递推PLS核算法的软测量在线学习方法

针对过程的动态时变特性,提出一种基于PLS核算法的软测量在线学习方法。该方法利用PLS核算法,通过递推学习具有代表性的新样本来改善模型的适应能力,较NIPALS算法具有更高的计算效率;并采用一种同时考虑输入和输出信息的相似度准则,有选择地删除一个或多个冗余样本,更有效地构建了训练样本集。工业聚丙烯熔融指数的软测量建模研究表明,本文提出的方法能够快速有效地跟踪牌号切换中熔融指数的变化。