基于加权统计特征KICA的故障检测与诊断方法

针对核独立元分析（kernel independent component analysis, KICA）在非线性动态过程中对微小故障检测率低的问题,提出一种基于加权统计特征KICA（weighted statistical feature KICA, WSFKICA）的故障检测与诊断方法。首先,利用KICA从原始数据中捕获独立元数据和残差数据;然后,通过加权统计特征和滑动窗口获取改进统计特征数据集,并由此数据集构建统计量进行故障检测;最后,利用基于变量贡献图的方法进行过程故障诊断。与传统KICA统计量相比,所提方法的统计量对非线性动态过程中的微小故障具有更高的故障检测性能。应用该方法对一个数值例子和田纳西-伊斯曼（Tennessee-Eastman, TE）过程进行仿真测试,仿真结果显示出所提方法相对于独立元分析（ICA）、KICA、核主成分分析（kernel principal component analysis, KPCA）和统计局部核主成分分析（statistical local kernel principal component analysis, SLKPCA）检测的优势。     

Fault Detection of Non‐Linear Processes Using Kernel Independent Component Analysis

In this paper, a new non‐linear process monitoring method based on kernel independent component analysis (KICA) is developed. Its basic idea is to use KICA to extract some dominant independent components capturing non‐linearity from normal operating process data and to combine them with statistical process monitoring techniques. The proposed method is applied to the fault detection in the Tennessee Eastman process and is compared with PCA, modified ICA, and KPCA. The proposed approach effectively captures the non‐linear relationship in the process variables and showed superior fault detectability compared to other methods while attaining comparable false alarm rates.     

Multivariate statistical process monitoring using an improved independent component analysis

An approach for multivariate statistical monitoring based on kernel independent component analysis (Kernel ICA) is presented. Different from the recently developed KICA which means kernel principal component analysis (KPCA) plus independent component analysis (ICA), Kernel ICA is an improvement of ICA and uses contrast functions based on canonical correlations in a reproducing kernel Hilbert space. The basic idea is to use Kernel ICA to extract independent components and later to provide enhanced monitoring of multivariate processes. I² (the sum of the squared independent scores) and squared prediction error (SPE) are adopted as statistical quantities. Besides, kernel density estimation (KDE) is described to calculate the confidence limits. The proposed monitoring method is applied to fault detection in the simulation benchmark of the wastewater treatment process and the Tennessee Eastman process, the simulation results clearly show the advantages of Kernel ICA monitoring in comparison to ICA and KICA monitoring.     

Nonlinear process monitoring using kernel principal component analysis

In this paper, a new nonlinear process monitoring technique based on kernel principal component analysis (KPCA) is developed. KPCA has emerged in recent years as a promising method for tackling nonlinear systems. KPCA can efficiently compute principal components in high-dimensional feature spaces by means of integral operators and nonlinear kernel functions. The basic idea of KPCA is to first map the input space into a feature space via nonlinear mapping and then to compute the principal components in that feature space. In comparison to other nonlinear principal component analysis (PCA) techniques, KPCA requires only the solution of an eigenvalue problem and does not entail any nonlinear optimization. In addition, the number of principal components need not be specified prior to modeling. In this paper, a simple approach to calculating the squared prediction error (SPE) in the feature space is also suggested. Based on T² and SPE charts in the feature space, KPCA was applied to fault detection in two example systems: a simple multivariate process and the simulation benchmark of the biological wastewater treatment process. The proposed approach effectively captured the nonlinear relationship in the process variables and showed superior process monitoring performance compared to linear PCA.     

一种基于KICA-GMM的过程故障检测方法

核独立元分析(kernel independent component analysis,KICA)故障检测方法的故障检测时间易受独立元顺序和主导独立元数目经验选取的影响,针对这个问题,提出基于KICA和高斯混合模型(Gaussian mixture model,GMM)的故障检测方法。采用KICA从正常工况测量数据中提取独立元,用GMM拟合各独立元的概率密度函数,建立基于GMM的监控量及其控制限;计算各独立元的监控量均值,以此判断其非高斯性强弱,对每个强非高斯独立元进行单独监控,对弱非高斯部分采用主元分析法进行监控。在Tennessee Eastman过程上的仿真结果说明,相比于KICA故障检测方法,所提方法不需要排序独立元和选取主导独立元数目,避免了其对故障检测时间的影响,能够有效利用过程信息,缩短故障检测的延迟时间。     

Reconstruction in integrating fault spaces for fault identification with kernel independent component analysis

In the original fault identification methods, contribution plots are popular. However, it is not accurate because of the smearing effect. In addition, traditional contribution plots cannot be applied to nonlinear process because there seems no way to accurately calculate variable contributions. As a comparison, the reconstruction method is widely used in fault identification for finding the root causes of the fault. For fault detection and identification of actual industrial process with nonlinear and non-Gaussian features, a new reconstruction-based fault identification method with kernel independent component analysis (KICA) is developed in this article. The proposed method, reconstruction in integrating fault spaces (RIFSs), extends the classic reconstruction-based fault identification approach to KICA for the first time, and develops the reconstruction method from unidimensional faults to multidimensional ones for nonlinear cases. Furthermore, the number of reconstruction is effectively reduced on the basis of the integrating fault spaces (IFSs) which are composed of fault subspaces satisfying orthogonal to each other from the known fault set. In addition, fault magnitude, indicating the adjustment magnitude of a fault sample back to normal range, is used as index to identify faults, and it makes the fault identification problem become more straightforward than with the existing fault identification index, such as ratio (index I) or the reconstructed statistics (index II). Finally, the proposed method is applied to the fault detection and identification on cyanide leaching of gold, which shows its feasibility and efficiency for both sensor faults and complex process faults.     

Nonlinear multiscale modelling for fault detection and identification

In order to detect abnormal events at different scales, a number of multiscale multivariate statistical process control (MSPC) approaches which combine a multivariate linear projection model with multiresolution analysis have been suggested. In this paper, a new nonlinear multiscale-MSPC method is proposed to address multivariate process performance monitoring and in particular fault diagnostics in nonlinear processes. A kernel principal component analysis (KPCA) model, which not only captures nonlinear relationships between variables but also reduces the dimensionality of the data, is built with the reconstructed data obtained by performing wavelet transform and inverse wavelet transform sequentially on measured data. A guideline is given for both off-line and on-line implementations of the approach. Two monitoring statistics used in multiscale KPCA-based process monitoring are used for fault detection. Furthermore, variable contributions to monitoring statistics are also derived by calculating the derivative of the monitoring statistics with respect to the variables. An intensive simulation study on a continuous stirred tank reactor process and a comparison of the proposed approach with several existing methods in terms of false alarm rate, missed alarm rate and detection delay, demonstrate that the proposed method for detecting and identifying faults outperforms current approaches.     

一种基于改进KICA的非高斯过程故障检测方法

针对基于核独立元分析(kernel independent component analysis,KICA)的故障检测方法只考虑非高斯信息提取而忽略局部近邻结构保持的问题,提出基于改进KICA的过程故障检测方法。将KICA法中只考虑非高斯信息提取的负熵最大化准则转换为熵最小化准则,结合局部保持投影的相似局部近邻结构准则,提出了同时考虑非高斯信息提取和局部近邻结构保持的目标函数,通过粒子群优化算法进行全局寻优,然后建立监控统计量对过程进行监控。在Tennessee Eastman过程上的仿真结果说明,与基于KICA的故障检测方法相比,所提方法能够在保持数据集局部近邻结构的同时,提取非高斯信息,能够有效缩短故障检测的延迟时间,提高故障检测率。     

Decentralized fault diagnosis using multiblock kernel independent component analysis

In this paper, a multiblock kernel independent component analysis (MBKICA) algorithm is proposed. Then a new fault diagnosis approach based on MBKICA is proposed to monitor large-scale processes. MBKICA has superior fault diagnosis ability since variables are grouped and the non-Gaussianity is considered compared to standard kernel methods. The proposed method is applied to fault detection and diagnosis in the continuous annealing process. The proposed decentralized nonlinear approach effectively captures the nonlinear relationship and non-Gaussianity in the block process variables, and shows superior fault diagnosis ability compared to other methods.     

Improved multi-scale kernel principal component analysis and its application for fault detection

In this paper the multiscale kernel principal component analysis (MSKPCA) based on sliding median filter (SFM) is proposed for fault detection in nonlinear system with outliers. The MSKPCA based on SFM (SFM-MSKPCA) algorithm is first proposed and applied to process monitoring. The advantages of SFM-MSKPCA are: (1) the dynamical multiscale monitoring method is proposed which combining the Kronecker production, the wavelet decomposition technique, the sliding median filter technique and KPCA. The Kronecker production is first used to build the dynamical model; (2) there are more disturbances and noises in dynamical processes compared to static processes. The sliding median filter technique is used to remove the disturbances and noises; (3) SFM-MSKPCA gives nonlinear dynamic interpretation compared to MSPCA; (4) by decomposing the original data into multiple scales, SFM-MSKPCA analyze the dynamical data at different scales, reconstruct scales contained important information by IDWT, eliminate the effects of the noises in the original data compared to kernel principal component analysis (KPCA). To demonstrate the feasibility of the SFM-MSKPCA method, its process monitoring abilities are tested by simulation examples, and compared with the monitoring abilities of the KPCA and MSPCA method on the quantitative basis. The fault detection results and the comparison show the superiority of SFM-MSKPCA in fault detection.     

基于双层局部KPCA的非线性过程微小故障检测方法

针对传统核主元分析（KPCA）方法难以有效检测微小故障的问题,提出一种基于双层局部核主元分析（double-level local kernel principal component analysis,DLKPCA）的非线性过程微小故障检测方法。该方法从变量和样本两个角度来挖掘数据内部的局部信息,以提高故障检测能力。首先,利用变量分块思想,基于不同变量与核主元之间互信息相关度的相似性,将所有过程变量划分多个局部变量块。然后,构建基于得分向量和特征值的残差函数以挖掘样本局部信息。最后利用贝叶斯融合策略对各块的结果进行融合。在田纳西-伊斯曼基准过程的仿真结果表明,在微小故障检测方面,本文所提方法具有比传统KPCA方法更好的故障检测性能。     

基于核熵独立成分分析的故障检测方法

传统核独立成分分析（KICA）依据特征值的大小进行降维,但是特征值大并不一定取得的信息熵贡献度也是最大的。针对这个问题,提出一种基于核熵独立成分分析（KEICA）的故障检测方法。将训练数据集投影在高维核空间,通过对数据信息熵的贡献大小选取核主成分,并建立独立成分分析（ICA）模型。对训练样本求{\mathit{I}}^{\mathrm{2}}和\mathrm{S}\mathrm{P}\mathrm{E}统计量,并利用核密度估计计算统计量的控制限。计算测试数据对训练数据的核矩阵,将其投影在ICA模型上并计算测试样本的统计量,统计量超出控制限的样本即可被识别为故障样本。将该方法用于非线性数值例子和Tennessee Eastman（TE）过程的故障检测,并与传统的核主成分分析（KPCA）、核熵成分分析（KECA）和KICA方法进行对比,表明KEICA的监测效果优于其他三种方法。     

基于核熵独立成分分析的故障检测方法

传统核独立成分分析（KICA）依据特征值的大小进行降维,但是特征值大并不一定取得的信息熵贡献度也是最大的。针对这个问题,提出一种基于核熵独立成分分析（KEICA）的故障检测方法。将训练数据集投影在高维核空间,通过对数据信息熵的贡献大小选取核主成分,并建立独立成分分析（ICA）模型。对训练样本求{\mathit{I}}^{\mathrm{2}}和\mathrm{S}\mathrm{P}\mathrm{E}统计量,并利用核密度估计计算统计量的控制限。计算测试数据对训练数据的核矩阵,将其投影在ICA模型上并计算测试样本的统计量,统计量超出控制限的样本即可被识别为故障样本。将该方法用于非线性数值例子和Tennessee Eastman（TE）过程的故障检测,并与传统的核主成分分析（KPCA）、核熵成分分析（KECA）和KICA方法进行对比,表明KEICA的监测效果优于其他三种方法。     

基于WPRKPCA的非线性化工过程微小故障检测

传统核主元分析法（KPCA）是一种广泛应用的非线性化工过程故障检测方法,但是其未充分利用过程数据的概率分布信息,往往难以有效检测过程中的微小故障。针对传统KPCA方法的局限性,本文提出了一种基于加权概率相关核主元分析（WPRKPCA）的非线性化工过程微小故障检测方法。与传统KPCA方法监控核成分的变化不同,该方法利用Kullback Leibler散度（KLD）度量核成分的概率分布变化,进而建立基于KLD成分的统计监控模型,以充分挖掘过程数据所包含的概率信息。进一步考虑到不同KLD成分承载故障信息的差异性,该方法设计了一种基于核密度估计的指数加权策略,根据KLD成分描述故障信息程度的差异分配相应的权值,以加强监控模型对微小故障检测的灵敏性。在一个数值例子和连续搅拌反应器（CSTR）系统上的仿真结果表明,本文所提方法具有比传统KPCA方法更好的微小故障检测性能。     

Fault diagnosis of nonlinear processes using multiscale KPCA and multiscale KPLS

New approaches are proposed for nonlinear process monitoring and fault diagnosis based on kernel principal component analysis (KPCA) and kernel partial least analysis (KPLS) models at different scales, which are called multiscale KPCA (MSKPCA) and multiscale KPLS (MSKPLS). KPCA and KPLS are applied to these multiscale data to capture process variable correlations occurring at different scales. Main contribution of the paper is to propose nonlinear fault diagnosis methods based on multiscale contribution plots. In particular, the nonlinear scores of the variables at each scale are derived. These nonlinear scale contributions can be computed, which is very useful in diagnosing faults that occur mainly at a single scale. The proposed methods are applied to process monitoring of a continuous annealing process and fused magnesium furnace. Application results indicate that the proposed approach effectively captures the complex relations in the process and improves the diagnosis ability.     

Learning a data-dependent kernel function for KPCA-based nonlinear process monitoring

Kernel principal component analysis (KPCA)-based process monitoring methods have recently shown to be very effective for monitoring nonlinear processes. However, their performances largely depend on the kernel function and currently there is no general rule for kernel selection. Existing methods simply choose the kernel function empirically or experimentally from a given set of candidates. This paper proposes a kernel function learning method for KPCA to learn a kernel function tailored to specific data and explores its potential for KPCA-based process monitoring. Motivated by the manifold learning method maximum variance unfolding (MVU), we obtain the kernel function by optimizing over a family of data-dependent kernels such that the nonlinear structure in input data is unfolded in the kernel feature space and gets more likely to be linear there. Using the optimized kernel, the nonlinear principal components of KPCA which are linear principal components in the kernel feature space can effectively capture the variation in data, and thus the data under normal operating conditions can be more precisely modeled by KPCA for process monitoring. Simulation results on an simple nonlinear system and the benchmark Tennessee Eastman (TE) demonstrate that the optimized kernel functions lead to significant improvement in the performance over the popular Gaussian kernels when used in the KPCA-based process monitoring.     

基于MKECA的非高斯性和非线性共存的间歇过程监测

多向核独立成分分析（multiway kernel independent component analysis,MKICA）在监测间歇过程非高斯性和非线性方面取得了广泛应用,其仅仅是将线性独立成分分析（independent component analysis,ICA）方法利用核主成分分析（kernel principal component analysis,KPCA）白化扩展到非线性领域,但数据经KPCA白化后只考虑数据信息最大化未考虑数据簇结构信息的不足,为解决此问题,采用核熵成分分析（kernel entropy component analysis,KECA）代替KPCA白化的过程监测方法。该方法首先利用AT展开方法将过程三维数据变为二维数据;其次用KECA进行白化处理的同时解决数据的非线性;然后建立ICA监测模型用于非高斯生产过程监测;最后将该方法应用到青霉素发酵仿真和实际的工业过程并与MKICA方法进行对比,验证该方法的有效性。     

基于主元分析和核密度估计的多变量统计过程监控及在工厂聚丙烯催化剂反应器的应用

Abstract Data-driven tools, such as principal component analysis （PCA） and independent component analysis （ICA） have been applied to different benchmarks as process monitoring methods. The difference between the two methods is that the components of PCA are still dependent while ICA has no orthogonality constraint and its latentvariables are independent. Process monitoring with PCA often supposes that process data or principal components is Gaussian distribution. However, this kind of constraint cannot be satisfied by several practical processes. To ex-tend the use of PCA, a nonparametric method is added to PCA to overcome the difficulty, and kernel density estimation （KDE） is rather a good choice. Though ICA is based on non-Gaussian distribution intormation, .KDE can help in the close monitoring of the data. Methods, such as PCA, ICA, PCA.with .KDE（KPCA）, and ICA with KDE,（KICA）, are demonstrated and. compared by applying them to a practical industnal Spheripol craft polypropylene catalyzer reactor instead of a laboratory emulator.     

一种改进的动态核主元分析故障检测方法

针对复杂工业系统动态非线性故障检测过程精度低和计算量大的问题,提出了一种改进的动态核主元分析故障检测方法，该方法首先利用不可区分度剔除相关程度较小或者不相关变量,减少数据量，然后通过观测值扩展对筛选后的新数据构建增广矩阵，并对矩阵使用核主元分析提取变量数据的非线性空间相关特征，最后通过监测T ²和SPE 两种统计量诊断出系统发生故障及识别故障变量。仿真实验证明，该方法能对风力发电机故障进行有效监测和诊断，与KPCA方法相比，改进的动态核主元分析方法对微小故障更为敏感。     

Improved kernel PCA-based monitoring approach for nonlinear processes

Conventional kernel principal component analysis (KPCA) may not function well for nonlinear processes, since the Gaussian assumption of the method may be violated through nonlinear and kernel transformation of the original process data. To overcome this deficiency, a statistical local approach is incorporated into KPCA. Through this method, a new score variable which was called improved residual in the statistical local approach is constructed. The new variable approximately follows Gaussian distribution, in spite of which distribution the original data follows. Two new statistics are constructed for process monitoring, with their corresponding confidence limits determined by a χ² distribution. Besides of the improvement made on KPCA, the new joint local approach-KPCA method also shows superiority on detection sensitivity, especially for small faults slow changes of the process. The new method is exemplified using a numerical study and also tested in the complicated Tennessee Eastman (TE) benchmark process.