Multi-scale kernel Fisher discriminant analysis with adaptive neuro-fuzzy inference system (ANFIS) in fault detection and diagnosis framework for chemical process systems

Fault detection and diagnosis (FDD) framework is one of safety aspects that is important to the industrial sector to ensure its high-quality production and processes. However, the development of FDD system in chemical process systems could have difficulties, e.g. highly nonlinear correlation within the variables, highly complex process, and an enormous number of sensors to be monitored. These issues have encouraged the development of various approaches to increase the effectiveness and robustness of the FDD framework, such as the wavelet transform analysis, where it has the advantage in extracting the significant features in both time and frequency domain. It has motivated us to propose an extension work of the multi-scale KFDA method, where we have modified it with the implementation of Parseval’s theorem and the application of ANFIS method to improve the performance of the fault classification. In this work, through the implementation of Parseval’s theorem, the observation of fault features via the energy spectrum and effective reduction in DWT analysis data quantity can be accomplished. The extracted features from the multi-scale KFDA method are used for fault diagnosis and classification, where multiple ANFIS models were developed for each designated fault pattern to increase the classification accuracy and reduce the diagnosis error rate. The fault classification performance of the proposed framework has been evaluated using a benchmarked Tennessee Eastman process. The results indicated that the proposed multi-scale KFDA-ANFIS framework has shown the improvement with an average of 87.02% in classification accuracy over the multi-scale PCA-ANFIS (78.90%) and FDA-ANFIS (70.80%).

     

局部Fisher判别分析算法及仿真研究*

复杂化工过程常被多种类型的故障损坏,正常的训练数据无法建立准确的操作模型。为了提高复杂化工过程中故障的检测和分类能力,传统无监督Fisher判别分析(Fisher Discriminant Analysis,FDA)算法无法在多模态故障数据中的应用,本文提出基于局部Fisher判别分析(Local Fisher Discriminant Analysis,LFDA)的故障诊断方法。首先计算训练数据的局部类内和类间离散度矩阵,寻找LFDA的投影方向;其次把训练数据和测试数据向投影向量上投影,提取特征向量;最后计算特征向量间的欧氏距离,运用KNN分类器进行分类。把提出的LFDA方法应用到Tennessee Eastman(TE)过程,监控结果表明,LFDA的效果好于FDA和核Fisher判别分析(Kernel Fisher Discriminant Analysis,KFDA),说明LFDA方法在分类及检测不同类的故障方面具有高准确性及高灵敏度的优势。     

改进的核费舍判别分析法应用于故障诊断

化工过程采样数据具有强非线性和噪声,针对化工过程状态监控的问题,提出一种改进的核费舍判别分析法（KFDA）的故障诊断算法。首先采样数据经过小波变换方法去除噪声,去除噪声后的数据进行KFDA建模,然后在建模同时采用特征向量选择（FVS）算法降低复杂性。Tennessee Eastman process实验结果表明了该算法的有效性,同时该算法加强了KFDA故障诊断的准确性,并明显地减少了存储空间和运算时间。     

Fault diagnosis of nonlinear and large-scale processes using novel modified kernel Fisher discriminant analysis approach

It is pretty significant for fault diagnosis timely and accurately to improve the dependability of industrial processes. In this study, fault diagnosis of nonlinear and large-scale processes by variable-weighted kernel Fisher discriminant analysis (KFDA) based on improved biogeography-based optimisation (IBBO) is proposed, referred to as IBBO-KFDA, where IBBO is used to determine the parameters of variable-weighted KFDA, and variable-weighted KFDA is used to solve the multi-classification overlapping problem. The main contributions of this work are four-fold to further improve the performance of KFDA for fault diagnosis. First, a nonlinear fault diagnosis approach with variable-weighted KFDA is developed for maximising separation between the overlapping fault samples. Second, kernel parameters and features selection of variable-weighted KFDA are simultaneously optimised using IBBO. Finally, a single fitness function that combines erroneous diagnosis rate with feature cost is created, a novel mixed kernel function is introduced to improve the classification capability in the feature space and diagnosis accuracy of the IBBO-KFDA, and serves as the target function in the optimisation problem. Moreover, an IBBO approach is developed to obtain the better quality of solution and faster convergence speed. On the one hand, the proposed IBBO-KFDA method is first used on Tennessee Eastman process benchmark data sets to validate the feasibility and efficiency. On the other hand, IBBO-KFDA is applied to diagnose faults of automation gauge control system. Simulation results demonstrate that IBBO-KFDA can obtain better kernel parameters and feature vectors with a lower computing cost, higher diagnosis accuracy and a better real-time capacity.     

A novel fault diagnosis system using pattern classification on kernel FDA subspace

Recently, pattern recognition techniques have been applied for fault diagnosis. Principal component analysis (PCA) and kernel principal component analysis (KPCA) are introduced for feature extraction. However, those unsupervised learning methods have not incorporated the prior knowledge of process patterns. This paper proposes a novel fault diagnosis system to improve the performance of fault diagnosis. Kernel Fisher discriminant analysis (KFDA) is used in the first step for feature extraction, then Gaussian mixture model (GMM) and k-nearest neighbor (kNN) are applied for fault detection and isolation on the KFDA subspace. Since the performance of fault diagnosis system would be degraded in the fault detection stage, fault detection and identification are presented in a holistic manner without an intermediate step in the novel system. A case study of the Tennessee Eastman (TE) benchmark process indicates that the proposed methods are more efficient, compared to the traditional ones. Furthermore, as the performances of GMM and kNN are comparable, the data structure of the process should be checked beforehand, depending on which the optimal classifier can be selected.     

基于特征向量提取的核主元分析法

核主成分分析(KPCA)是非线性化工过程故障检测与诊断时常用的多变量统计控制方法之一.从两个方面改进了KPCA的故障检测性能.为了提高KPCA方法故障检测的准确率,提出了基于小波的KPCA故障检测方法.当样本数大时,采用基于几何考虑的特征向量提取(FVS)算法,降低了KPCA计算的复杂性,缩短了计算时间.Tennessee Eastman process仿真给出了所提出的方法的有效性.     

Fault classification method for inverter based on hybrid support vector machines and wavelet analysis

A new classification method for fault waveform is proposed based on discrete orthogonal wavelet transform (DOWT) and hybrid support vector machine (hybrid SVM) for fault type of a three-phase voltage inverter. The waveforms of output voltage obtained from the faulty inverter are decomposed by DOWT into wavelet coefficient matrices, through which we can obtain singular value vectors acted as features of time-series periodic waveforms. And then a multi-classes classification method based on a new Huffman Tree structure is presented to realize 1-v-r SVM strategy. The extracted features are applied to hybrid SVM for determining fault type. Compared to employing the structure based on ordinary binary tree, the superiority of the proposed SVM method is shown in the success of fault diagnosis because the average Loo-correctness of the SVM based on Huffman tree structure exceed the general SVM 3.65%, and the correctness reaches 99.6%.     

基于SVDD和D-S理论的模拟电路故障诊断

为解决模拟电路故障诊断复杂多样难于辨识的问题和有效提高诊断准确度及速度,提出了一种融合支持向量数据描述(SVDD)算法和D-S证据理论的故障诊断方法。首先,对采集信号进行基于局部判别基的Haar小波包变换,依据判别测度选取判别能力强的前5个节点的标准能量构成特征集。然后利用SVDD算法求出特征集对于不同类别的基本信任分配函数,最后利用证据理论对不同基本信任分配函数进行组合得到最终故障诊断决策。将该方法应用于两级四运放双二次低通滤波器电路进行故障诊断,实验结果表明该方法能够准确迅速诊断出模拟电路中的故障;与基于SVDD多分类算法、一对一(o-v-o)SVM和一对多(o-v-a)SVM分类算法的故障诊断方法进行比较,本方法能够提高模拟电路故障诊断的精度;比采用o-v-o SVM和o-v-a SVM分类算法的故障诊断方法有更快的诊断速度。     

基于数据分析的化工过程监测

为了改善主元分析对带噪声过程的监测性能，本文结合小波包分析消噪性能与主元分析提取变量间相关性能的特点，提出了一种小波包主元分析方法。给出了基于小波包主元分析的过程监测的算法实现。并在此基础上，对TE过程进行了监测性能仿真。结果表明小波包主元分析方法有较好的监测性能。     

Deep learning for fault-relevant feature extraction and fault classification with stacked supervised auto-encoder

Stacked auto-encoder (SAE)-based deep learning has been introduced for fault classification in recent years, which has the potential to extract deep abstract features from the raw input data. However, SAE cannot ensure the relevance of deep features with the fault types due to its unsupervised self-reconstruction in the pretraining stage. To overcome this problem, a stacked supervised auto-encoder is proposed to pretrain the deep network and obtain deep fault-relevant features from raw input data. In each supervised auto-encoder, informative features are learned from the input data with the goal that they can largely distinguish different fault types. By stacking multiple supervised auto-encoders hierarchically, high-level fault-relevant features are gradually learned from raw input data, which can improve the classification accuracy of the classifiers. The proposed SSAE is tested on the Tennessee–Eastman (TE) benchmark process and a real industrial hydrocracking process. The results show the effectiveness and flexibility of SSAE.     

Principal components selection for dimensionality reduction using discriminant information applied to fault diagnosis

The Principal Component Analysis is one of most applied dimensionality reduction techniques for process monitoring and fault diagnosis in industrial process. This work proposes a procedure based on the discriminant information contained in the principal components to determine the most significant ones in fault separability. The Tennessee Eastman Process industrial benchmark is used to illustrate the effectiveness of the proposal. The use of statistical hypothesis tests as a separability measure between multiple failures is proposed for the selection of the principal components. The classifier profile concept has been introduced for comparison purposes. Results show an improvement in the classification process when compared with traditional techniques and the StepWise selection. This has resulted in a better classification for a fixed number of components, or a smaller number of required components to obtain a prefixed error rate. In addition, the computational advantage is demonstrated.     

基于鲁棒ICA-PCA的TE故障诊断*

针对复杂工业过程混合分布的问题,提出了鲁棒ICA-PCA(Independent Component Analysis-Principal Component Analysis, ICA-PCA)的故障诊断的新方法。由于实际工业过程数据不可避免的带有大量干扰,为降低数据粗差的影响,首先采用小波去噪算法提高建模数据质量,然后利用鲁棒ICA-PCA算法提取过程的非高斯和高斯信息,并构建了三个统计量进行故障的监控。最后把上述方法应用到田纳西-伊斯曼(Tennessee Eastman,TE)化工过程。仿真结果表明,相比于传统PCA算法、ICA-PCA等算法,鲁棒ICA-PCA方法能够有效的检测故障的发生,该方法具有较好的鲁棒性和灵敏性。     

Nonlinear feature extraction and classification of multivariate data in kernel feature space

Batch processes have played an essential role in the production of high value-added product of chemical, pharmaceutical, food, bio-chemical, and semi-conductor industries. For productivity and quality improvement, several multivariate statistical techniques such as principal component analysis (PCA) and Fisher discriminant analysis (FDA) have been developed to solve a fault diagnosis problem of batch processes. Fisher discriminant analysis, as a traditional statistical technique for feature extraction and classification, has been shown to be a good linear technique for fault diagnosis and outperform PCA based diagnosis methods. This paper proposes a more efficient nonlinear diagnosis method for batch processes using a kernel version of Fisher discriminant analysis (KFDA). A case study on two batch processes has been conducted. In addition, the diagnosis performance of the proposed method was compared with that of an existing diagnosis method based on linear FDA. The diagnosis results showed that the proposed KFDA based diagnosis method outperforms the linear FDA based method.     

Neural network modeling relationship between inputs and state mapping plane obtained by FDA–t-SNE for visual industrial process monitoring

Fault monitoring and diagnosis can significantly help in understanding the actual operation of modern chemical processes. Data visualization can enable technical staff to visually detect and diagnose various fault conditions compared with other conventional techniques. Thus, fisher discriminant analysis (FDA), t-distributed stochastic neighbor embedding (t-SNE), and back-propagation (BP) artificial neural networks are implemented for visual fault monitoring and diagnosis. Three fundamental steps are involved. First, FDA is employed to extract the main features of the dataset, which contain different states of data. Second, t-SNE is applied for data visualization, and on the mapping plane, the various states of the chemical process have their own mapping areas. Third, BP is conducted to model the relationship between inputs and the location of mapping points on the mapping plane. Finally, the trained BP net can be utilized for fault monitoring and diagnosis. Detailed comparative experiments are studied based on the Tennessee Eastman process among FDA, SOM and FDA-SOM to analyze the performance of the combined method. This method is highly competitive for visual fault monitoring and diagnosis than other state-of-art methods.     

基于集成局部费舍尔判别分析的故障分类

实际工业过程数据的局部特性一般都较为复杂,不利于样本特征的提取和故障分类精度的提高.针对此问题,本文提出一种集成的局部费舍尔判别分析(ILFDA)模型,可以同时从变量和样本两个维度挖掘数据的局部结构特征,提高故障分类的性能并降低建模的难度.首先,根据过程的结构原理对复杂系统进行分块,从而可以有效获取变量维度的数据局部信...     

Integrating independent component analysis and support vector machine for multivariate process monitoring

This study aims to develop an intelligent algorithm by integrating the independent component analysis (ICA) and support vector machine (SVM) for monitoring multivariate processes. For developing a successful SVM-based fault detector, the first step is feature extraction. In real industrial processes, process variables are rarely Gaussian distributed. Thus, this study proposes the application of ICA to extract the hidden information of a non-Gaussian process before conducting SVM. The proposed fault detector will be implemented via two simulated processes and a case study of the Tennessee Eastman process. Results demonstrate that the proposed method possesses superior fault detection when compared to conventional monitoring methods, including PCA, ICA, modified ICA, ICA–PCA and PCA–SVM.     

Gaussian Discriminative Analysis aided GAN for imbalanced big data augmentation and fault classification

With data in industrial processes being larger in scale and easier to access, data-driven technologies have become more prevalent in process monitoring. Fault classification is an indispensable part of process monitoring, while machine learning is an effective tool for fault classification. In most practical cases, however, the number of fault data is far smaller than normal data, and this imbalance of dataset would lead to the significant decline in performance of common classifier learning algorithms. To this issue, we propose a data augmentation method, which is based on Generative Adversarial Networks(GAN) and aided by Gaussian Discriminant Analysis(GDA), for enhancement of fault classification accuracy. To validate the effectiveness of this method for imbalanced fault classification, on toy data and the Tennessee Eastman (TE) benchmark process, common oversampling method and the basic GAN are compared to our method, with different classification algorithms. Besides, proposed method is deployed and parallelly trained on Tensorflow platform, which is suitable for applications like data augmentation and imbalanced fault classification in industrial big data environments.     

SVM-ABC based cancer microarray (gene expression) hybrid method for data classification

Microarray technology presents a challenge due to the large dimensionality of the data, which can be difficult to interpret. To address this challenge, the article proposes a feature extraction-based cancer classification technique coupled with artificial bee colony optimization (ABC) algorithm. The ABC-support vector machine (SVM) method is used to classify the lung cancer datasets and compared them with existing techniques in terms of precision, recall, F-measure, and accuracy. The proposed ABC-SVM has the advantage of dealing with complex nonlinear data, providing good flexibility. Simulation analysis was conducted with 30% of the data reserved for testing the proposed method. The results indicate that the proposed attribute classification technique, which uses fewer genes, performs better than other modalities. The classifiers, such as naïve Bayes, multi-class SVM, and linear discriminant analysis, were also compared and the proposed method outperformed these classifiers and state-of-the-art techniques. Overall, this study demonstrates the potential of using intelligent algorithms and feature extraction techniques to improve the accuracy of cancer diagnosis using microarray gene expression data.     

一种面向不平衡数据集的核Fisher线性判别分析方法

实际应用中,很多分类问题是面向不平衡数据的分类,而不平衡数据集会导致许多分类器的性能下降。文中介绍核Fisher线性判别分析的分类机制,分析不平衡数据导致核Fisher线性判别分析失效的原因,进而提出一种加权核Fisher线性判别分析方法。该方法通过调整两类样本的核协方差矩阵对核类内离散度矩阵的贡献, 可克服不平衡数据对分类性能的影响。为进一步测试该方法, 对UCI数据集进行实验测试,实验结果表明该方法可有效改进分类器的分类性能。     

Intelligent fault diagnosis of rotating machinery using infrared thermal image

This study presents a new intelligent diagnosis system for classification of different machine conditions using data obtained from infrared thermography. In the first stage of this proposed system, two-dimensional discrete wavelet transform is used to decompose the thermal image. However, the data attained from this stage are ordinarily high dimensionality which leads to the reduction of performance. To surmount this problem, feature selection tool based on Mahalanobis distance and relief algorithm is employed in the second stage to select the salient features which can characterize the machine conditions for enhancing the classification accuracy. The data received from the second stage are subsequently utilized to intelligent diagnosis system in which support vector machines and linear discriminant analysis methods are used as classifiers. The results of the proposed system are able to assist in diagnosing of different machine conditions.