Dynamic process fault monitoring based on neural network and PCA

A newly developed method, NNPCA, integrates two data driven techniques, neural network (NN) and principal component analysis (PCA), for process monitoring. NN is used to summarize the operating process information into a nonlinear dynamic mathematical model. Chemical dynamic processes are so complex that they are presently ahead of theoretical methods from a fundamental physical standpoint. NN functions as the nonlinear dynamic operator to remove processes' nonlinear and dynamic characteristics. PCA is employed to generate simple monitoring charts based on the multivariable residuals derived from the difference between the process measurements and the neural network prediction. It can evaluate the current performance of the process. Examples from the recent monitoring practice in the industry and the large-scale system in the Tennessee Eastman process problem are presented to help the reader delve into the matter.     

基于主成分机器学习算法的慢性肝病的智能预测新方法

运用新一代信息技术快速预测慢性肝病的机理和特征,是提高慢性肝病诊断率的有效途径。运用主成分分析机器学习算法,对描述慢性肝病的多项指标属性项进行降维处理,结合神经网络学习,构建了慢性肝病预测模型。实验分析了125组20维慢性肝病患者的医学检验指标数据项,利用ROC(Receiver Operating Characteristic)曲线优选出13维指标项作为慢性肝病敏感度高的检验指标属性项。通过主成分分析将13维指标项降至5维综合数据项。神经网络训练115组检验指标样本集,剩余10组样本集作为测试样本。与原始20维数据作为神经网络输入相比,所提模型不仅降低了复杂度,且预测精度提高了15.07%。     

An improved PCA scheme for sensor FDI: Application to an air quality monitoring network

In this paper a sensor fault detection and isolation procedure based on principal component analysis (PCA) is proposed to monitor an air quality monitoring network. The PCA model of the network is optimal with respect to a reconstruction error criterion. The sensor fault detection is carried out in various residual subspaces using a new detection index. For our application, this index improves the performance compared to classical detection index SPE. The reconstruction approach allows, on one hand, to isolate the faulty sensors and, on the other hand, to estimate the fault amplitudes.     

Projection based MIMO control performance monitoring: I—covariance monitoring in state space

In this paper we propose a new control performance monitoring method based on subspace projections. We begin with a state space model of a generally non-square process and derive the minimum variance control (MVC) law and minimum achievable variance in a state feedback form. We derive a multivariate time delay (MTD) matrix for use with our extended state space formulation, which implicitly is equivalent to the interactor matrix. We show how the minimum variance output space can be considered an optimal subspace of the general closed-loop output space and propose a simple control performance calculation which uses orthogonal projection of filtered output data onto past closed-loop data. Finally, we propose a control performance monitoring technique based on the output covariance and diagnose the cause of suboptimal control performance using generalized eigenvector analysis. The proposed methods are demonstrated on a few simulated examples and an industrial wood waste burning power boiler.     

神经网络在软件失效预测中的性能比较和研究

在软件开发的早期预测有失效倾向的软件模块,能够极大地提高软件的质量.软件失效预测中的一个普遍问题是数据中噪声的存在.神经网络具有鲁棒性而且对噪声有很强的抑制能力.不同结构的神经网络在训练算法和应用领域都有差异.该文主要就软件失效预测这个应用领域叙述几种适用的网络,并比较这几种网络在训练结果和性能上的差异.上述方法在SDH通信软件的失效预测中得到了成功的应用.试验结果显示虽然MLP、PNN、LVQ网络都能解决这类模式分类问题,但是只有MLP网络训练结果比较稳定,在不同的数据集上训练出的网络都有很好的预测效果.     

A general theory of a class of linear neural nets for principal and minor component analysis

This paper presents a unified theory of a class of learning neural nets for principal component analysis (PCA) and minor component analysis (MCA). First, some fundamental properties are addressed which all neural nets in the class have in common. Second, a subclass called the generalized asymmetric learning algorithm is investigated, and the kind of asymmetric structure which is required in general to obtain the individual eigenvectors of the correlation matrix of a data sequence is clarified. Third, focusing on a single-neuron model, a systematic way of deriving both PCA and MCA learning algorithms is shown, through which a relation between the normalization in PCA algorithms and that in MCA algorithms is revealed. This work was presented, in part, at the Third International Symposium on Artificial Life and Robotics, Oita, Japan, January 19–21, 1998     

一种全局收敛的PCA神经网络学习算法

主元分析(PCA)也称为K-L变换是进行特征提取的一种重要方法。近年来,为了处理海量数据,许多基于Hebbian学习算法的PCA神经网络被提出来。传统的算法,通常不能保证其收敛性或者收敛速度较慢。基于CRLS神经网络,本文提出了一种新的确保权向量收敛的学习算法,本算法无须在计算中规格化权向量。同时也证明了该学习算法使得权向量收敛到最大特征值所对应的特征向量。实验表明,与传统的CRLS神经网络比较,本文算法准确性得到极大提高。     

Assessment of water quality variation of a monitoring network using exploratory factor analysis and empirical orthogonal function

This study suggests a systematic assessment method that jointly uses the exploratory factor analysis (EFA) and empirical orthogonal function (EOF-patterns) of Principal Component Analysis (PCA) to assess the water quality variation of the monitoring network of Nakdong River, Korea, in which 28 stations measuring 15 water quality parameters are located. The EFA results showed the monitoring stations to be distinguished by two main factors. The representative stations of which the variance was almost explained by the specific factor were selected. We applied PCA to the monitoring data of representative stations, and then analyzed the EOF-patterns that indicate the characteristics of water-quality variation for each factor. With the interpretation of main factors and EOF-patterns causing dominant water quality variations, the monitoring network of Nakdong River could be spatially and seasonally evaluated according to the contribution of each factor.     

Genetic algorithms for feature selection of image analysis-based quality monitoring model: An application to an iron mine

Measuring the quality parameters of materials at mines is difficult and a costly job. In this paper, an image analysis-based method is proposed efficiently and cost effectively that determines the quality parameters of material. The image features are extracted from the samples collected from a mine and modeled using neural networks against the actual grade values of the samples generated by chemical analysis. The dimensions of the image features are reduced by applying the genetic algorithm. The results showed that only 39 features out of 189 features are sufficient to model the quality parameter. The model was tested with the testing data set and the result revealed that the estimated grade values are in good agreement with the real grade values (R²=0.77). The developed method was then applied to a case study mine of iron ore. The case study results show that proposed image-based algorithm can be a good alternative for estimating quality parameters of materials at a mine site. The effectiveness of the proposed method was verified by applying it on a limestone deposit and the results revealed that the method performed equally well for the limestone deposit.     

A globally convergent learning algorithm for PCA neural networks

Principal component analysis (PCA) by neural networks is one of the most frequently used feature extracting methods. To process huge data sets, many learning algorithms based on neural networks for PCA have been proposed. However, traditional algorithms are not globally convergent. In this paper, a new PCA learning algorithm based on cascade recursive least square (CRLS) neural network is proposed. This algorithm can guarantee the network weight vector converges to an eigenvector associated with the largest eigenvalue of the input covariance matrix globally. A rigorous mathematical proof is given. Simulation results show the effectiveness of the algorithm.     

An intelligent system for sorting pistachio nut varieties

An intelligent pistachio nut sorting system combining acoustic emissions analysis, Principal Component Analysis (PCA) and Multilayer Feedforward Neural Network (MFNN) classifier was developed and tested. To evaluate the performance of the system 3200 pistachio nuts from four native Iranian pistachio nut varieties were used. Each variety was consisted of 400 split-shells and 400 closed-shells nut. The nuts were randomly selected, slide down a chute, inclined 60° above the horizontal, on which nuts slide down to impact a steel plate and their acoustic signals were recorded from the impact. Sound signals in the time-domain are saved for subsequent analysis. The method is based on feature generation by Fast Fourier Transform (FFT), feature reduction by PCA and classification by MFNN. Features such as amplitude, phase and power spectrum of sound signals are computed via a 1024-point FFT. By using PCA more than 98% reduction in the dimension of feature vector is achieved. To find the optimal MFNN classifier, various topologies each having different number of neurons in the hidden layer were designed and evaluated. The best MFNN model had a 40–12–4 structure, that is, a network having one hidden layer with 40 neurons at its input, 12 neurons in the hidden layer and 4 neurons (pistachio varieties) in the output layer. The selection of the optimal model was based on the examination of mean square error, correlation coefficient and correct separation rate (CSR). The CSR or total weighted average in system accuracy for the 40–12–4 structure was 97.5%, that is, only 2.5% of nuts were misclassified.     

基于改进BP神经网络的羊肉价格预测

在羊肉价格预测问题的研究中,羊肉价格有着严重的非线性、高噪声和影响因素难以确定等特点,高效准确的预测羊肉价格是十分困难的。传统方法对羊肉价格的预测往往主观性较强或过分依赖羊肉价格间的线性关系,导致预测的精度较低,不够准确。针对羊肉价格预测难题及BP神经网络存在的缺陷,提出一种主成分分析与LM(Lvevenberg-Marquardt)算法结合使用的BP神经网络改进模型。首先定性分析影响羊肉价格的因子,然后采用主成分分析方法消除噪声并筛选主要影响因子作为神经网络输入,最后采用基于LM算法的BP神经网络进行训练学习与预测。仿真结果表明,模型的预测值与实际值十分接近,预测精度良好,提高了仿真预测的效率,为羊肉价格的预测提供了一种可行且有效的方法。     

Process monitoring of iron-making process in a blast furnace with PCA-based methods

Incidents happening in the blast furnace will strongly affect the stability and smoothness of the iron-making process. Thus far, diagnosis of abnormalities in furnaces still mainly relies on the personal experiences of individual workers in many iron works. In this paper, principal component analysis (PCA)-based algorithms are developed to monitor the iron-making process and achieve early abnormality detection. Because the process exhibits a non-normal distribution and a time-varying nature in the measurement data, a static convex hull-based PCA algorithm (SCHPCA) which replaces the traditional T²-based abnormality detection logic with the convex hull-based abnormality detection logic, and its moving window version, called the moving window convex hull-based PCA algorithm (MWCHPCA) are proposed, respectively. These two algorithms are tested on the real process data to verify their effectiveness in the early abnormality detection of iron-making process.     

Gene expression time series modeling with principal component and neural network

In this work, gene expression time series models have been constructed by using principal component analysis (PCA) and neural network (NN). The main contribution of this paper is to develop a methodology for modeling numerical gene expression time series. The PCA-NN prediction models are compared with other popular continuous prediction methods. The proposed model can give us the extracted features from the gene expressions time series and the orders of the prediction accuracies. Therefore, the model can help practitioners to gain a better understanding of a cell cycle, and to find the dependency of genes, which is useful for drug discoveries. Based on the results of two public real datasets, the PCA-NN method outperforms the other continuous prediction methods. In the time series model, we adapt Akaike's information criteria (AIC) tests and cross-validation to select a suitable NN model to avoid the overparameterized problem.     

基于无线传感器网络技术的水质监测系统

随着人们对赖以生存的水环境的重视,水质实时在线监测系统需求迫切。基于对无线传感器网络技术的研究,以无线传感器网络为通讯手段,结合水质评价模型,设计了一个水质在线监测系统。实现对特定水域的实时监测,对提高水质保护和水资源合理利用具有一定的意义。     

A patent quality analysis for innovative technology and product development

Enterprises evaluate intellectual property rights and the quality of patent documents in order to develop innovative products and discover state-of-the-art technology trends. The product technologies covered by patent claims are protected by law, and the quality of the patent insures against infringement by competitors while increasing the worth of the invention. Thus, patent quality analysis provides a means by which companies determine whether or not to customize and manufacture innovative products. Since patents provide significant financial protection for businesses, the number of patents filed is increasing at a fast pace. Companies which cannot process patent information or fail to protect their innovations by filing patents lose market competitiveness. Current patent research is needed to estimate the quality of patent documents. The purpose of this research is to improve the analysis and ranking of patent quality. The first step of the proposed methodology is to collect technology specific patents and to extract relevant patent quality performance indicators. The second step is to identify the key impact factors using principal component analysis. These factors are then used as the input parameters for a back-propagation neural network model. Patent transactions help judge patent quality and patents which are licensed or sold with intellectual property usage rights are considered high quality patents. This research collected 283 patents sold or licensed from the news of patent transactions and 116 patents which were unsold but belong to the technology specific domains of interest. After training the patent quality model, 36 historical patents are used to verify the performance of the trained model. The match between the analytical results and the actual trading status reached an 85% level of accuracy. Thus, the proposed patent quality methodology evaluates the quality of patents automatically and effectively as a preliminary screening solution. The approach saves domain experts valuable time targeting high value patents for R&D commercialization and mass customization of products.     

Ensemble model of wastewater treatment plant based on rich diversity of principal component determining by genetic algorithm for status monitoring

Wastewater treatment plants (WWTPs) is a complex process, effective process monitoring can make it stable and prevent the destruction of the ecological environment. Principal component analysis (PCA) has been widely used in process monitoring. However, most PCA-based methods construct a single PCA model using several principal components (PCs), causing loss of information on some faults and less generalization ability of the PCA model. Thus, this study proposed a novel ensemble process monitoring method based on genetic algorithm (GA) for selective diversity of PCs. GA is used to determine a set of principal component subspaces with the greatest diversity as the base models. Bayesian inference is adopted to combine the results of base models into a probability index. Cases study on TE benchmark process and an actual WWTP show the excellent performance of the proposed method compared with several PCA-based methods and the strong generalization ability of the ensemble model.     

TM和SAR影像主分量变换融合法

探讨基于主分量变换法融合TM和SAR影像,采用包含广东省三水城的TM和航空SAR影像融合结果表明:主分量变换融合法不仅能提高多光谱影像的信息量和空间分解力,而且很大程度上保留了原多光谱影像的光谱特征。因此多光谱影像经采用主分量变换融合法与SAR融合后,在量测和解译能力上都有提高。与HIS变换融合法相比,主分量变换融合法对光谱特征的扭曲程度没有HIS融合法严重,因此它必将在实际中得到更广泛的应用。     

High-voltage equipment condition monitoring and diagnosis system based on information fusion

As high-voltage electric equipment has complex structure and works in harsh environments, fiber Bragg grating (FBG) sensors are applied to realize the real-time monitoring of some parameters in which temperature is the main parameter. Using FBG sensors to monitor temperature of high-voltage electric equipment can overcome the disadvantages of harsh monitoring environment such as high-voltage, big current, strong electromagnetic interference and so on. The fault of high-voltage electric equipment is difficult to be distinguished as there may be many different reasons. The traditional or simple methods cannot totally meet the demand of fault diagnosis of high-voltage electric equipment. First, taking neural network as a classifier to distinguish different fault types from complex fault information in the feature layer can supply a good foundation to final information fusion diagnosis. Second, Dempster–Shafer evidence theory is used to make a comprehensive diagnosis of fault information in the decision layer. All the uses above can increase the speed and accuracy of diagnosis and have practical significance. The fault diagnosis system shows good results and provides an effective way to realize the real-time condition monitoring and more accurate fault diagnosis of high-voltage electric equipment.     

基于无线传感器网络的水质监测系统设计

在研究无线传感器网络及Zigbee协议标准的基础上,对远程实时水质监测系统进行了分析.提出了基于Zigbee无线传感器网络与互联网结合的远程实时水质监测系统架构.设计了基于无线传感器的水质监测网络体系结构,实现了水质监测参数的荻取及传输.