Recognition of control chart patterns using an intelligent technique

Control chart patterns (CCPs) are important statistical process control tools for determining whether a process is run in its intended mode or in the presence of unnatural patterns. Automatic recognition of abnormal patterns in control charts has seen increasing demands nowadays in the manufacturing processes. This paper presents a novel hybrid intelligent method for recognition of common types of CCP. The proposed method includes three main modules: the feature extraction module, the classifier module and optimization module. In the feature extraction module, a proper set of the shape features and statistical features is proposed as the efficient characteristic of the patterns. In the classifier module multilayer perceptron neural network and support vector machine (SVM) are investigated. In support vector machine training, the hyper-parameters have very important roles for its recognition accuracy. Therefore, in the optimization module, improved bees algorithm is proposed for selecting of appropriate parameters of the classifier. Simulation results show that the proposed algorithm has very high recognition accuracy.     

Recognition of control chart patterns using improved selection of features

Recognition of various control chart patterns (CCPs) can significantly reduce the diagnostic search process. Feature-based approaches can facilitate efficient pattern recognition. The full potentiality of feature-based approaches can be achieved by using the optimal set of features. In this paper, a set of seven most useful features is selected using a classification and regression tree (CART)-based systematic approach for feature selection. Based on these features, eight most commonly observed CCPs are recognized using heuristic and artificial neural network (ANN) techniques. Extensive performance evaluation of the two types of recognizers reveals that both these recognizers result in higher recognition accuracy than the earlier reported feature-based recognizers. In this work, various features are extracted from the control chart plot of actual process data in such a way that their values become independent of the process mean and standard deviation. Thus, the developed feature-based CCP recognizers can be applicable to any general process.     

Improved statistical features-based control chart patterns recognition using ANFIS with fuzzy clustering

Neural Computing and Applications - Various types of abnormal control chart patterns can be linked to certain assignable causes in industrial processes. Hence, control chart patterns recognition...     

Identification of control chart patterns using wavelet filtering and robust fuzzy clustering

This paper proposes a hybrid framework composed of filtering module and clustering module to identify six common types of control chart patterns, including natural pattern, cyclic pattern, upward shift, downward shift, upward trend, and downward trend. In particular, a multi-scale wavelet filter is designed for denoising and its performance is compared to single-scale filters, including mean filter and exponentially weighted moving average (EWMA) filter. Moreover, three fuzzy clustering algorithms, based on fuzzy c means (FCM), entropy fuzzy c means (EFCM) and kernel fuzzy c means (KFCM), are adopted to compare their performance of pattern classification. Experimental results demonstrate that the excellent performance of EFCM and KFCM against outliers, especially in the case of high noise level embedded in the input data. Therefore, a hybrid framework combining wavelet filter with robust fuzzy clustering is suggested and proposed in this paper. Compared to neural network based approaches, the proposed method provides a promising way for the on-line recognition of control chart patterns because of its efficient computation and robustness against outliers.     

Fuzzy SVM with a new fuzzy membership function

It is known that with a proper fuzzy membership function, a fuzzy support vector machine can effectively reduce the effects of outliers when solving the classification problem. In this paper, a new fuzzy membership function is proposed to the nonlinear fuzzy support vector machine. The fuzzy membership is calculated in the feature space and is represented by kernels. This method gives good performance on reducing the effects of outliers and significantly improves the classification accuracy and generalization.     

A hybrid approach for identification of concurrent control chart patterns

Control chart patterns (CCPs) are widely used to identify the potential process problems in modern manufacturing industries. The earliest statistical techniques, including chart and R chart, are respectively used for monitoring process mean and process variance. Recently, pattern recognition techniques based on artificial neural network (ANN) are very popular to be applied to recognize unnatural CCPs. However, most of them are limited to recognize simple CCPs arising from single type of unnatural variation. In other words, they are incapable to handle the problem of concurrent CCPs where two types of unnatural variation exist together within the manufacturing process. To facilitate the research gap, this paper presents a hybrid approach based on independent component analysis (ICA) and decision tree (DT) to identify concurrent CCPs. Without loss of generality, six types of concurrent CCPs are used to validate the proposed method. Experimental results show that the proposed approach is very successful to handle most of the concurrent CCPs. The proposed method has two limitations in real application: it needs at least two concurrent CCPs to reconstruct their source patterns and it may be incapable to handle the concurrent pattern incurred by two correlated process (“upward trend” and “upward shift”).     

基于融合特征与支持向量机的控制图模式识别

为了提高控制图模式识别的精度, 将控制图模式的原始特征与形状特征相融合得到分类特征, 并采用支持向量机进行模式分类的控制图模式识别。融合所得特征既保持了控制图模式的原始特征所蕴涵的模式全局特性信息, 又通过引入形状特征对部分易混淆模式的局部几何特性进行强化, 使不同模式间的区分度得到有效提高; 而以支持向量机作为模式分类器保证方法在高维度特征和小样本条件下也能获得较好的识别性能。仿真实验结果表明所提方法的识别精度相比其他几种基于形状特征的控制图模式识别方法有明显提高。     

Recognition of concurrent control chart patterns using wavelet transform decomposition and multiclass support vector machines

Statistical process control charts have been widely utilized for monitoring process variation in many applications. Nonrandom patterns exhibited by control charts imply certain potential assignable causes that may deteriorate the process performance. Though some effective approaches to recognition of control chart patterns (CCPs) have been developed, most of them only focus on recognition and analysis of single patterns. A hybrid approach by integrating wavelet transform and improved particle swarm optimization-based support vector machine (P-SVM) for on-line recognition of concurrent CCPs is developed in this paper. A statistical correlation coefficient is used to determine whether the input pattern is a single or concurrent CCP. Based on wavelet transform, a raw concurrent pattern signal is decomposed into two basic pattern signals, which can be recognized by multiclass SVMs. The performance of the hybrid approach is evaluated by simulation experiments, and numerical and graphical results are provided to demonstrate that the proposed approach can perform effectively and efficiently in on-line CCP recognition task.     

一种新的混合核函数支持向量机

针对单核函数支持向量机性能的局限性问题,提出将sigmoid核函数与高斯核函数组成一种新的混合核函数支持向量机.高斯核是典型的局部核;sigmoid核在神经网络中被证明具有良好的全局分类性能.新混合核函数结合二者的优点,其支持向量机的分类性能优于由单核函数构成的支持向量机,实验结果表明该方法的有效性.     

A hybrid learning-based model for on-line detection and analysis of control chart patterns

Unnatural control chart patterns (CCPs) are associated with a particular set of assignable causes for process variation. Therefore, effectively recognizing CCPs can substantially narrow down the set of possible causes to be examined, and accelerate the diagnostic search. In recent years, neural networks (NNs) have been successfully used to the CCP recognition task. The emphasis has been on the CCP detection rather than more detailed quantification of information of the CCP. Additionally, a common problem in existing NN-based CCP recognition methods is that of discriminating between various types of CCP that share similar features in a real-time recognition scheme. This work presents a hybrid learning-based model, which integrates NN and DT learning techniques, to detect and discriminate typical unnatural CCPs, while identifying the major parameter (such as the shift displacement or trend slope) and starting point of the CCP detected. The performance of the model was evaluated by simulation, and numerical and graphical results that demonstrate that the proposed model performs effectively and efficiently in on-line CCP recognition task are provided. Although this work considers the specific application of a real-time CCP recognition model for the individuals (X) chart, the proposed learning-based methodology can be applied to other control charts (such as the X-bar chart).     

Fuzzy logic based assignable cause diagnosis using control chart patterns

Control chart patterns, besides determining the presence of assignable causes, also provide hints on the nature of assignable cause(s) present. Relating the patterns exhibited on the control chart to assignable causes is an ambiguous and vague task especially when multiple patterns co-exist. In this work, a rule based fuzzy inference system is developed for control chart to prioritize the control chart causes based on the accumulated evidence. When a process goes out of control, search for assignable causes can be assisted by the priorities assigned to the causes. For an in-control process, developing patterns can be tracked and preventive action can be taken to prevent the process from going out of control.     

Feature-based recognition of control chart patterns

Control charts primarily in the form of chart are widely used to identify the situations when control actions will be needed for manufacturing systems. Various types of patterns are observed in control charts. Identification of these control chart patterns (CCPs) can provide clues to potential quality problems in the manufacturing process. Each type of control chart pattern has its own geometric shape and various related features can represent this shape. Feature-based approaches can facilitate efficient pattern recognition since extracted shape features represent the main characteristics of the patterns in a condensed form. In this paper, a set of eight new features, extraction of which does not call for utilizing the experience and skill of the user in any form, is presented. Two feature-based approaches using heuristics and artificial neural network (ANN) are developed, which are capable of recognizing eight most commonly observed CCPs including stratification and systematic patterns. Relative performances of the feature-based heuristic and feature-based ANN recognizers are extensively studied using synthetic pattern data. The feature-based ANN recognizer results in better recognition performance and generalization compared to the feature-based heuristic recognizer.     

复高斯小波核函数的支持向量机研究

针对基于常用核函数的支持向量机在非线性系统参数辨识及预测方面的不足之处,构建了一种新的核函数——复高斯小波函数核函数。首先证明了新构建的核函数的正确性,即满足Mercy条件,表明其可以作为核函数;然后构建基于该核函数的支持向量机,并将该支持向量机用于非线性系统的辨识和未知部分的预测。通过与常用核函数构建的支持向量机的仿真结果进行对比,验证了该方法的正确性和有效性。     

动态权值混合C-均值模糊核聚类算法*

PCM算法存在聚类重叠的缺陷,PFCM算法同时利用隶属度与典型值把数据样本划分到不同的类中,提高了算法的抗噪能力,但PFCM算法对样本分布不均衡的聚类效果并不十分理想。针对此不足,可以通过Mercer核把原来的数据空间映射到特征空间,并为特征空间的每个向量分配一个动态权值,从而得到特征空间内的目标函数。理论分析和实验结果表明,相对于其他经典模糊聚类算法,新算法具有更好的健壮性和聚类效果。     

Recognition of mixture control chart patterns based on fusion feature reduction and fireworks algorithm-optimized MSVM

Pattern Analysis and Applications - Unnatural control chart patterns (CCPs) can be associated with the quality problems of the production process. It is quite critical to detect and identify these...     

基于切比雪夫核的SVM在语音识别中的应用

支持向量机的核函数因参数寻优问题,产生了额外计算量,从而降低了在语音识别应用系统中的实时性.鉴于以上弊端,在语音识别系统中,运用了一种基于切比雪夫多项式的核函数.该函数在训练过程中能够获得更少的支持向量个数,同时该函数结合了高斯核函数的优良性能,对广义的切比雪夫核函数进行了适当的改进得到修正切比雪夫核函数.实验运用了两个不同的语音数据库分别进行了对比实验,取得了较为理想的效果,提高了支持向量机的泛化能力及语音识别系统的鲁棒性.     

Design of semi-tensor product-based kernel function for SVM nonlinear classification

The kernel function method in support vector machine (SVM) is an excellent tool for nonlinear classification. How to design a kernel function is difficult for an SVM nonlinear classification problem, even for the polynomial kernel function. In this paper, we propose a new kind of polynomial kernel functions, called semi-tensor product kernel (STP-kernel), for an SVM nonlinear classification problem by semi-tensor product of matrix (STP) theory. We have shown the existence of the STP-kernel function and verified that it is just a polynomial kernel. In addition, we have shown the existence of the reproducing kernel Hilbert space (RKHS) associated with the STP-kernel function. Compared to the existing methods, it is much easier to construct the nonlinear feature mapping for an SVM nonlinear classification problem via an STP operator.     

基于多种核函数的SVM在垃圾邮件过滤中的应用

采用TF-IDF和Bernoulli两种模型构造邮件向量,首先详细测试了CHI降维策略对线性支持向量机进行邮件分类的影响。将基于核函数的支持向量机引入到垃圾邮件过滤中,对基于线性核、多项式核和径向基核的支持向量机在邮件分类中的准确率和训练时间进行了比较,分析了训练样本不平衡对分类的影响,并从理论上对实验结果进行了分析,实验结果证明基于径向基核函数的SVM分类器对垃圾邮件有较好的过滤效果。