Recognition of control chart patterns using an intelligent technique

Control chart patterns (CCPs) are important statistical process control tools for determining whether a process is run in its intended mode or in the presence of unnatural patterns. Automatic recognition of abnormal patterns in control charts has seen increasing demands nowadays in the manufacturing processes. This paper presents a novel hybrid intelligent method for recognition of common types of CCP. The proposed method includes three main modules: the feature extraction module, the classifier module and optimization module. In the feature extraction module, a proper set of the shape features and statistical features is proposed as the efficient characteristic of the patterns. In the classifier module multilayer perceptron neural network and support vector machine (SVM) are investigated. In support vector machine training, the hyper-parameters have very important roles for its recognition accuracy. Therefore, in the optimization module, improved bees algorithm is proposed for selecting of appropriate parameters of the classifier. Simulation results show that the proposed algorithm has very high recognition accuracy.     

Recognition of control chart patterns using improved selection of features

Recognition of various control chart patterns (CCPs) can significantly reduce the diagnostic search process. Feature-based approaches can facilitate efficient pattern recognition. The full potentiality of feature-based approaches can be achieved by using the optimal set of features. In this paper, a set of seven most useful features is selected using a classification and regression tree (CART)-based systematic approach for feature selection. Based on these features, eight most commonly observed CCPs are recognized using heuristic and artificial neural network (ANN) techniques. Extensive performance evaluation of the two types of recognizers reveals that both these recognizers result in higher recognition accuracy than the earlier reported feature-based recognizers. In this work, various features are extracted from the control chart plot of actual process data in such a way that their values become independent of the process mean and standard deviation. Thus, the developed feature-based CCP recognizers can be applicable to any general process.     

Improved statistical features-based control chart patterns recognition using ANFIS with fuzzy clustering

Neural Computing and Applications - Various types of abnormal control chart patterns can be linked to certain assignable causes in industrial processes. Hence, control chart patterns recognition...     

Identification of control chart patterns using wavelet filtering and robust fuzzy clustering

This paper proposes a hybrid framework composed of filtering module and clustering module to identify six common types of control chart patterns, including natural pattern, cyclic pattern, upward shift, downward shift, upward trend, and downward trend. In particular, a multi-scale wavelet filter is designed for denoising and its performance is compared to single-scale filters, including mean filter and exponentially weighted moving average (EWMA) filter. Moreover, three fuzzy clustering algorithms, based on fuzzy c means (FCM), entropy fuzzy c means (EFCM) and kernel fuzzy c means (KFCM), are adopted to compare their performance of pattern classification. Experimental results demonstrate that the excellent performance of EFCM and KFCM against outliers, especially in the case of high noise level embedded in the input data. Therefore, a hybrid framework combining wavelet filter with robust fuzzy clustering is suggested and proposed in this paper. Compared to neural network based approaches, the proposed method provides a promising way for the on-line recognition of control chart patterns because of its efficient computation and robustness against outliers.     

Fuzzy SVM with a new fuzzy membership function

It is known that with a proper fuzzy membership function, a fuzzy support vector machine can effectively reduce the effects of outliers when solving the classification problem. In this paper, a new fuzzy membership function is proposed to the nonlinear fuzzy support vector machine. The fuzzy membership is calculated in the feature space and is represented by kernels. This method gives good performance on reducing the effects of outliers and significantly improves the classification accuracy and generalization.     

A hybrid approach for identification of concurrent control chart patterns

Control chart patterns (CCPs) are widely used to identify the potential process problems in modern manufacturing industries. The earliest statistical techniques, including chart and R chart, are respectively used for monitoring process mean and process variance. Recently, pattern recognition techniques based on artificial neural network (ANN) are very popular to be applied to recognize unnatural CCPs. However, most of them are limited to recognize simple CCPs arising from single type of unnatural variation. In other words, they are incapable to handle the problem of concurrent CCPs where two types of unnatural variation exist together within the manufacturing process. To facilitate the research gap, this paper presents a hybrid approach based on independent component analysis (ICA) and decision tree (DT) to identify concurrent CCPs. Without loss of generality, six types of concurrent CCPs are used to validate the proposed method. Experimental results show that the proposed approach is very successful to handle most of the concurrent CCPs. The proposed method has two limitations in real application: it needs at least two concurrent CCPs to reconstruct their source patterns and it may be incapable to handle the concurrent pattern incurred by two correlated process (“upward trend” and “upward shift”).     

Recognition of concurrent control chart patterns using wavelet transform decomposition and multiclass support vector machines

Statistical process control charts have been widely utilized for monitoring process variation in many applications. Nonrandom patterns exhibited by control charts imply certain potential assignable causes that may deteriorate the process performance. Though some effective approaches to recognition of control chart patterns (CCPs) have been developed, most of them only focus on recognition and analysis of single patterns. A hybrid approach by integrating wavelet transform and improved particle swarm optimization-based support vector machine (P-SVM) for on-line recognition of concurrent CCPs is developed in this paper. A statistical correlation coefficient is used to determine whether the input pattern is a single or concurrent CCP. Based on wavelet transform, a raw concurrent pattern signal is decomposed into two basic pattern signals, which can be recognized by multiclass SVMs. The performance of the hybrid approach is evaluated by simulation experiments, and numerical and graphical results are provided to demonstrate that the proposed approach can perform effectively and efficiently in on-line CCP recognition task.     

一种新的混合核函数支持向量机

针对单核函数支持向量机性能的局限性问题,提出将sigmoid核函数与高斯核函数组成一种新的混合核函数支持向量机.高斯核是典型的局部核;sigmoid核在神经网络中被证明具有良好的全局分类性能.新混合核函数结合二者的优点,其支持向量机的分类性能优于由单核函数构成的支持向量机,实验结果表明该方法的有效性.     

Fuzzy logic based assignable cause diagnosis using control chart patterns

Control chart patterns, besides determining the presence of assignable causes, also provide hints on the nature of assignable cause(s) present. Relating the patterns exhibited on the control chart to assignable causes is an ambiguous and vague task especially when multiple patterns co-exist. In this work, a rule based fuzzy inference system is developed for control chart to prioritize the control chart causes based on the accumulated evidence. When a process goes out of control, search for assignable causes can be assisted by the priorities assigned to the causes. For an in-control process, developing patterns can be tracked and preventive action can be taken to prevent the process from going out of control.     

Feature-based recognition of control chart patterns

Control charts primarily in the form of chart are widely used to identify the situations when control actions will be needed for manufacturing systems. Various types of patterns are observed in control charts. Identification of these control chart patterns (CCPs) can provide clues to potential quality problems in the manufacturing process. Each type of control chart pattern has its own geometric shape and various related features can represent this shape. Feature-based approaches can facilitate efficient pattern recognition since extracted shape features represent the main characteristics of the patterns in a condensed form. In this paper, a set of eight new features, extraction of which does not call for utilizing the experience and skill of the user in any form, is presented. Two feature-based approaches using heuristics and artificial neural network (ANN) are developed, which are capable of recognizing eight most commonly observed CCPs including stratification and systematic patterns. Relative performances of the feature-based heuristic and feature-based ANN recognizers are extensively studied using synthetic pattern data. The feature-based ANN recognizer results in better recognition performance and generalization compared to the feature-based heuristic recognizer.     

Recognition of mixture control chart patterns based on fusion feature reduction and fireworks algorithm-optimized MSVM

Pattern Analysis and Applications - Unnatural control chart patterns (CCPs) can be associated with the quality problems of the production process. It is quite critical to detect and identify these...     

基于切比雪夫核的SVM在语音识别中的应用

支持向量机的核函数因参数寻优问题,产生了额外计算量,从而降低了在语音识别应用系统中的实时性.鉴于以上弊端,在语音识别系统中,运用了一种基于切比雪夫多项式的核函数.该函数在训练过程中能够获得更少的支持向量个数,同时该函数结合了高斯核函数的优良性能,对广义的切比雪夫核函数进行了适当的改进得到修正切比雪夫核函数.实验运用了两个不同的语音数据库分别进行了对比实验,取得了较为理想的效果,提高了支持向量机的泛化能力及语音识别系统的鲁棒性.     

Identification of a dominating instrument in polytimbral same-pitch mixes using SVM classifiers with non-linear kernel

In this paper we deal with the problem of identification of the dominating musical instrument in a recording containing simultaneous sounds of the same pitch. Sustained harmonic sounds from one octave of twelve instruments were considered. The training data set contains isolated sounds of two forms, one from selected musical instruments, and the other from the same mixed with artificial harmonic and noise sounds of lower amplitude. The test data set contains mixes of musical instrument sounds. A Support Vector Machine classifier was used for training and testing experiments, using a non-linear kernel. Additionally, we performed tests on data based on different recordings of instruments than those used in the training procedure described above. Results of these experiments are presented and discussed.     

Image classification without segmentation using a hybrid pyramid kernel

Image classification usually requires complicated segmentation to separate foreground objects from the background scene. However, the statistical content of a background scene can actually provide very useful information for classification. In this paper, we propose a new hybrid pyramid kernel which incorporates local features extracted from both dense regular grids and interest points for image classification, without requiring segmentation. Features extracted from dense regular grids can better capture information about the background scene, while interest points detected at corners and edges can better capture information about the salient objects. In our algorithm, these two local features are combined in both the spatial and the feature-space domains, and are organized into pyramid representations. In order to obtain better classification accuracy, we fine-tune the parameters involved in the similarity measure, and we determine discriminative regions by means of relevance feedback. From the experimental results, we observe that our algorithm can achieve a 6.37 % increase in performance as compared to other pyramid-representation-based methods. To evaluate the applicability of the proposed hybrid kernel to large-scale databases, we have performed a cross-dataset experiment and investigated the effect of foreground/background features on each of the kernels. In particular, the proposed hybrid kernel has been proven to satisfy Mercer’s condition and is efficient in measuring the similarity between image features. For instance, the computational complexity of the proposed hybrid kernel is proportional to the number of features.     

模糊支持向量机建筑物边缘特征提取方法研究

为解决边缘点与非边缘点过渡的模糊边缘,提出了一种模糊支持向量机的边缘检测算法。该算法选用图像3 3窗口4个方向的灰度梯度、梯度幅值和梯度方向组成6维特征向量,同时选用径向机核函数对样本特征向量升维到高维空间,在高维空间中构造最优分类超平面。同时,根据归一化后的梯度幅值来确定每个样本的隶属度,最后利用模糊支持向量机实现边缘检测。实验结果表明了模糊支持向量机边缘检测方法的可行性。     

Recognizing control chart patterns with neural network and numerical fitting

Control chart has been widely used to determine whether the state of machining process is stable or not, and pattern recognition technology is often used to automatically judge the changing modes of control chart. It is because that the abnormal patterns of a control chart can reveal the potential problem of machining quality. In order to improve the recognition rate and efficiency of control chart patterns, a neural network-numerical fitting (NN-NF) model is proposed to recognize different control chart patterns. A back propagation (BP) network is first used to recognize control chart patterns preliminarily. And then, numerical fitting method is adopted to estimate the parameters and specific types of the patterns, which is different from the traditional neural network-based control chart pattern recognition methods. Based on this, Monte Carlo simulation is used to generate training and testing data samples. The results of simulated experiment show that training time of this NN-NF model can be reduced. At the same time, the recognition rate can also be improved. At last, a real example is also provided to illustrate the NN-NF model.     

Adaptive fuzzy fault-tolerant control using Nussbaum-type function with state-dependent actuator failures

Neural Computing and Applications - This paper presents an adaptive fuzzy fault-tolerant tracking control for a class of unknown multi-variable nonlinear systems, with external disturbances,...     

Robust kernel discriminant analysis using fuzzy memberships

Linear discriminant analysis (LDA) is a simple but widely used algorithm in the area of pattern recognition. However, it has some shortcomings in that it is sensitive to outliers and limited to linearly separable cases. To solve these problems, in this paper, a non-linear robust variant of LDA, called robust kernel fuzzy discriminant analysis (RKFDA) is proposed. RKFDA uses fuzzy memberships to reduce the effect of outliers and adopts kernel methods to accommodate non-linearly separable cases. There have been other attempts to solve the problems of LDA, including attempts using kernels. However, RKFDA, encompassing previous methods, is the most general one. Furthermore, theoretical analysis and experimental results show that RKFDA is superior to other existing methods in solving the problems.     

Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach

The effective recognition of unnatural control chart patterns (CCPs) is a critical issue in statistical process control, as unnatural CCPs can be associated with specific assignable causes adversely affecting the process. Machine learning techniques, such as artificial neural networks (ANNs), have been widely used in the research field of CCP recognition. However, ANN approaches can easily overfit the training data, producing models that can suffer from the difficulty of generalization. This causes a pattern misclassification problem when the training examples contain a high level of background noise (common cause variation). Support vector machines (SVMs) embody the structural risk minimization, which has been shown to be superior to the traditional empirical risk minimization principle employed by ANNs. This research presents a SVM-based CCP recognition model for the on-line real-time recognition of seven typical types of unnatural CCP, assuming that the process observations are AR(1) correlated over time. Empirical comparisons indicate that the proposed SVM-based model achieves better performance in both recognition accuracy and recognition speed than the model based on a learning vector quantization network. Furthermore, the proposed model is more robust toward background noise in the process data than the model based on a back propagation network. These results show the great potential of SVM methods for on-line CCP recognition.