Fuzzy neural computing of coffee and tainted-water data from an electronic nose

In this paper we compare the ability of a fuzzy neural network and a common back-propagation network to classify odour samples that were obtained by an electronic nose employing semiconducting oxide conductometric gas sensors. Two different sample sets have been analysed: first, the aroma of three blends of commercial coffee, and secondly, the headspace of six different tainted-water samples. The two experimental data sets provide an excellent opportunity to test the ability of a fuzzy neural network due to the high level of sensor variability often experienced with this type of sensor. Results are presented on the application of three-layer fuzzy neural networks to electronic nose data. They demonstrate a considerable improvement in performance compared to a common back-propagation network.     

Handwritten Chinese Character Recognition Based on Primitive and Fuzzy Features via the SEART Neural Net Model

A handwritten Chinese character recognition method based on primitive and compound fuzzy features using the SEART neural network model is proposed. The primitive features are extracted in local and global view. Since handwritten Chinese characters vary a great deal, the fuzzy concept is used to extract the compound features in structural view. We combine the two categories of features and use a fast classifier, called the Supervised Extended ART (SEART) neural network model, to recognize handwritten Chinese characters. The SEART classifier has excellent performance, is fast, and has good generalization and exception handling abilities in complex problems. Using the fuzzy set theory in feature extraction and the neural network model as a classifier is helpful for reducing distortions, noise and variations. In spite of the poor thinning, a 90.24% recognition rate on average for the 605 test character categories was obtained. The database used is CCL/HCCR3 (provided by CCL, ITRI, Taiwan). The experiment not only confirms the feasibility of the proposed system, but also suggests that applying the fuzzy set theory and neural networks to recognition of handwritten Chinese characters is an efficient and promising approach.     

气体传感器阵列常用模式识别算法

模式识别在气体传感器阵列的测量中占有举足轻重的地位。介绍了k近邻法、聚类分析、判别函数分析、反向传播人工神经网络、主元分析法、概率神经网、学习向量量化、自组织映射、自适应共振网、遗传算法等气体传感器阵列常用模式识别算法的原理和特点。同时,指出了在应用中模式识别算法选择和评价的标准。     

Optimized Bayesian adaptive resonance theory mapping model using a rational quadratic kernel and Bayesian quadratic regularization

Applied Intelligence - Bayesian adaptive resonance theory (ART) and ARTMAP-based neural network classifier (known as BAM) are widely used and achieve good classification performance when solving...     

GOFAM: a hybrid neural network classifier combining fuzzy ARTMAP and genetic algorithm

Fuzzy ARTMAP (FAM), which is a supervised model from the adaptive resonance theory (ART) neural network family, is one of the conspicuous neural network classifier. The generalization/performance of FAM is affected by two important factors which are network parameters and presentation order of training data. In this paper we introduce a genetic algorithm to find a better presentation order of training data for FAM. The proposed method which is the combination of genetic algorithm with Fuzzy ARTMAP is called Genetic Ordered Fuzzy ARTMAP (GOFAM). To illustrate the effectiveness of GOFAM, several standard datasets from UCI repository of machine learning databases are experimented. The results are analyzed and compared with those from FAM and Ordered FAM which is used to determine a fixed order of training pattern presentation to FAM. Experimental results demonstrate the performance of GOFAM is much better than performance of Fuzzy ARTMAP and Ordered Fuzzy ARTMAP. In term of network size, GOFAM performs significantly better than FAM and Ordered FAM.     

GLCM based extraction of flame image texture features and KPCA-GLVQ recognition method for rotary kiln combustion working conditions

According to the pulverized coal combustion flame image texture features of the rotary-kiln oxide pellets sintering process,a combustion working condition recognition method based on the generalized learning vector(GLVQ) neural network is proposed.Firstly,the numerical flame image is analyzed to extract texture features,such as energy,entropy and inertia,based on grey-level co-occurrence matrix(GLCM) to provide qualitative information on the changes in the visual appearance of the flame.Then the kernel principal component analysis(KPCA) method is adopted to deduct the input vector with high dimensionality so as to reduce the GLVQ target dimension and network scale greatly.Finally,the GLVQ neural network is trained by using the normalized texture feature data.The test results show that the proposed KPCA-GLVQ classifer has an excellent performance on training speed and correct recognition rate,and it meets the requirement for real-time combustion working condition recognition for the rotary kiln process.     

基于神经网络的矿用红外瓦斯传感器检测模型的研究

文章简要介绍了瓦斯红外检测原理,指出了传统吸收型模型的不足,基于RBF神经网络的非线性逼近能力建立了一种红外瓦斯传感器检测模型,给出了RBF神经网络的组织,并对RBF神经网络进行了训练,得到了红外瓦斯传感器检测模型的RBF神经网络结构。实验结果表明,该模型误差小、精度高,可满足煤矿井下应用的需要。     

Distributed denial of service attack detection using an ensemble of neural classifier

The vulnerabilities in the Communication (TCP/IP) protocol stack and the availability of more sophisticated attack tools breed in more and more network hackers to attack the network intentionally or unintentionally, leading to Distributed Denial of Service (DDoS) attack. The DDoS attacks could be detected using the existing machine learning techniques such as neural classifiers. These classifiers lack generalization capabilities which result in less performance leading to high false positives. This paper evaluates the performance of a comprehensive set of machine learning algorithms for selecting the base classifier using the publicly available KDD Cup dataset. Based on the outcome of the experiments, Resilient Back Propagation (RBP) was chosen as base classifier for our research. The improvement in performance of the RBP classifier is the focus of this paper. Our proposed classification algorithm, RBPBoost, is achieved by combining ensemble of classifier outputs and Neyman Pearson cost minimization strategy, for final classification decision. Publicly available datasets such as KDD Cup, DARPA 1999, DARPA 2000, and CONFICKER were used for the simulation experiments. RBPBoost was trained and tested with DARPA, CONFICKER, and our own lab datasets. Detection accuracy and Cost per sample were the two metrics evaluated to analyze the performance of the RBPBoost classification algorithm. From the simulation results, it is evident that RBPBoost algorithm achieves high detection accuracy (99.4%) with fewer false alarms and outperforms the existing ensemble algorithms. RBPBoost algorithm outperforms the existing algorithms with maximum gain of 6.6% and minimum gain of 0.8%.     

GA-BP神经网络在下肢运动步态识别中的应用研究

为了提高下肢表面肌电信号步态识别的准确性,提出了一种基于遗传算法（GA）优化的BP神经网络分类器设计方法。首先,对采集的下肢表面肌电信号进行小波滤波及特征值提取,其次,构造基于GA优化的BP神经网络分类器,然后,以提取的表面肌电信号特征作为输入对分类器进行训练,最后利用训练好的分类器进行测试。实验结果表明,基于GA优化的BP神经网络分类器能成功识别下肢正常行走的五个步态,平均识别率达到98%以上,效果明显优于BP神经网络分类器的识别效果。     

用RCR特征和NN识别实时手绘工程草图

针对实时手绘工程草图(简称手绘草图)的识别，引入草图重心、重径距和正规化重径(RCR)等图形特征概念，提出手绘草图的神经网识别方法．该方法以图素具有统计意义的正规化重径作为特征、以图素交叉方式组织正规化重径的值作为学习样本，应用弹力传播的Rprop算法训练BP神经网，一次训练即可得到能够识别任意倾角和位置手绘草图图素的识别器．从而达到了理想的识别效果．     

基于遗传策略和神经网络的非监督分类方法

文章提出了一种新的基于遗传策略和模糊ART(adaptive resonance theory)神经网络的非监督分类方法.首先,利用原有的训练样本对模糊ART神经网络进行非监督训练,然后,采用遗传策略为模糊ART神经网络增加各类族边界邻域内的训练样本点,再对模糊ART神经网络进行有监督训练.这种方法解决了训练样本在较少条件下的ART系列神经网络的学习与分类问题,提高了ART系列神经网络的分类性能,并扩展了其应用范围.     

Pattern recognition for sensor array signals using Fuzzy ARTMAP

A Fuzzy ARTMAP classifier for pattern recognition in chemical sensor array was developed based on Fuzzy Set Theory and Adaptive Resonance Theory. In contrast to most current classifiers with difficulty in detecting new analytes, the Fuzzy ARTMAP system can identify untrained analytes with comparatively high probability. And to detect presence of new analyte, the Fuzzy ARTMAP classifier does not need retraining process that is necessary for most traditional neural network classifiers. In this study, principal component analysis (PCA) was first implemented for feature extraction purpose, followed by pattern recognition using Fuzzy ARTMAP classifiers. To construct the classifier with high recognition rate, parameter sensitive analysis was applied to find critical factors and Pareto optimization was used to locate the optimum parameter setting for the classifier. The test result shows that the proposed method can not only maintain satisfactory correct classification rate for trained analytes, but also be able to detect untrained analytes at a high recognition rate. Also the Pareto optimal values of the most important parameter have been identified, which could help constructing Fuzzy ARTMAP classifiers with good classification performance in future application.     

Odour quantification by a sensor array: An application to landfill gas odours from two different municipal waste treatment works

The possibility of quantifying the landfill gas (LFG) odour in terms of odour-units per cubic meter (ou/m³) using a tin oxide sensor array is investigated. The objective is to determine the most appropriate neural machines (MLP networks, RBF networks) model to perform the odour concentration approximation and evaluate the influence of multiple biogas sources modelling on the approximation quality. The structural risk minimization principle is used instead of the usual empirical risk minimization principle in the training algorithm of the neural machines. Multilayer perceptrons (MLP) networks prove to minimize best the error on the prediction of odour concentration of unknown data. The data is constituted of LFG odour samples from two municipal waste treatment works presenting different concentrations of odorous compounds. It is shown that the quality of the LFG odour approximation is in the present case influenced directly by the size of the training data set. The use of data coming from two different sources is not detrimental to the quality of the approximation.     

基于SVM的柴油机故障诊断方法研究

介绍了基于支持向量机(SVM)的故障诊断方法的原理和算法。利用小波包分解提取信号的特征参数,将特征送入故障分类器中训练。实验结果表明,当数据样本较少时,相比神经网络而言,基于SVM的故障分类器仍能正确分类多种故障。这种诊断方法具有算法简单、故障分类能力强的优点。     

Optimization of training data required for neuro-classification

Classification of remotely sensed data with artificial neural networks is called neuro-classification, and this technique has shown great potential. The amount of data used for training a neural network affects the accuracy and efficiency of the neural network classifier. A neural network was trained separately with 5, 10, 15, and 20 per cent of image data from a Landsat Thematic Mapper scene, which was acquired 29 July 1987 for an agricultural region within Indiana, U.S.A. At a risk level of 5 per cent, the results showed that (a) classifiers NN-5% (neuro-classification with 5 per cent of the image data used for training), AW-10%, and AW-15% did not differ from one another, (b) classifiers AW-15% and AW-20% did not differ from each other, but (c) classifiers NN-5% and AW-10% differed from classifier AW-20%. The training rates were reduced by more than 10?seconds cycle^-1 as we increased the percentage of the image data for training a neural network. Approximately 5-10 per cent of the image data are needed to train a neural network classifier adequately to obtain satisfactory performance.     

Constructive feedforward ART clustering networks. II

For pt.I see ibid., p.645-61 (2002). Part I of this paper defines the class of constructive unsupervised on-line learning simplified adaptive resonance theory (SART) clustering networks. Proposed instances of class SART are the symmetric fuzzy ART (S-Fuzzy ART) and the Gaussian ART (GART) network. In Part II of our work, a third network belonging to class SART, termed fully self-organizing SART (FOSART), is presented and discussed. FOSART is a constructive, soft-to-hard competitive, topology-preserving, minimum-distance-to-means clustering algorithm capable of: 1) generating processing units and lateral connections on an example-driven basis and 2) removing processing units and lateral connections on a minibatch basis. FOSART is compared with Fuzzy ART, S-Fuzzy ART, GART and other well-known clustering techniques (e.g., neural gas and self-organizing map) in several unsupervised learning tasks, such as vector quantization, perceptual grouping and 3-D surface reconstruction. These experiments prove that when compared with other unsupervised learning networks, FOSART provides an interesting balance between easy user interaction, performance accuracy, efficiency, robustness, and flexibility     

基于加速度信号和进化RBF神经网络的人体行为识别*

针对基于加速度信号的人体行为识别,采用递阶遗传算法(HGA)训练径向基函数(RBF)神经网络,获得满意的识别正确率.设计适应度函数,利用四分位数间距改进HGA中参数基因的交叉方式,给出自动确定子代生成区域的方法,省去以往同类算法中的经验性设定,并结合算术交叉选择优秀子代,然后对比均匀变异和非均匀变异子代的适应值,实现对RBF网络结构和参数的联合优化.在基于加速度信号的行为识别系统中,与基本HGA和其他常用的训练方法相比,文中算法训练的RBF分类器可获得更低的输出误差和更高的测试样本识别正确率.     

Applying a new localized generalization error model to design neural networks trained with extreme learning machine

High accuracy and low overhead are two key features of a well-designed classifier for different classification scenarios. In this paper, we propose an improved classifier using a single-hidden layer feedforward neural network (SLFN) trained with extreme learning machine. The novel classifier first utilizes principal component analysis to reduce the feature dimension and then selects the optimal architecture of the SLFN based on a new localized generalization error model in the principal component space. Experimental and statistical results on the NSL-KDD data set demonstrate that the proposed classifier can achieve a significant performance improvement compared with previous classifiers.     

PSO-optimized modular neural network trained by OWO-HWO algorithm for fault location in analog circuits

Fault diagnosis of analog circuits is a key problem in the theory of circuit networks and has been investigated by many researchers in recent decades. In this paper, an active filter circuit is used as the circuit under test (CUT) and is simulated in both fault-free and faulty conditions. A modular neural network model is proposed in this paper for soft fault diagnosis of the CUT. To optimize the structure of neural network modules in the proposed scheme, particle swarm optimization (PSO) algorithm is used to determine the number of hidden layer nodes of neural network modules. In addition, the output weight optimization–hidden weight optimization (OWO-HWO) training algorithm is employed, instead of conventional output weight optimization–backpropagation (OWO-BP) algorithm, to improve convergence speed in training of the neural network modules in proposed modular model. The performance of the proposed method is compared to that of monolithic multilayer perceptrons (MLPs) trained by OWO-BP and OWO-HWO algorithms, K-nearest neighbor (KNN) classifier and a related system with the same CUT. Experimental results show that the PSO-optimized modular neural network model which is trained by the OWO-HWO algorithm offers higher correct fault location rate in analog circuit fault diagnosis application as compared to the classic and monolithic investigated neural models.