Entropies for detection of epilepsy in EEG

The electroencephalogram (EEG) is a representative signal containing information about the condition of the brain. The shape of the wave may contain useful information about the state of the brain. However, the human observer cannot directly monitor these subtle details. Besides, since bio-signals are highly subjective, the symptoms may appear at random in the time scale. Therefore, the EEG signal parameters, extracted and analyzed using computers, are highly useful in diagnostics. The aim of this work is to compare the different entropy estimators when applied to EEG data from normal and epileptic subjects. The results obtained indicate that entropy estimators can distinguish normal and epileptic EEG data with more than 95% confidence (using t-test). The classification ability of the entropy measures is tested using ANFIS classifier. The results are promising and a classification accuracy of about 90% is achieved.     

An intelligent diagnosis system based on principle component analysis and ANFIS for the heart valve diseases

In this paper, an intelligent diagnosis system based on principle component analysis (PCA) and adaptive network based on fuzzy inference system (ANFIS) for the heart valve disease is introduced. This intelligent system deals with combination of the feature extraction and classification from measured Doppler signal waveforms at the heart valve using the Doppler ultrasound (DHS). Here, the wavelet entropy is used as features. This intelligent system has three phases. In pre-processing phase, the data acquisition and pre-processing for DHS signals are performed. In feature extraction phase, the feature vector is extracted by calculating the 12 wavelet entropy values for per DHS signal and dimension of Doppler signal dataset, which are 12 features, is reduced to 6 features using PCA. In classification phase, these reduced wavelet entropy features are given to inputs ANFIS classifier. The correct diagnosis performance of the PCA–ANFIS intelligent system is calculated in 215 samples. The classification accuracy of this PCA–ANFIS intelligent system was 96% for normal subjects and 93.1% for abnormal subjects.     

基于模糊积分的多神经网络集成信息融合

使用模糊积分实现集成神经网络中的子分类器信息融合,提出一种更加有效和全面的模糊密度,用于模糊积分的计算。以双螺旋分类问题为实验对象,使用集成神经网络实现具有较高正确率的分类方法,对神经网络集成的有效性和各类参数的设定作实验分析,并通过多种模糊密度的比较数据说明该模糊密度函数的有效性。     

Genetic algorithm in designing fuzzy information retrieval-based classifier by principal component analysis

The aim of this paper is to develop a fuzzy classifier form the point of view of a fuzzy information retrieval system. The genetic algorithm is employed to find useful fuzzy concepts with high classification performance for classification problems; then, each of classes and patterns can be represented by a fuzzy set of useful fuzzy concepts. Each of fuzzy concepts is linguistically interpreted and the corresponding membership functions remain fixed during the evolution. A pattern can be categorized into one class if there exists a maximum degree of similarity between them. For not distorting the usefulness of the proposed classifier for high-dimensional problems, the principal component analysis is incorporated into the proposed classifier to reduce dimensions. The generalization ability of the proposed classifier is examined by performing computer simulations on some well-known data sets, such as the breast cancer data and the wine classification data. The results demonstrate that the proposed classifier works well in comparison with other classification methods.     

Deriving terrain and textural information from stereo RADARSAT data for mountainous land cover mapping

A new procedure is proposed for land cover classification in a mountainous area using stereo RADARSAT-1 data. The method integrates a few types of information that can be extracted from the same stereo RADARSAT images: (1) the Digital Elevation Model (DEM) generated from the stereo RADARSAT images; (2) terrain information (elevation, slope and aspect) extracted from the derived DEM; and (3) textural information derived from the same RADARSAT images. An Artificial Neural Network (ANN) classifier is applied for the land cover classification. Performance of the proposed method is evaluated using a mountainous study area in Southern Argentina, where there is a lack of up-to-date information for environmental monitoring. The results show that the integration of textural and terrain information can greatly improve the accuracy of the classification using the ANN classifier. It demonstrates that stereo RADARSAT images provide valuable data sources for land cover mapping, especially in mountainous areas where cloud cover is a problem for optical data collection and topographical data are not always available.     

Fuzzy classifier design using harmonic search methods

A new approach to design of a fuzzy-rule-based classifier that is capable of selecting informative features is discussed. Three basic stages of the classifier construction—feature selection, generation of fuzzy rule base, and optimization of the parameters of rule antecedents—are identified. At the first stage, several feature subsets on the basis of discrete harmonic search are generated by using the wrapper scheme. The classifier structure is formed by the rule base generation algorithm by using extreme feature values. The optimal parameters of the fuzzy classifier are extracted from the training data using continuous harmonic search. Akaike information criterion is deployed to identify the best performing classifiers. The performance of the classifier was tested on real-world KEEL and KDD Cup 1999 datasets. The proposed algorithms were compared with other fuzzy classifiers tested on the same datasets. Experimental results show efficiency of the proposed approach and demonstrate that highly accurate classifiers can be constructed by using relatively few features.     

基于模糊高斯基函数神经网络的遥感图像分类

针对遥感图像分类的特点,提出了一种基于模糊高斯基函数神经网络的遥感图像分类器。该分类器将模糊技术与神经网络相结合,采用神经网络来实现模糊推理,利用神经网络的学习能力来达到调整模糊隶属函数和模型规则的目的,从而使系统具备了自适应的特性,实验结果表明,这种基于模糊高斯基孙数神经网络的分类器经过训练后,可应用于遥感图像的分类,其分类精度明显高于传统的最大似然分类法。     

Fuzzy min-max neural networks. I. Classification.

A supervised learning neural network classifier that utilizes fuzzy sets as pattern classes is described. Each fuzzy set is an aggregate (union) of fuzzy set hyperboxes. A fuzzy set hyperbox is an n-dimensional box defined by a min point and a max point with a corresponding membership function. The min-max points are determined using the fuzzy min-max learning algorithm, an expansion-contraction process that can learn nonlinear class boundaries in a single pass through the data and provides the ability to incorporate new and refine existing classes without retraining. The use of a fuzzy set approach to pattern classification inherently provides a degree of membership information that is extremely useful in higher-level decision making. The relationship between fuzzy sets and pattern classification is described. The fuzzy min-max classifier neural network implementation is explained, the learning and recall algorithms are outlined, and several examples of operation demonstrate the strong qualities of this new neural network classifier.     

基于训练空间重构的多模块TSK模糊系统

利用重构训练样本空间的手段,提出一种多训练模块Takagi-Sugeno-Kang （TSK）模糊分类器H-TSK-FS.它具有良好的分类性能和较高的可解释性,可以解决现有层次模糊分类器中间层输出和模糊规则难以解释的难题.为了实现良好的分类性能,H-TSK-FS由多个优化零阶TSK模糊分类器组成.这些零阶TSK模糊分类器内部采用一种巧妙的训练方式.原始训练样本、上一层训练样本中的部分样本点以及所有已训练层中最逼近真实值的部分决策信息均被投影到当前层训练模块中,并构成其输入空间.通过这种训练方式,前层的训练结果对后层的训练起到引导和控制作用.这种随机选取样本点、在一定范围内随机选取训练特征的手段可以打开原始输入空间的流形结构,保证较好或相当的分类性能.另外,该研究主要针对少量样本点且训练特征数不是很大的数据集.在设计每个训练模块时采用极限学习机获取模糊规则后件参数.对于每个中间训练层,采用短规则表达知识.每条模糊规则则通过约束方式确定不固定的输入特征以及高斯隶属函数,目的是保证所选输入特征具有高可解释性.真实数据集和应用案例实验结果表明,H-TSK-FS具有良好的分类性能和高可解释性.     

基于自适应级联模糊推理的调制识别算法

针对非平稳的数字调制信号,构造新的高阶交又累量特征;利用神经网络的学习机制实现自适应模糊推理调制识别器的非线性动态建模;采取分层决策的级联结构,提高了特征与识别器的契合度,最大程度上减少了隶属度函数和模糊规则的冗余;根据特征样本的大致分布建立蕴涵初始经验的级联模糊神经网络系统,使知识推理结构明确可控;通过样本训练实现结构参数自适应调整和优化,完成其逼近求精.仿真实验证明,该系统在信噪比等环境参数变化较大的情况下具有更好的稳健性,其算法识别率和效率相对于神经网络识别器和模糊识别器有明显提高.     

基于增强深度特征和TSK模糊分类器的癫痫脑电信号识别

识别癫痫脑电信号的关键在于获取有效的特征和构建可解释的分类器.为此,提出一种基于增强深度特征的TSK模糊分类器(ED-TSK-FC).首先,ED-TSK-FC使用一维卷积神经网络(1D-CNN)自动获取癫痫脑电信号的深度特征与潜在类别信息,并将深度特征和潜在类别信息合并为增强深度特征;其次,将增强深度特征作为ED-TSK-FC模糊规则前件与后件部分的训练变量,保证原始输入的深度特征及其潜在意义都出现在模糊规则中,进而对增强深度特征作出良好的解释;然后,采用岭回归极限学习算法对模糊规则的后件参数进行快速求解,在不显著降低分类准确度的情况下,ED-TSK-FC的廉价训练方法可以缩短模型的训练时间;最后,在Bonn癫痫数据集上,分别从分类性能、学习效率和可解释性3个方面,验证ED-TSK-FC的优越性.     

Evolving an artificial neural network classifier for condition monitoring of rotating mechanical systems

We present the results of our investigation into the use of genetic algorithms (GAs) for identifying near optimal design parameters of diagnostic systems that are based on artificial neural networks (ANNs) for condition monitoring of mechanical systems. ANNs have been widely used for health diagnosis of mechanical bearing using features extracted from vibration and acoustic emission signals. However, different sensors and the corresponding features exhibit varied response to different faults. Moreover, a number of different features can be used as inputs to a classifier ANN. Identification of the most useful features is important for an efficient classification as opposed to using all features from all channels, leading to very high computational cost and is, consequently, not desirable. Furthermore, determining the ANN structure is a fundamental design issue and can be critical for the classification performance. We show that a GA can be used to select a smaller subset of features that together form a genetically fit family for successful fault identification and classification tasks. At the same time, an appropriate structure of the ANN, in terms of the number of nodes in the hidden layer, can be determined, resulting in improved performance.     

Fault diagnosis of roller bearing using fuzzy classifier and histogram features with focus on automatic rule learning

Roller bearing is one of the most widely used elements in rotary machines. Condition monitoring of such elements is conceived as pattern recognition problem. Pattern recognition has three main phases: feature extraction, feature selection and feature classification. Histogram features can be used for fault diagnosis of roller bearing. This paper presents the use of decision tree for selecting best few histogram features (bin ranges) that will discriminate the fault conditions of the bearing from given train samples. These features are extracted from vibration signals. A rule set is formed from the extracted features and fed to a fuzzy classifier. The rule set necessary for building the fuzzy classifier is obtained largely by intuition and domain knowledge. This paper also presents the usage of decision tree to generate the rules automatically from the feature set. The vibration signal from a piezoelectric transducer is captured for the following conditions – good bearing, bearing with inner race fault, bearing with outer race fault, and inner and outer race fault. The histogram features were extracted and good features that discriminate the different fault conditions of the bearing were selected using decision tree. The rule set for fuzzy classifier is obtained by once using the decision tree again. A fuzzy classifier is built and tested with representative data. The results are found to be encouraging.     

多导联EEG信号分类识别研究

脑电信号是一种典型的非平稳随机信号,对脑电信号的分类识别是非常困难的,为了提高正确识别率,提出多导脑电信号的分类识别方法。首先对受试者分别在睁眼和闭眼状态下的单导脑电信号进行特征提取,然后选取多组识别效果不好的单导联的特征,组合成为多导脑电信号特征,最后用RBF核函数的支持向量机分类器进行分类识别。结果表明对多导联特征的正识率比单导联正识率有很大提高。结论：多导脑电信号能够更好地反映大脑活动的整体信息,噪声抑制能力较强,因此多导联脑电信号特征的分类识别效果较好。     

常用数字通信信号调制方式分类的一种新方法

提出了一种常用数字中频信号盲识别方法。该方法通过信号延迟复共轭相乘相位特征的分析,提出了两个新的分类特征参数,结合对信号非线性变换谱特征和信号包络的分析,应用层次结构判决树分类器实现了常见数字信号的自动识别。仿真结果表明,本文提出的分类算法计算简单,分类效果良好。     

Improvement of phone recognition accuracy using speech mode classification

In this work, we have developed a speech mode classification model for improving the performance of phone recognition system (PRS). In this paper, we have explored vocal tract system, excitation source and prosodic features for development of speech mode classification (SMC) model. These features are extracted from voiced regions of a speech signal. In this study, conversation, extempore, and read speech are considered as three different modes of speech. The vocal tract component of speech is extracted using Mel-frequency cepstral coefficients (MFCCs). The excitation source features are captured through Mel power differences of spectrum in sub-bands (MPDSS) and residual Mel-frequency cepstral coefficients (RMFCCs) of the speech signal. The prosody information is extracted from pitch and intensity. Speech mode classification models are developed using above described features independently, and in fusion. The experiments carried out on Bengali speech corpus to analyze the accuracy of the speech mode classification model using the artificial neural network (ANN), naive Bayes, support vector machines (SVMs) and k-nearest neighbor (KNN). We proposed four classification models which are combined using maximum voting approach for optimal performance. From the results, it is observed that speech mode classification model developed using the fusion of vocal tract system, excitation source and prosodic features of speech, yields the best performance of 98%. Finally, the proposed speech mode classifier is integrated to the PRS, and the accuracy of phone recognition system is observed to be improved by 11.08%.     

DESIGN OF A FUZZY MIN-MAX HYPERBOX CLASSIFIER USING A SUPERVISED LEARNING METHOD

ABSTRACT

This investigation proposes a fuzzy min-max hyperbox classifier to solve M-class classification problems. In the proposed fuzzy min-max hyperbox classifier, a supervised learning method is implemented to generate min-max hyperboxes for the training patterns in each class so that the generated fuzzy min-max hyperbox classifier has a perfect classification rate in the training set. However, the 100% correct classification of the training set generally leads to overfitting. In order to improve this drawback, a procedure is employed to decrease the complexity of the input decision boundaries so that the generated fuzzy hyperbox classifier has a good generalization performance. Finally, two benchmark data sets are considered to demonstrate the good performance of the proposed approach for solving this classification problem.     

Subtractive clustering attribute weighting (SCAW) to discriminate the traffic accidents on Konya-Afyonkarahisar highway in Turkey with the help of GIS: A case study

A case study including the discrimination of traffic accidents as accident free and accident cases on Konya-Afyonkarahisar highway in Turkey using the proposed hybrid method based on combining of a new data preprocessing method called subtractive clustering attribute weighting (SCAW) and classifier algorithms with the help of Geographical Information System (GIS) technology has been conducted. In order to improve the discrimination of classifier algorithms including artificial neural network (ANN), adaptive network based fuzzy inference system (ANFIS), support vector machine, and decision tree, using data preprocessing need in solution of these kinds of problems (traffic accident case study). So, we have proposed a novel data preprocessing method called subtractive clustering attribute weighting (SCAW) and combined with classifier algorithms. In this study, the experimental data has been obtained by means of using GIS. The obtained GIS attributes are day, temperature, humidity, weather conditions, and month of occurred accident. To evaluate the performance of the proposed hybrid method, the classification accuracy, sensitivity and specificity values have been used. The experimental obtained results are 53.93%, 52.25%, and 38.76% classification successes using alone ANN, ANFIS, and SVM with RBF kernel type, respectively. As for the proposed hybrid method, the classification accuracies of 67.98%, 70.22%, and 61.24% have been obtained using the combination of SCAW with ANN, the combination of SCAW with SVM (radial basis function (RBF) kernel type), and the combination of SCAW with ANFIS, respectively. The proposed SCAW method with the combination of classifier algorithms has been achieved the very promising results in the discrimination of traffic accidents.     

Fuzzy classifier design using genetic algorithms

A new method for design of a fuzzy-rule-based classifier using genetic algorithms (GAs) is discussed. The optimal parameters of the fuzzy classifier including fuzzy membership functions and the size and structure of fuzzy rules are extracted from the training data using GAs. This is done by introducing new representation schemes for fuzzy membership functions and fuzzy rules. An effectiveness measure for fuzzy rules is developed that allows for systematic addition or deletion of rules during the GA optimization process. A clustering method is utilized for generating new rules to be added when additions are required. The performance of the classifier is tested on two real-world databases (Iris and Wine) and a simulated Gaussian database. The results indicate that highly accurate classifiers could be designed with relatively few fuzzy rules. The performance is also compared to other fuzzy classifiers tested on the same databases.