Application of InP Neural Network to ECG BeatClassification

This paper presents an application of a hybrid neural network structure to the classification of the electrocardiogram (ECG) beats. Three different feature extraction methods are comparatively examined: discrete cosine transform, wavelet transform and a direct method. Classification performances, training times and the numbers of nodes of Kohonen network, Restricted Coulomb Energy (RCE) network and the hybrid neural network are presented. To increase the classification performance and to decrease the number of nodes, the hybrid neural network is trained by Genetic Algorithms (GAs). Ten types of ECG beats obtained from the MIT-BIH database and from a real-time ECG measurement system are classified with a success of 98% by using the hybrid neural network structure and discrete cosine transform together.     

Classification of ECG beats by using a fast least square support vector machines with a dynamic programming feature selection algorithm

In this paper, we present a new system for the classification of electrocardiogram (ECG) beats by using a fast least square support vector machine (LSSVM). Five feature extraction methods are comparatively examined in the 15-dimensional feature space. The dimension of the each feature set is reduced by using dynamic programming based on divergence analysis. After the preprocessing of ECG data, six types of ECG beats obtained from the MIT-BIH database are classified with an accuracy of 95.2% by the proposed fast LSSVM algorithm together with discrete cosine transform. Experimental results show that not only the fast LSSVM is faster than the standard LSSVM algorithm, but also it gives better classification performance than the standard backpropagation multilayer perceptron network.     

Segmentation of MR and CT Images Using a Hybrid Neural Network Trained by Genetic Algorithms

A novel hybrid neural network trained by the genetic algorithms is presented. Genetic algorithms are used to improve the neural net's classification performance while minimizing the number of nodes. Each node of the network forms a closed region in the input space. The closed regions, which are formed by the nodes, intersect each other. The performance of the proposed hybrid neural network is compared with the multilayer perceptron, and the restricted Coulomb energy network for the segmentation of MR and CT head images. Experimental results show that the proposed neural network gives the best classification performance with a small number of nodes in short training times.     

Segmentation of MR and CT Images by Using a Quantiser Neural Network

A Quantiser Neural Network (QNN) is proposed for the segmentation of MR and CT images. Elements of a feature vector are formed by image intensities at one neighbourhood of the pixel of interest. QNN is a novel neural network structure, which is trained by genetic algorithms. Each node in the first layer of the QNN forms a hyperplane (HP) in the input space. There is a constraint on the HPs in a QNN. The HP is represented by only one parameter in d-dimensional input space. Genetic algorithms are used to find the optimum values of the parameters which represent these nodes. The novel neural network is comparatively examined with a multilayer perceptron and a Kohonen network for the segmentation of MR and CT head images. It is observed that the QNN gives the best classification performance with fewer nodes after a short training time.     

Implementing wavelet transform/mixture of experts network for analysis of electrocardiogram beats

Abstract: Mixture of experts (ME) is a modular neural network architecture for supervised learning. This paper illustrates the use of the ME network structure to guide model selection for classification of electrocardiogram (ECG) beats. The expectation maximization algorithm is used for training the ME so that the learning process is decoupled in a manner that fits well with the modular structure. The ECG signals were decomposed into time–frequency representations using discrete wavelet transforms and statistical features were calculated to depict their distribution. The ME network structure was implemented for ECG beats classification using the statistical features as inputs. To improve classification accuracy, the outputs of expert networks were combined by a gating network simultaneously trained in order to stochastically select the expert that is performing the best at solving the problem. Five types of ECG beats (normal beat, congestive heart failure beat, ventricular tachyarrhythmia beat, atrial fibrillation beat, partial epilepsy beat) obtained from the Physiobank database were classified with an accuracy of 96.89% by the ME network structure. The ME network structure achieved accuracy rates which were higher than those of the stand-alone neural network models.     

Dictionary learning for VQ feature extraction in ECG beats classification

Vector quantization(VQ) can perform efficient feature extraction from electrocardiogram (ECG) with the advantages of dimensionality reduction and accuracy increase. However, the existing dictionary learning algorithms for vector quantization are sensitive to dirty data, which compromises the classification accuracy. To tackle the problem, we propose a novel dictionary learning algorithm that employs k-medoids cluster optimized by k-means++ and builds dictionaries by searching and using representative samples, which can avoid the interference of dirty data, and thus boost the classification performance of ECG systems based on vector quantization features. We apply our algorithm to vector quantization feature extraction for ECG beats classification, and compare it with popular features such as sampling point feature, fast Fourier transform feature, discrete wavelet transform feature, and with our previous beats vector quantization feature. The results show that the proposed method yields the highest accuracy and is capable of reducing the computational complexity of ECG beats classification system. The proposed dictionary learning algorithm provides more efficient encoding for ECG beats, and can improve ECG classification systems based on encoded feature.     

ECG beat classifier designed by combined neural network model

This paper illustrates the use of combined neural network model to guide model selection for classification of electrocardiogram (ECG) beats. The ECG signals were decomposed into time-frequency representations using discrete wavelet transform and statistical features were calculated to depict their distribution. The first level networks were implemented for ECG beats classification using the statistical features as inputs. To improve diagnostic accuracy, the second level networks were trained using the outputs of the first level networks as input data. Four types of ECG beats (normal beat, congestive heart failure beat, ventricular tachyarrhythmia beat, atrial fibrillation beat) obtained from the Physiobank database were classified with the accuracy of 96.94% by the combined neural network. The combined neural network model achieved accuracy rates which were higher than that of the stand-alone neural network model.     

CDUL: Class directed unsupervised learning

A novel neural network called Class Directed Unsupervised Learning (CDUL) is introduced. The architecture, based on a Kohonen self-organising network, uses additional input nodes to feed class knowledge to the network during training, in order to optimise the final positioning of Kohonen nodes in feature space. The structure and training of CDUL networks is detailed, showing that (a) networks cannot suffer from the problem of single Kohonen nodes being trained by vectors of more than one class, (b) the number of Kohonen nodes necessary to represent the classes is found during training, and (c) the number of training set passes CDUL requires is low in comparison to similar networks. CDUL is subsequently applied to the classification of chemical excipients from Near Infrared (NIR) reflectance spectra, and its performance compared with three other unsupervised paradigms. The results thereby obtained demonstrate a superior performance which remains relatively constant through a wide range of network parameters.     

A modified mixture of experts network structure for ECG beats classification with diverse features

This paper illustrates the use of modified mixture of experts (MME) network structure to guide model selection for classification of electrocardiogram (ECG) beats with diverse features. The MME is a modular neural network architecture for supervised learning. Expectation-maximization (EM) algorithm was used for training the MME so that the learning process is decoupled in a manner that fits well with the modular structure. The wavelet coefficients and Lyapunov exponents of the ECG signals were computed and statistical features were calculated to depict their distribution. The statistical features, which were used for obtaining the diverse features of the ECG signals, were then input into the MME network structure for training and testing purposes. We explored the ability of designed and trained MME network structure, combined with wavelet preprocessing (computing wavelet coefficients) and nonlinear dynamics tools (computing Lyapunov exponents), to discriminate five types of ECG beats (normal beat, congestive heart failure beat, ventricular tachyarrhythmia beat, atrial fibrillation beat, partial epilepsy beat) obtained from the Physiobank database. The MME achieved accuracy rates which were higher than that of the mixture of experts (ME) and feedforward neural network models (multilayer perceptron neural network—MLPNN). The proposed MME approach can be useful in classifying long-term ECG signals for early detection of heart diseases/abnormalities.     

Combining recurrent neural networks with eigenvector methods for classification of ECG beats

The purpose of this study is to evaluate the accuracy of the recurrent neural networks (RNNs) trained with Levenberg–Marquardt algorithm on the electrocardiogram (ECG) beats. Four types of ECG beats (normal beat, congestive heart failure beat, ventricular tachyarrhythmia beat, atrial fibrillation beat) obtained from the Physiobank database were analyzed. Decision making was performed in two stages: feature extraction by eigenvector methods and classification using the RNN trained on the extracted features. The RNNs were implemented for classification of the ECG beats using the statistical features as inputs. The ability of designed and trained Elman RNNs, combined with eigenvector methods, were explored to classify the ECG beats. The classification results demonstrated that the combined eigenvector methods/RNN approach can be useful in analyzing the ECG beats.     

Feature saliency using signal-to-noise ratios in automated diagnostic systems developed for ECG beats

Artificial neural networks (ANNs) have been used in a great number of medical diagnostic decision support system applications and within feedforward ANNs framework there are a number of established measures such as saliency measures for identifying important input features. By identifying a set of salient features, the noise in a classification model can be reduced, resulting in more accurate classification. In this study, a signal-to-noise ratio (SNR) saliency measure was employed to determine saliency of input features of multilayer perceptron neural networks (MLPNNs) used in classification of electrocardiogram (ECG) beats (normal beat, congestive heart failure beat, ventricular tachyarrhythmia beat, atrial fibrillation beat) obtained from the Physiobank database. The SNR saliency measure determines the saliency of a feature by comparing it to that of an injected noise feature and the SNR screening method utilizes the SNR saliency measure to select a parsimonious set of salient features. ECG signals were decomposed into time–frequency representations using discrete wavelet transform. Input feature vectors were extracted using statistics over the set of the wavelet coefficients. The MLPNNs used in the ECG beats-classification were trained for the SNR screening method. The application results of the SNR screening method to the ECG signals demonstrated that classification accuracies of the MLPNNs with salient input features are higher than that of the MLPNNs with salient and non-salient input features.     

Integration of independent component analysis and neural networks for ECG beat classification

In this paper, we propose a scheme to integrate independent component analysis (ICA) and neural networks for electrocardiogram (ECG) beat classification. The ICA is used to decompose ECG signals into weighted sum of basic components that are statistically mutual independent. The projections on these components, together with the RR interval, then constitute a feature vector for the following classifier. Two neural networks, including a probabilistic neural network (PNN) and a back-propagation neural network (BPNN), are employed as classifiers. ECG samples attributing to eight different beat types were sampled from the MIT-BIH arrhythmia database for experiments. The results show high classification accuracy of over 98% with either of the two classifiers. Between them, the PNN shows a slightly better performance than BPNN in terms of accuracy and robustness to the number of ICA-bases. The impressive results prove that the integration of independent component analysis and neural networks, especially PNN, is a promising scheme for the computer-aided diagnosis of heart diseases based on ECG.     

Statistics over features of ECG signals

This paper presented the usage of statistics over the set of the features representing the electrocardiogram (ECG) signals. Since classification is more accurate when the pattern is simplified through representation by important features, feature extraction and selection play an important role in classifying systems such as neural networks. Multilayer perceptron neural network (MLPNN) architectures were formulated and used as basis for detection of variabilities of the ECG signals. Four types of ECG beats (normal beat, congestive heart failure beat, ventricular tachyarrhythmia beat, atrial fibrillation beat) obtained from the Physiobank database were classified. The selected Lyapunov exponents, wavelet coefficients and the power levels of power spectral density (PSD) values obtained by eigenvector methods of the ECG signals were used as inputs of the MLPNN trained with Levenberg–Marquardt algorithm. The classification results confirmed that the proposed MLPNN has potential in detecting the variabilities of the ECG signals.     

RBF神经网络在遥感影像分类中的应用研究

用RBF神经网络进行遥感影像分类，在网络结构设计上使RBF层与输出层的节点数都等于所要分类的类别数。用Kohonen聚类算法确定RBF中心的时候，用训练样本的均值作为初始中心，并在RBF宽度进行求取的时候进行了改进，以避免内存溢出。所设计的RBF神经网络分类模型具有结构简单、算法简洁的优点。实验结果表明，该方法用于遥感影像分类取得了较高的分类精度，具有实际应用价值。     

Classification of electrocardiogram signals with support vector machines and extreme learning machine

An Electrocardiogram or ECG is an electrical recording of the heart and is used in the investigation of heart disease. This ECG can be classified as normal and abnormal signals. The classification of the ECG signals is presently performed with the support vector machine. The generalization performance of the SVM classifier is not sufficient for the correct classification of ECG signals. To overcome this problem, the ELM classifier is used which works by searching for the best value of the parameters that tune its discriminant function and upstream by looking for the best subset of features that feed the classifier. The experiments were conducted on the ECG data from the Physionet arrhythmia database to classify five kinds of abnormal waveforms and normal beats. In this paper, a thorough experimental study was done to show the superiority of the generalization capability of the Extreme Learning Machine (ELM) that is presented and compared with support vector machine (SVM) approach in the automatic classification of ECG beats. In particular, the sensitivity of the ELM classifier is tested and that is compared with SVM combined with two classifiers, and they are the k-nearest Neighbor Classifier and the radial basis function neural network classifier, with respect to the curse of dimensionality and the number of available training beats. The obtained results clearly confirm the superiority of the ELM approach as compared with traditional classifiers.     

采用S变换特征选择方法的心律失常分类

针对短时傅里叶变换与小波变换对心电图（Electrocardiogram,ECG）信号特征提取不足以及心律失常识别困难的问题,提出了一种基于S变换特征选择的心律失常分类算法。首先对ECG信号进行S变换,并从幅值和相位两个角度提取ECG信号的时频特征,与形态特征和RR间隔组成原始特征向量。然后将遗传算法与支持向量机（Support vector machine,SVM）结合组成Wrapper式特征选择方法,并在其中融入ReliefF算法,即采用ReliefF算法计算特征权重,并根据特征权重大小来指导遗传算法种群初始化,遗传算法以SVM的分类性能作为适应度函数来搜索特征子集。最后使用"一对多"（One against all,OAA）SVM对MIT-BIH心律失常数据库8种类型心拍进行分类。实验结果表明,该算法达到了较好的分类效果,灵敏度、特异性和准确率分别为96.14%,99.75%和99.81%。     

Minimal Structure of Self-Organizing HCMAC Neural Network Classifier

The authors previously proposed a self-organizing Hierarchical Cerebellar Model Articulation Controller (HCMAC) neural network containing a hierarchical GCMAC neural network and a self-organizing input space module to solve high-dimensional pattern classification problems. This novel neural network exhibits fast learning, a low memory requirement, automatic memory parameter determination and highly accurate high-dimensional pattern classification. However, the original architecture needs to be hierarchically expanded using a full binary tree topology to solve pattern classification problems according to the dimension of the input vectors. This approach creates many redundant GCMAC nodes when the dimension of the input vectors in the pattern classification problem does not exactly match that in the self-organizing HCMAC neural network. These redundant GCMAC nodes waste memory units and degrade the learning performance of a self-organizing HCMAC neural network. Therefore, this study presents a minimal structure of self-organizing HCMAC (MHCMAC) neural network with the same dimension of input vectors as the pattern classification problem. Additionally, this study compares the learning performance of this novel learning structure with those of the BP neural network,support vector machine (SVM), and original self-organizing HCMAC neural network in terms of ten benchmark pattern classification data sets from the UCI machine learning repository. In particular, the experimental results reveal that the self-organizing MHCMAC neural network handles high-dimensional pattern classification problems better than the BP, SVM or the original self-organizing HCMAC neural network. Moreover, the proposed self-organizing MHCMAC neural network significantly reduces the memory requirement of the original self-organizing HCMAC neural network, and has a high training speed and higher pattern classification accuracy than the original self-organizing HCMAC neural network in most testing benchmark data sets. The experimental results also show that the MHCMAC neural network learns continuous function well and is suitable for Web page classification.     

特征扩展的随机向量函数链神经网络

基于宽度学习的动态模糊推理系统(broad-learning-based dynamic fuzzy inference system , BL-DFIS)能自动构建出精简的模糊规则并获得良好的分类性能. 然而, 当遇到大型复杂的数据集时, BL-DFIS因会使用较多模糊规则来试图达到令人满意的识别精度, 从而对其可解释性造成了不利影响. 对此, 提出一种兼顾分类性能和可解释性的模糊神经网络, 将其称为特征扩展的随机向量函数链神经网络(FA-RVFLNN). 在该网络中, 一个以原始数据为输入的RVFLNN被作为主体结构, BL-DFIS则用作性能补充, 这意味着FA-RVFLNN包含具有性能增强作用的直接链接. 由于主体结构的增强节点使用Sigmoid激活函数, 因此, 其推理过程可借助一种模糊逻辑算子(I-OR)来解释. 而且, 具有明确含义的原始输入数据也有助于解释主体结构的推理规则. 在直接链接的支撑下, FA-RVFLNN可利用增强节点、特征节点和模糊节点学到更丰富的有用信息. 实验表明: FA-RVFLNN既减缓了主体结构RVFLNN中过多增强节点带来的“规则爆炸”问题, 也提高了性能补充结构BL-DFIS的可解释性(平均模糊规则数降低了50%左右), 在泛化性能和网络规模上仍具有竞争力.     

Imposed target based modification of Taguchi method for feature optimisation with application in arrhythmia beat detection

Development of an expert system for clinical application includes automation in diagnosis of abnormality and patient monitoring based on features derived from continuous data set. This paper presents a novel method for feature optimization and classification of electrocardiogram (ECG) for arrhythmia analysis. A feature set optimization technique can reduce the classification hazard by selecting few comprehensive features to cater all kind of abnormalities under consideration. Proposed work deals with ranking and selection of an optimized pair of features using Taguchi method from eleven possible features normally used for characterizing arrhythmic beats like left bundle branch (LBBB), right bundle branch (RBBB) and premature ventricular contraction (PVC) are compared to normal beats. An imposed target based modification of Taguchi method is also suggested for the systems where the output is not pre-defined as in the case of biomedical applications. The proposed method is advantageous for the expert systems in which individual identity of the features are to be stored while reducing the dimensionality of the feature set. Multiclass Navis Bayes classifier is used to classify the beats in a single run and good performance parameters are obtained as reported in the result section.     

基于U-NET网络的心律失常信号识别算法研究

在心电信号心律失常自动识别系统中,针对心电信号形态复杂导致特征提取困难、自动分类模型准确度低、现实应用性差的问题,设计了一种基于U-NET全卷积神经网络的心电信号语义分割的识别分类方法。该方法通过全卷积神经网络的编码运算规则,将心电信号切片数据作为输入,标签地图作为输出,可划分出信号片段中的心拍位置与类别。仿真结果表明：该方法在正常窦性搏动、左束支传导阻滞、右束支传导阻滞、房性早搏和室性早搏五分类问题中取得较高准确率,实现了对心律失常信号的有效识别。