Classification of hyperspectral remote sensing images with support vector machines

This paper addresses the problem of the classification of hyperspectral remote sensing images by support vector machines (SVMs). First, we propose a theoretical discussion and experimental analysis aimed at understanding and assessing the potentialities of SVM classifiers in hyperdimensional feature spaces. Then, we assess the effectiveness of SVMs with respect to conventional feature-reduction-based approaches and their performances in hypersubspaces of various dimensionalities. To sustain such an analysis, the performances of SVMs are compared with those of two other nonparametric classifiers (i.e., radial basis function neural networks and the K-nearest neighbor classifier). Finally, we study the potentially critical issue of applying binary SVMs to multiclass problems in hyperspectral data. In particular, four different multiclass strategies are analyzed and compared: the one-against-all, the one-against-one, and two hierarchical tree-based strategies. Different performance indicators have been used to support our experimental studies in a detailed and accurate way, i.e., the classification accuracy, the computational time, the stability to parameter setting, and the complexity of the multiclass architecture. The results obtained on a real Airborne Visible/Infrared Imaging Spectroradiometer hyperspectral dataset allow to conclude that, whatever the multiclass strategy adopted, SVMs are a valid and effective alternative to conventional pattern recognition approaches (feature-reduction procedures combined with a classification method) for the classification of hyperspectral remote sensing data.     

基于SVM的纠错编码多分类算法的研究与应用

为了提高变压器故障诊断的准确率,提出了一种基于纠错编码和支持向量机相结合的多分类算法,根据SVM理论建立变压器故障诊断数学模型,首先基于纠错编码矩阵构造出若干个互不相关的子支持向量机,以提高分类模型的分类准确率。最后把变压器油中溶解气体(DGA)作为纠错编码支持向量机的训练以及测试样本,实现变压器的故障诊断,同时用UCI数据对该算法进行验证。通过VS2008和Libsvm相结合对其进行验证,结果表明该方法具有很高的分类精度。     

基于矩阵灰建模的单次P300检测新方法

针对少导联P300单次提取识别率较低的问题,提出了一种基于矩阵灰建模的参数模型法提取特征的方法,提高了P300单次识别率.首先对脑电信号进行预处理,然后选择导联组合,接着对每个Epoch进行建模,将模型参数作为特征向量输入SVM分类识别.结果表明,单次P300的平均识别率为91.43%,叠加平均3次正确率可高达97.87%.     

基于机器视觉的分级车牌字符识别方法

为提高车牌字符识别率,提出一种考虑整体和局部特征,分别采用两级SVM分类器的识别方法,其工作模式为:第一级分类器针对所有字符,在识别结果属于形似字符的情况下,送入对应的第二级分类器作进一步识别。第一级分类器提取字符图像整体的各网格比例作为SVM的分类特征。将形似字符分为5组,分别对应的5个SVM构成第二级分类器。通过分析各组内字符笔画特征的局部相异性,提取相应网格中字符轮廓的垂直、水平投影方差、比例等特征并进行特征融合作为相应SVM分类特征。实验结果表明,该方法字符平均识别时间为23.45 ms,且在形似字符的识别率和总体识别率方面均优于模板匹配、神经网络和同类的分级识别方法,是一种有效的方法。     

一种基于遗传算法的SVM决策树多分类方法

在当前的机器学习领域,如何利用支持向量机（SVM）对多类目标进行分类,同时提高分类器的分类效率已经成为研究的热点之一,有效地解决此问题对于提高目标的识别概率具有较大意义。本文针对SVM多分类问题提出了一种基于遗传算法的SVM最优决策树生成算法。算法以随机生成的决策树构建的SVM分类器对同一测试样本的分类正确率作为遗传算法的适应度函数,通过遗传算法寻找到最优决策树,再以最优决策树构建SVM分类器,最终实现SVM的多分类。将该算法应用于低空飞行声目标识别问题,实验结果表明,新方法比传统的1-a-1、1-a-r、SVM-DL和GADT-SVM方法有更高的分类精度和更短的分类时间。      

基于SVM及其改进算法的fMRI图像分类性能研究

为了提出一种更适用于分析fMRI图像特征的机器学习算法,引入机器学习近年提出的、具有较好的泛化能力、并能够保证极值解是全局最优解的新方法支持向量机（SVM）算法,具体选择了PSVM、SSVM、LPSVM、NSVM 4种SVM改进算法以及基本SVM算法应用于fMRI图像的分类问题,在MATLAB平台上进行了算法仿真实现。在对各种算法的分类计算时间、分类精确度两个方面进行比较和讨论后,得到PSVM算法在fMRI图像的分类问题上,有较好的综合性能。     

Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine

The feasibility of classifying different human activities based on micro-Doppler signatures is investigated. Measured data of 12 human subjects performing seven different activities are collected using a Doppler radar. The seven activities include running, walking, walking while holding a stick, crawling, boxing while moving forward, boxing while standing in place, and sitting still. Six features are extracted from the Doppler spectrogram. A support vector machine (SVM) is then trained using the measurement features to classify the activities. A multiclass classification is implemented using a decision-tree structure. Optimal parameters for the SVM are found through a fourfold cross-validation. The resulting classification accuracy is found to be more than 90%. The potentials of classifying human activities over extended time duration, through wall, and at oblique angles with respect to the radar are also investigated and discussed.     

基于支持向量机的混凝土结构中钢筋腐蚀的判别

提出了一种基于多因素的混凝土中钢筋腐蚀判别方法.该方法综合考虑影响钢筋腐蚀的多个因素的共同作用,克服了以往单因素判别钢筋腐蚀不够客观的弊端.本文首先通过相关分析比较各个影响因素的相关性,然后通过变量聚类对多个影响因素分类,选出典型变量建立基于支持向量机的钢筋腐蚀状态分类器,最后在实际工程中检验了其判断的准确性,并对比了以往曾有学者根据Fisher准则建立的分类器的判别结果.结果表明,基于支持向量机的分类器分类准确率优于基于Fisher准则的分类器.     

用于高阶MPPSK 信号检测的SVM新算法

为了降低支持向量机(SVM)算法在高阶多元位置相移键控（M-ary Position Phase Shift Keying,MPPSK）系统的信号检测复杂度,在分析常用SVM多分类算法的基础上,提出了一种新的具有更低复杂度的类二分法SVM。为了进一步提高高阶MPPSK信号检测性能,提出一种新的SVM特征向量提取方法,调制矩阵法,并将两种方法结合起来,用于高阶MPPSK系统的信号检测。仿真结果表明:类二分法SVM能显著降低多分类SVM的算法复杂度,调制矩阵选取特征向量法能够显著提高高阶MPPSK系统的检测性能,两种方法结合用于高阶MPPSK系统,可以在有效降低复杂度的前提下保证期望的检测性能。      

基于局部竞争策略的极化SAR图像精细分类

合成孔径雷达（Synthetic Aperture Radar, SAR）成像技术已经成为一种高分辨对地观测的重要手段之一,而极化SAR图像地物分类一直是其中的研究热点。基于复Wishart分布的最大似然（Maximum Likelihood,ML）分类器是最经典的极化SAR图像分类算法之一,但由于地物类型的复杂性、区域的不均匀性等原因使得基于像素的ML-Wishart分类器的分类精度不高。针对这个问题,本文提出了一种基于复Wishart分布的局部最大后验概率（Maximum a Posteriori,MAP）竞争方法,该算法通过计算伪先验概率,并在每个像素的局部窗口中实施MAP分类器,可以提高复杂区域图像的分类精度。该文主要研究了4种基于Wishart分布的分类算法,包括经典复Wishart分类算法、混合复Wishart模型、基于马尔科夫随机场（Markov Random Field, MRF）的混合复Wishart模型和基于局部竞争策略的MAP分类算法。在混合模型建模中,不同于以往的对整幅图像进行建模的模型策略,本文采用对单个类别进行混合建模的策略。实验对比分析了上述4个分类器和SVM分类器在C波段RADARSAT-2多时相的全极化SAR农田数据上的分类效果。实验结果表明,所提出的基于局部竞争策略的分类器对数据的分类结果稳定,具有最高的分类精度,基于混合Wishart的MRF模型分类结果次之。     

Combining feature scaling estimation with SVM classifier design using GA approach

This letter adopts a GA （Genetic Algorithm） approach to assist in learning scaling of features that are most favorable to SVM （Support Vector Machines） classifier, which is named as GA-SVM. The relevant coefficients of various features to the classification task, measured by real-valued scaling, are estimated efficiently by using GA. And GA exploits heavy-bias operator to promote sparsity in the scaling of features. There are many potential benefits of this method： Feature selection is performed by eliminating irrelevant features whose scaling is zero, an SVM classifier that has enhanced generalization ability can be learned simultaneously. Experimental comparisons using original SVM and GA-SVM demonstrate both economical feature selection and excellent classification accuracy on junk e-mail recognition problem and Internet ad recognition problem. The experimental results show that comparing with original SVM classifier, the number of support vector decreases significantly and better classification results are achieved based on GA-SVM. It also demonstrates that GA can provide a simple, general, and powerful framework for tuning parameters in optimal problem, which directly improves the recognition performance and recognition rate of SVM.     

基于粒子群优化-支持向量机方法的下肢肌电信号步态识别

为提高下肢表面肌电信号步态识别的准确性和实时性,该文提出一种基于粒子群优化(PSO)算法优化支持向量机(SVM)的模式识别方法。首先对消噪后的肌电信号提取积分肌电值和方差作为特征样本,然后利用PSO算法优化SVM的惩罚参数和核函数参数,最后利用步态动作的肌电信号样本数据对构造的SVM分类器进行训练、测试。实验结果表明PSO-SVM分类器对下肢正常行走5个步态的识别率,明显高于未经参数优化的SVM分类器,优化后平均识别率达到97.8%,并兼顾了分类的准确性和自适应性。     

Intelligent hybrid approaches for human ECG signals identification

This paper presents hybrid approaches for human identification based on electrocardiogram (ECG). The proposed approaches consist of four phases, namely data acquisition, preprocessing, feature extraction and classification. In the first phase, data acquisition phase, data sets are collected from two different databases, ECG-ID and MIT-BIH Arrhythmia database. In the second phase, noise reduction of ECG signals is performed by using wavelet transform and a series of filters used for de-noising. In the third phase, features are obtained by using three different intelligent approaches: a non-fiducial, fiducial and a fusion approach between them. In the last phase, the classification approach, three classifiers are developed to classify subjects. The first classifier is based on artificial neural network (ANN). The second classifier is based on K-nearest neighbor (KNN), relying on Euclidean distance. The last classifier is support vector machine (SVM) classification accuracy of 95% is obtained for ANN, 98 % for KNN and 99% for SVM on the ECG-ID database, while 100% is obtained for ANN, KNN, and SVM on MIT-BIH Arrhythmia database. The results show that the proposed approaches are robust and effective compared with other recent works.     

一种基于二值粒子群优化和支持向量机的目标检测算法

针对复杂场景下目标检测和目标检测中特征选择问题,该文将二值粒子群优化算法(BPSO)用于特征选择,结合支持向量机(SVM)技术提出了一种新颖的基于BPSO-SVM特征选择的自动目标检测算法。该算法将目标检测转化为目标识别问题,采用wrapper特征选择模型,以SVM为分类器,通过样本训练分类器,根据分类结果,利用BPSO算法在特征空间中进行全局搜索,选择最优特征集进行分类。基于BPSO-SVM的特征选择方法降低了特征维数,显著提高了分类器性能。实验结果表明,该文算法不仅有效提高了复杂场景下目标姿态、尺度、光照变化和局部被遮挡时的检测准确率,还大大缩短了检测时间。     

Support vector machine-based classification scheme for myoelectric control applied to upper limb

This paper proposes and evaluates the application of support vector machine (SVM) to classify upper limb motions using myoelectric signals. It explores the optimum configuration of SVM-based myoelectric control, by suggesting an advantageous data segmentation technique, feature set, model selection approach for SVM, and postprocessing methods. This work presents a method to adjust SVM parameters before classification, and examines overlapped segmentation and majority voting as two techniques to improve controller performance. A SVM, as the core of classification in myoelectric control, is compared with two commonly used classifiers: linear discriminant analysis (LDA) and multilayer perceptron (MLP) neural networks. It demonstrates exceptional accuracy, robust performance, and low computational load. The entropy of the output of the classifier is also examined as an online index to evaluate the correctness of classification; this can be used by online training for long-term myoelectric control operations.     

凸组合核函数的支持向量机高光谱图像分类

支持向量机的高光谱图像分类中,单核函数存在局限性。为了提高分类器的分类精度和支持向量机模型的泛化能力,利用高斯径向基核和多层感知核进行凸组合构造复合核函数支持向量机,证明了该函数满足作为核函数的判决Mercer条件,并进一步将凸组合核函数支持向量机应用到高光谱图像分类中,完成了建模和实验验证。实验结果表明,凸组合核函数具有较好的鲁棒性,且该类支持向量机的分类精度和KAPPA系数较单核SVM均得到了有效的提高,是一种解决多分类问题行之有效的分类器。     

An accurate traffic classification model based on support vector machines

Network traffic classification is a fundamental research topic on high‐performance network protocol design and network operation management. Compared with other state‐of‐the‐art studies done on the network traffic classification, machine learning (ML) methods are more flexible and intelligent, which can automatically search for and describe useful structural patterns in a supplied traffic dataset. As a typical ML method, support vector machines (SVMs) based on statistical theory has high classification accuracy and stability. However, the performance of SVM classifier can be severely affected by the data scale, feature dimension, and parameters of the classifier. In this paper, a real‐time accurate SVM training model named SPP‐SVM is proposed. An SPP‐SVM is deducted from the scaling dataset and employs principal component analysis (PCA) to extract data features and verify its relevant traffic features obtained from PCA. By employing PCA algorithm to do the dimension extraction, SPP‐SVM confirms the critical component features, reduces the redundancy among them, and lowers the original feature dimension so as to reduce the over fitting and increase its generalization effectively. The optimal working parameters of kernel function used in SPP‐SVM are derived automatically from improved particle swarm optimization algorithm, which will optimize the global solution and make its inertia weight coefficient adaptive without searching for the parameters in a wide range, traversing all the parameter points in the grid and adjusting steps gradually. The performance of its two‐ and multi‐class classifiers is proved over 2 sets of traffic traces, coming from different topological points on the Internet. Experiments show that the SPP‐SVM's two‐ and multi‐class classifiers are superior to the typical supervised ML algorithms and performs significantly better than traditional SVM in classification accuracy, dimension, and elapsed time.     

Alzheimer's diagnosis using eigenbrains and support vector machines

An accurate and early diagnosis of the Alzheimer's disease (AD) is of fundamental importance for the patient's medical treatment. Single photon emission computed tomography (SPECT) images are commonly used by physicians to assist the diagnosis. Presented is a computer-assisted diagnosis tool based in a principal component analysis (PCA) dimensional reduction of the feature space approach and a support vector machine (SVM) classification method for improving the AD diagnosis accuracy by means of SPECT images. The most relevant image features were selected under a PCA compression, which diagonalises the covariance matrix, and the extracted information was used to train an SVM classifier, which could classify new subjects in an unsupervised manner.     

Automatic image orientation detection

We present an algorithm for automatic image orientation estimation using a Bayesian learning framework. We demonstrate that a small codebook (the optimal size of codebook is selected using a modified MDL criterion) extracted from a learning vector quantizer (LVQ) can be used to estimate the class-conditional densities of the observed features needed for the Bayesian methodology. We further show how principal component analysis (PCA) and linear discriminant analysis (LDA) can be used as a feature extraction mechanism to remove redundancies in the high-dimensional feature vectors used for classification. The proposed method is compared with four different commonly used classifiers, namely k-nearest neighbor, support vector machine (SVM), a mixture of Gaussians, and hierarchical discriminating regression (HDR) tree. Experiments on a database of 16 344 images have shown that our proposed algorithm achieves an accuracy of approximately 98% on the training set and over 97% on an independent test set. A slight improvement in classification accuracy is achieved by employing classifier combination techniques.     

基于多尺度样本扩增的高光谱影像半监督分类

大量的训练样本可有效缓解模型过拟合,从而提高分类效果。在初始标记样本较少的情况下,开展借助不同尺度的同质区快速扩增大量高精度训练样本的实验,并利用初始标记样本和扩增样本训练支持向量机(Support Vector Machine, SVM)分类器,实现对高光谱数据的有效分类。该方法在Pavia University、Salinas和Indian Pines三种高光谱数据上均能获得大量高精度的训练样本,分类精度分别达到99%、99%和97%以上。实验结果表明,扩增的大量伪标签样本可以有效训练SVM分类器,提高分类效果。