基于混沌机制的人工蜂群算法优化的支持向量机分类器

支持向量机的分类性能在很大程度上取决于其相关参数的选择,为了改善支持向量机的分类准确率,本文采用基于混沌机制的人工蜂群算法对其参数进行优化。在传统人工蜂群算法的基础上,采用Logistic混沌映射初始化种群和锦标赛选择策略,进一步提高人工蜂群算法的收敛速度和寻优精度。该方法采用分类准确率作为适应度函数,利用人工蜂群算法对支持向量机的惩罚因子和核函数参数进行优化。通过对多个标准数据集的分类测试,证明基于混沌机制的人工蜂群算法优化的支持向量机分类器能够获得更高的分类准确率。     

Gene selection using genetic algorithm and support vectors machines

In this paper, we present a gene selection method based on genetic algorithm (GA) and support vector machines (SVM) for cancer classification. First, the Wilcoxon rank sum test is used to filter noisy and redundant genes in high dimensional microarray data. Then, the different highly informative genes subsets are selected by GA/SVM using different training sets. The final subset, consisting of highly discriminating genes, is obtained by analyzing the frequency of appearance of each gene in the different gene subsets. The proposed method is tested on three open datasets: leukemia, breast cancer, and colon cancer data. The results show that the proposed method has excellent selection and classification performance, especially for breast cancer data, which can yield 100% classification accuracy using only four genes.     

基于遗传算法优化SVM的嵌入式网络系统异常入侵检测

由于传统嵌入式网络系统入侵检测方法难以获得较高的检测精度,提出基于遗传算法优化的支持向量机(GA-SVM)的网络入侵检测技术.支持向量机分类器能够较好地解决少样本、高维、非线性分类问题.然而,支持向量机训练参数的选择对其分类精度有着很大影响,遗传算法能够同时优化支持向量机的训练参数,采用遗传算法进行支持向量机的训练参数同步优化.实验结果表明,这种遗传算法优化的支持向量机分类入侵检测模型有着很高的检测精度.     

人工鱼群算法在SVM参数优化选择中的应用

针对支持向量机的参数优化缺乏理论支持,而SVM交叉检验法选取又较为费时的情况下,提出了基于人工鱼群算法的支持向量机参数优化选取算法,并以SVM分类预测准确率最大为优化原则,利用人工鱼群算法的较好并行性和较强的全局寻优能力,以实现最优目标并得到SVM的最优参数组合。数值实验结果表明：人工鱼群算法在SVM参数优化选取中具有更快的寻优性能,同时具有较高的分类准确率。该方法具有较好的并行性和较强的全局寻优能力。     

一种新的分裂层次聚类SVM多值分类器

提出一种分裂层次聚类SVM分类树分类方法.该方法通过融合模糊聚类技术和支持向量机算法,利用分裂的层次聚类策略,有选择地重新构造学习样本集和SVM子分类器,得到了一种树形多值分类器.研究结果表明,对于k类别模式识别问题,该方法只需构造k-1个SVM子分类器,克服了SVM子分类器过多以及存在不可区分区域的缺点,具有良好的分类性能.实验结果验证了该方法的优越性.     

基于差分进化算法的支持向量机参数选择

支持向量机参数是影响其性能的重要因素,为了进一步提高支持向量机分类精度和泛化能力,提出了基于差分进化算法的SVM参数选择。以样本误判率最小为优化准则,利用差分进化算法对SVM参数进行优化选择。实验结果表明,利用差分进化算法选择SVM参数,加快了参数搜索的速度,提高了SVM分类精度,该方法具有良好的鲁棒性和较强的全局寻优能力。     

Performance evaluation of score level fusion in multimodal biometric systems

In a multimodal biometric system, the effective fusion method is necessary for combining information from various single modality systems. In this paper the performance of sum rule-based score level fusion and support vector machines (SVM)-based score level fusion are examined. Three biometric characteristics are considered in this study: fingerprint, face, and finger vein. We also proposed a new robust normalization scheme (Reduction of High-scores Effect normalization) which is derived from min-max normalization scheme. Experiments on four different multimodal databases suggest that integrating the proposed scheme in sum rule-based fusion and SVM-based fusion leads to consistently high accuracy. The performance of simple sum rule-based fusion preceded by our normalization scheme is comparable to another approach, likelihood ratio-based fusion [8] (Nandakumar et al., 2008), which is based on the estimation of matching scores densities. Comparison between experimental results on sum rule-based fusion and SVM-based fusion reveals that the latter could attain better performance than the former, provided that the kernel and its parameters have been carefully selected.     

Hybrid Harmony Search Combined with Stochastic Local Search for Feature Selection

Feature selection is a challenging task that has been the subject of a large amount of research, especially in relation to classification tasks. It permits to eliminate the redundant attributes and enhance the classification accuracy by keeping only the relevant attributes. In this paper, we propose a hybrid search method based on both harmony search algorithm (HSA) and stochastic local search (SLS) for feature selection in data classification. A novel probabilistic selection strategy is used in HSA–SLS to select the appropriate solutions to undergo stochastic local refinement, keeping a good compromise between exploration and exploitation. In addition, the HSA–SLS is combined with a support vector machine (SVM) classifier with optimized parameters. The proposed HSA–SLS method tries to find a subset of features that maximizes the classification accuracy rate of SVM. Experimental results show good performance in favor of our proposed method.     

A new multi-unit iris authentication based on quality assessment and score level fusion for mobile phones

Although iris recognition technology has been reported to be more stable and reliable than other biometric systems, performance can be degraded due to many factors such as small eyes, camera defocusing, eyelash occlusions and specular reflections on the surface of glasses. In this paper, we propose a new multi-unit iris authentication method that uses score level fusion based on a support vector machine (SVM) and a quality assessment method for mobile phones. Compared to previous research, this paper presents the following two contributions. First, we reduced the false rejection rate and improved iris recognition accuracy by using iris quality assessment. Second, if even two iris images were determined to be of bad quality, we captured the iris images again without using a recognition process. If only one iris image among the left and right irises was regarded as a good one, it was used for recognition. However, if both the left and right iris images were good, we performed multi-unit iris recognition using score level fusion based on a SVM. Experimental results showed that the accuracy of the proposed method was superior to previous methods that used only one good iris image or those methods that used conventional fusion methods.     

基于特征层融合的模拟电路故障诊断方法

为了提高模拟电路软故障诊断精度,提出了基于特征层融合的模拟电路故障诊断方法.通过小波变换的频带能量和AR模型的系数生成故障的初始特征,利用线性判别分析提取特征,降低特征向量的维数,结合mRMR原则与支持向量机构成的组合特征选择方法,对降维后特征进行最优选择,输入到训练好的支持向量机多分类器中进行分类,从而降低特征的冗余,提高故障诊断的精度.以某车辆电压调节电路为例进行仿真分析,实验结果表明,该方法有很好的诊断能力.     

Feature selection for hyperspectral data based on recursive support vector machines

In this article, a feature selection algorithm for hyperspectral data based on a recursive support vector machine (R‐SVM) is proposed. The new algorithm follows the scheme of a state‐of‐the‐art feature selection algorithm, SVM recursive feature elimination or SVM‐RFE, and uses a new ranking criterion derived from the R‐SVM. Multiple SVMs are used to address the multiclass problem. The algorithm is applied to Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) data to select the most informative bands and the resulting subsets of the bands are compared with SVM‐RFE using the accuracy of classification as the evaluation of the effectiveness of the feature selection. The experimental results for an agricultural case study indicate that the feature subset generated by the newly proposed algorithm is generally competitive with SVM‐RFE in terms of classification accuracy and is more robust in the presence of noise.     

Multi-fault classification based on support vector machine trained by chaos particle swarm optimization

A novel method of training support vector machine (SVM) by using chaos particle swarm optimization (CPSO) is proposed. A multi-fault classification model based on the SVM trained by CPSO is established and applied to the fault diagnosis of rotating machines. The results show that the method of training SVM using CPSO is feasible, the proposed fault classification model outperforms the neural network trained by chaos particle swarm optimization and least squares support vector machine, the precision and reliability of the fault classification results can meet the requirement of practical application.     

A distributed PSO–SVM hybrid system with feature selection and parameter optimization

This study proposed a novel PSO–SVM model that hybridized the particle swarm optimization (PSO) and support vector machines (SVM) to improve the classification accuracy with a small and appropriate feature subset. This optimization mechanism combined the discrete PSO with the continuous-valued PSO to simultaneously optimize the input feature subset selection and the SVM kernel parameter setting. The hybrid PSO–SVM data mining system was implemented via a distributed architecture using the web service technology to reduce the computational time. In a heterogeneous computing environment, the PSO optimization was performed on the application server and the SVM model was trained on the client (agent) computer. The experimental results showed the proposed approach can correctly select the discriminating input features and also achieve high classification accuracy.     

一种改进的支持向量机的室内指纹定位技术

为提高室内定位算法定位的精度和实时性,提出一种改进的支持向量机(A-SVM)的室内指纹定位方法。利用SVM具有较好的学习和泛化能力的特点,把定位匹配转换为多分类问题。为克服SVM分类存在的片面性问题,提出基于SVM与反K近邻融合的位置指纹分类方法得到估计位置,并利用卡尔曼滤波对估计位置进行滤波处理。实验结果表明,算法有效减小了定位结果的波动性,与传统SVM相比具有较高的定位精度。     

Parameter determination of support vector machine and feature selection using simulated annealing approach

Support vector machine (SVM) is a novel pattern classification method that is valuable in many applications. Kernel parameter setting in the SVM training process, along with the feature selection, significantly affects classification accuracy. The objective of this study is to obtain the better parameter values while also finding a subset of features that does not degrade the SVM classification accuracy. This study develops a simulated annealing (SA) approach for parameter determination and feature selection in the SVM, termed SA-SVM.To measure the proposed SA-SVM approach, several datasets in UCI machine learning repository are adopted to calculate the classification accuracy rate. The proposed approach was compared with grid search which is a conventional method of performing parameter setting, and various other methods. Experimental results indicate that the classification accuracy rates of the proposed approach exceed those of grid search and other approaches. The SA-SVM is thus useful for parameter determination and feature selection in the SVM.     

Fault diagnosis of power transformer based on support vector machine with genetic algorithm

Diagnosis of potential faults concealed inside power transformers is the key of ensuring stable electrical power supply to consumers. Support vector machine (SVM) is a new machine learning method based on the statistical learning theory, which is a powerful tool for solving the problem with small sampling, nonlinearity and high dimension. The selection of SVM parameters has an important influence on the classification accuracy of SVM. However, it is very difficult to select appropriate SVM parameters. In this study, support vector machine with genetic algorithm (SVMG) is applied to fault diagnosis of a power transformer, in which genetic algorithm (GA) is used to select appropriate free parameters of SVM. The experimental data from several electric power companies in China are used to illustrate the performance of the proposed SVMG model. The experimental results indicate that the SVMG method can achieve higher diagnostic accuracy than IEC three ratios, normal SVM classifier and artificial neural network.     

基于深度学习的虹膜人脸多特征融合识别

传统多生物特征融合识别方法中人工设计特征提取存在盲目性和差异性,特征融合存在空间不匹配或维度过高等问题,为此提出一种基于深度学习的多生物特征融合识别方法。通过卷积神经网络(convolutional neural networks,CNN)提取人脸和虹膜特征、参数化t-SNE算法特征降维和支持向量机(support vector machine,SVM)分类组合进行融合识别。实验结果表明,该融合识别方法与单一生物特征识别以及其它融合识别方法相比,鲁棒性增强,识别性能提升明显。     

基于克隆选择的差分进化算法及其在SVM中的应用

支持向量机参数是影响其性能的重要因素,但对支持向量机核参数的选取仍没有形成一套成熟的理论,从而严重影响了其广泛的应用。将克隆选择算法引入差分进化算法,对基本克隆选择算法和差分进化算法中的策略进行改进。将两种改进的算法进行融合,提出了一种基于克隆选择的差分进化算法,并将其应用于SVM核参数的优化中。测试结果表明,该算法不仅可以有效避免差分进化算法易早熟收敛的问题,而且寻优能力得到显著提高;在UCI数据库wine数据中的应用表明,利用克隆选择差分进化算法优化SVM核参数加快了参数搜索的速度,提高了SVM预测精度和泛化能力,具有较高的分类准确率和较好的推广性能。     

一种推广高斯核模型设计及其优化

支持向量机分类中,不同属性对分类的贡献往往不同,针对此问题,在核函数中引入属性权重,提出一种推广的高斯核模型,同时以最小化k-fold交叉验证误差为目标,采用粒子群算法进行推广高斯核的模型选择。最后通过UCI上标准数据集进行实验,证实该方法能够有效提高支持向量机的推广能力。     

改进人工鱼群算法在SVM参数优化中的应用

支持向量机的参数优化一直是一个重要的研究方向。参数的好坏很大程度上决定了支持向量机的分类精度和泛化能力。针对人工鱼群算法优化支持向量机参数时,容易在后期徘徊于最优解附近、难以逼近的问题,提出了人工鱼群加速算法,使用速度参数代替人工鱼步长,从而求得最优目标并得到SVM的最优参数组合。仿真实验结果表明：该算法收敛速度快,求解数值精度高,对初值的依赖程度低,在SVM参数优化中具有更好的性能、更高的分类准确率,是一个极其有效的参数优化方法。