一种基于遗传算法的SVM决策树多分类策略研究

提出了一种基于遗传算法(GA)的SVM最优决策树生成算法,并将其应用于解决SVM多分类问题.首先以最大分类间隔为准则,利用遗传算法对传统的SVM决策树进行优化,生成最优(或近优)决策二叉树;然后在各个决策节点,利用传统的SVM算法进行二值分类,最终实现SVM的多值分类.理论分析及实验结果表明,新方法比传统的DT-SVM、DAG-SVM方法有更高的分类精度,比经典的1-a-1、1-a-r有更高的训练和分类效率.     

一种基于遗传算法的SVM决策树多分类方法

在当前的机器学习领域,如何利用支持向量机（SVM）对多类目标进行分类,同时提高分类器的分类效率已经成为研究的热点之一,有效地解决此问题对于提高目标的识别概率具有较大意义。本文针对SVM多分类问题提出了一种基于遗传算法的SVM最优决策树生成算法。算法以随机生成的决策树构建的SVM分类器对同一测试样本的分类正确率作为遗传算法的适应度函数,通过遗传算法寻找到最优决策树,再以最优决策树构建SVM分类器,最终实现SVM的多分类。将该算法应用于低空飞行声目标识别问题,实验结果表明,新方法比传统的1-a-1、1-a-r、SVM-DL和GADT-SVM方法有更高的分类精度和更短的分类时间。      

基于可变特征空间SVM的互联网流量分类

支持向量机（support vector machine,SVM）是一类具有良好泛化能力的机器学习算法,适合应用于互联网动态环境下的流量分类问题。目前将SVM扩展到流量分类这样的多分类问题的方法主要有One-Against-All和One-Against-One方法。这些方法都基于单一的特征空间训练SVM两分类器,没有考虑到不同特征对不同流量类的不同区分能力,因此获得的分离超平面并不是最合理的。为此提出了可变特征空间的SVM集成方法,即为每个两分类 SVM 构建具有最优区分能力的独立特征空间,单独训练两分类 SVM,最后再利用One-Against-All和One-Against-One方法集成为多分类器。实验表明,与原来的单一特征空间的One-Against-All和One-Against-One集成方法相比,提出的方法能有效提高流量分类器分类精度和召回率,更易获得最优分离超平面。     

基于高阶累积量的核Logistic回归调制分类算法

针对现有数字信号调制识别的问题,提出了一种基于核 Logistic 回归(KLR)的自动分类方法.该方法提取了信号的高阶累积量参数用作训练与测试数据,采取常用的决策树分类构架的思想,仿真并比较已有的基于支撑向量机(SVM)的调制分类方法,结果表明,在低信噪比为0 dB时,分类性能一般高于 SVM;5 dB时,采用 KLR的分类识别率均达到90%以上,有较为优越的分类性能.     

基于最短划分距离的网络流量决策树分类方法

对不同类别的应用数据流,根据其在最初若干分组中进行握手和参数协商的差异性,通过通信模式、载荷长度以及信息熵等特征,采用基于最短划分距离的方法构建决策树模型,对其进行流量分类。经过在4个不同类型的真实网络数据集上的离线分类实验,以及在校园网环境中的在线流量分类实验。结果表明该模型对8种常见协议的网络流量,分析其前4到6个分组的特征,能够在分类准确性和系统开销上取得较好的效果。与其他机器学习算法相比,该模型构建的决策树规模较小,分类时间较短,适合于实时流量分类问题。     

遥感图像分类中的遗传算法LVQ神经网络运用

对于遥感图像分类过程中的问题,提出遗传算法LVQ神经网络来实现遥感图像的分类。将LVQ神经网络结合遗传算法,使用遗传算法最优阈值与权值实现网络训练,使分类精度得到提高。之后融合相似灰度值创建分类图像特征矢量,使特征矢量在神经网络中输入实现训练。学习矢量量化神经算法对初值非常敏感,对遥感图像分类精度具有一定影响。最后,为了对性能进行测试,在实验过程中对比本文分类方法和SVM决策树分类方法,通过实验结果表示,文中提出的分类方法的遥感图像分类精度为95.82%,与其他分类方法相比,分类精度得到进一步提高。     

基于FCM隶属度的支持向量机

传统SVM在训练大规模数据集时,训练速度慢,时间消耗代价大.针对此问题,提出利用FCM算法对训练样本集进行预处理,依据样本隶属度提取出所有可能的支持向量进行SVM训练.利用原始数据集对算法进行验证,此算法在保证SVM分类精度的同时,大大提高了训练速度,算法具有可行性.     

对等网络流量信息结构异常的检测技术研究

随着信息技术的发展,对等网络P2P信息流量经常出现偏离正常范围的异常情况,这里以决策树算法为基础,对P2P流量检测和流量异常时的检测技术进行研究。采用改进的C4.5决策树P2P流量检测模型,通过P2P流量异常检测模型对大量训练数据集的训练,实现了对错误的逐步修正,通过试验室仿真试验可知,经过选择网络流量特征后,基于改进的C4.5决策树的P2P网络流量分类器能实现较好的分类效果,分类检测率在94.6%~96.7%,较高的检测率说明采用改进的C4.5决策树算法能有效地对P2P流量进行检测,为研究P2P流量异常检测技术提供了参考。     

面向审计领域的短文本分类技术研究

针对审计问题这种短文本所具有的特征稀疏、问题类别界限模糊问题,提出了一种改进的面向审计领域的短文本分类方法。该方法首先为审计问题构造了专门的特征集,以审计领域的同义词词集和法规库为基础,并结合特定规则来调整特征权重,然后以修改的SVM决策树作为多类分类器进行短文本分类。实验结果表明,该方法在对审计问题分类的应用上,具有较为满意的正确率,能满足实际的分类需求。     

一种基于Hadoop平台CloudSVM的网络流量分类方法

大规模的netflow训练数据集是构建高质量、高稳定网络流量分类器的必然要求。但随着网络流特征维数的提高和数据集规模的扩大,无论是网络流的分析处理还是基于支持向量机(SVM)的分类器模型的训练,都无法在有效的时间内得到有效的处理结果。本文基于Hadoop云计算平台,采用MapReduce技术对SVM网络流量分类器进行分布式学习和训练,构建CloudSVM网络流量分类器。通过对来自校园网出口镜像的近2 T的大规模网络流量的跟踪文件的分布式存储和处理,对抽取的样本数据集进行分类,实验验证了基于Hadoop平台分布式存储和并行处理大规模网络数据集的高效率性,也验证了CloudSVM分类器在不降低分类准确度的情况下可以快速收敛到最佳,并随着大规模网络流样本的增加,SVM分类器训练的时间趋近平稳。     

Game Traffic Classification Using Statistical Characteristics at the Transport Layer

The pervasive game environments have activated explosive growth of the Internet over recent decades. Thus, understanding Internet traffic characteristics and precise classification have become important issues in network management, resource provisioning, and game application development. Naturally, much attention has been given to analyzing and modeling game traffic. Little research, however, has been undertaken on the classification of game traffic. In this paper, we perform an interpretive traffic analysis of popular game applications at the transport layer and propose a new classification method based on a simple decision tree, called an alternative decision tree (ADT), which utilizes the statistical traffic characteristics of game applications. Experimental results show that ADT precisely classifies game traffic from other application traffic types with limited traffic features and a small number of packets, while maintaining low complexity by utilizing a simple decision tree.     

基于决策树的空袭目标数据挖掘

为了更好地辅助决策人员进行空袭目标选择,首先分析了影响空袭目标选择的因素;利用Netica软件得到训练样本集;利用ID3算法构造决策树模型,并从中挖掘出空袭目标选择的14条规则;最后总结出目标选择遵循的6条指导原则。仿真结果表明,利用决策树进行空袭目标数据挖掘,准确率比较满意,是一种目标选择的新思路。     

A federated semi-supervised learning approach for network traffic classification

The classification of network traffic, which involves classifying and identifying the type of network traffic, is the most fundamental step to network service improvement and modern network management. Classic machine learning and deep learning methods have widely adopted in the field of network traffic classification. However, there are two major challenges in practice. One is the user privacy concern in cross-domain traffic data sharing for the purpose of training a global classification model, and the other is the difficulty to obtain large amount of labeled data for training. In this paper, we propose a novel approach using federated semi-supervised learning for network traffic classification, in which the federated server and clients from different domains work together to train a global classification model. Among them, unlabeled data are used on the client side, and labeled data are used on the server side. The experimental results derived from a public dataset show that the accuracy of the proposed approach can reach 97.81%, and the accuracy gap between the federated learning approach and the centralized training method is minimal.     

Research of the traffic characteristics for the real time online traffic classification

Aiming at the hysteretic characteristics of classification problem existed in current internet traffic identification field,this paper investigates the traffic characteristic suitable for the on-line traffic classification,such as quality of service (QoS).By the theoretical analysis and the experimental observation,two characteristics (the ACK-Len ab and ACK-Len ba) were obtained.They are the data volume which first be sent by the communication parties continuously.For these two characteristics only depend on data’s total length of the first few packets on the flow,network traffic can be classified in the early time when the flow arrived.The experiment based on decision tree C4.5 algorithm,with above 97% accuracy.The result indicated that the characteristics proposed can commendably reflect behavior patterns of the network application,although they are simple.     

KFDA and clustering based multiclass SVM for intrusion detection

To improve the classification accuracy and reduce the training time, an intrusion detection technology is proposed, which combines feature extraction technology and multiclass support vector machine （SVM） classification algorithm. The intrusion detection model setup has two phases. The first phase is to project the original training data into kernel fisher discriminant analysis （KFDA） space. The second phase is to use fuzzy clustering technology to cluster the projected data and construct the decision tree, based on the clustering results. The overall detection model is set up based on the decision tree. Results of the experiment using knowledge discovery and data mining （KDD） from 99 datasets demonstrate that the proposed technology can be an an effective way for intrusion detection.     

基于决策树和神经网络的农作物分类研究——以廊坊市为例

以河北省廊坊市永清县整个县域为研究区,以GF1-WFV 16 m分辨率影像为数据源,选取覆盖作物完整生长期多个时相的影像数据,构建作物归一化植被指数(Normalized Difference Vegetation Index,NDVI)时间序列。通过对研究区NDVI曲线的分析,发现利用该数据构建的NDVI时间序列可描述研究区作物的生长特性,体现当地不同作物的物候差异,能有效地区分出当地的种植模式。选取NDVI曲线上最大值、最小值、峰值的出现时间、峰值数量和阈值等特征参数构建决策树。根据研究区的物候历和对当地种植结构的调查,利用最佳时相的影像,针对某一种或特定几种作物进行分类提取。分别采用决策树分类、神经网络分类等方法进行精度验证,综合比较得出最佳的作物分类方法。研究结果表明,在永清县这一县域研究区,利用GF1-WFV 16 m分辨率多时相遥感数据进行作物分类,采用决策树分类、神经网络分类两种方法的精度分别为72.0729%、87.3%。利用决策树分类的效果最优。     

An accurate traffic classification model based on support vector machines

Network traffic classification is a fundamental research topic on high‐performance network protocol design and network operation management. Compared with other state‐of‐the‐art studies done on the network traffic classification, machine learning (ML) methods are more flexible and intelligent, which can automatically search for and describe useful structural patterns in a supplied traffic dataset. As a typical ML method, support vector machines (SVMs) based on statistical theory has high classification accuracy and stability. However, the performance of SVM classifier can be severely affected by the data scale, feature dimension, and parameters of the classifier. In this paper, a real‐time accurate SVM training model named SPP‐SVM is proposed. An SPP‐SVM is deducted from the scaling dataset and employs principal component analysis (PCA) to extract data features and verify its relevant traffic features obtained from PCA. By employing PCA algorithm to do the dimension extraction, SPP‐SVM confirms the critical component features, reduces the redundancy among them, and lowers the original feature dimension so as to reduce the over fitting and increase its generalization effectively. The optimal working parameters of kernel function used in SPP‐SVM are derived automatically from improved particle swarm optimization algorithm, which will optimize the global solution and make its inertia weight coefficient adaptive without searching for the parameters in a wide range, traversing all the parameter points in the grid and adjusting steps gradually. The performance of its two‐ and multi‐class classifiers is proved over 2 sets of traffic traces, coming from different topological points on the Internet. Experiments show that the SPP‐SVM's two‐ and multi‐class classifiers are superior to the typical supervised ML algorithms and performs significantly better than traditional SVM in classification accuracy, dimension, and elapsed time.