首页 | 本学科首页   官方微博 | 高级检索  
     

面向不均衡数据集的过抽样算法
引用本文:崔鑫,徐华,宿晨.面向不均衡数据集的过抽样算法[J].计算机应用,2020,40(6):1662-1667.
作者姓名:崔鑫  徐华  宿晨
作者单位:江南大学 物联网工程学院,江苏 无锡 214122
摘    要:合成少数类过抽样技术(SMOTE)中的噪声样本可能参与合成新样本,所以难以保证新样本的合理性。针对这个问题,结合聚类算法提出了改进算法CSMOTE。该算法抛弃了SMOTE在最近邻间线性插值的思想,使用少数类的簇心与其对应簇中的样本进行线性插值合成新样本,并且对参与合成的样本进行了筛选,降低了噪声样本参与合成的可能。在六个实际数据集上,将CSMOTE算法与四个SMOTE的改进算法以及两种欠抽样算法进行了多次的对比实验,CSMOTE算法在所有数据集上均获得了最高的AUC值。实验结果表明,CSMOTE算法具有更高的分类性能,可以有效解决数据集中样本分布不均衡的问题。

关 键 词:簇心  不均衡数据集  合成少数类过抽样技术  聚类  过采样  
收稿时间:2019-10-27
修稿时间:2019-12-17

Over-sampling algorithm for imbalanced datasets
CUI Xin,XU Hua,SU Chen.Over-sampling algorithm for imbalanced datasets[J].journal of Computer Applications,2020,40(6):1662-1667.
Authors:CUI Xin  XU Hua  SU Chen
Affiliation:School of Internet of Things Engineering, Jiangnan University, Wuxi Jiangsu 214122, China
Abstract:In Synthetic Minority Over-sampling TEchnique (SMOTE), noise samples may participate in the synthesis of new samples, so it is difficult to guarantee the rationality of the new samples. Aiming at this problem, combining clustering algorithm, an improved algorithm called Clustered Synthetic Minority Over-sampling TEchnique (CSMOTE) was proposed. In the algorithm, the idea of the linear interpolation between the nearest neighbors was abandoned, and the linear interpolation between the cluster centers of minority classes and the samples of corresponding clusters was used to synthesize new samples. And the samples involved in the synthesis were screened to reduce the possibility of noise samples participating in the synthesis. On six actual datasets, CSMOTE algorithm was compared with four SMOTE’s improved algorithms and two under-sampling algorithms for many times, and CSMOTE algorithm obtained the highest AUC values on all datasets. Experimental results show that CSMOTE algorithm has higher classification performance and can effectively solve the problem of unbalanced sample distribution in the datasets.
Keywords:cluster center                                                                                                                        imbalanced dataset                                                                                                                        Synthetic Minority Over-sampling TEchnique (SMOTE)                                                                                                                        clustering                                                                                                                        over-sampling
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机应用》浏览原始摘要信息
点击此处可从《计算机应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号