非平衡数据集分类研究

现实世界中存在着非平衡数据集,即数据集中的一类样本数量远大于另一类。而少数类样本的识别通常是人们首要关心的,将少数类样本误分为多数类要比将多数类样本误分为少数类付出更高的代价。传统的机器学习算法可能会产生偏向多数类的结果,因而对于少数类而言,预测的效果会很差。在对目前国内外非平衡数据集研究现状深入分析的基础上,针对非平衡数据集数据复杂度研究和失衡解决方法研究两个方向相对孤立及缺乏系统性的缺陷,提出了一种非平衡数据集整体解决框架,以满足日益迫切的应用需求。

Research on Imbalanced Dataset Learning Method

A dataset is imbalanced if the classification categories are not approximately equally represented.Often real-world datasets are predominately composed of ＂normal＂ examples with only a small percentage of ＂abnormal＂ or ＂interesting＂ examples.It is also the case that the cost of misclassifying an abnormal（interesting） example as a normal example is often much higher than the cost of the reverse error.Traditional machine learning algorithms may be biased towards the majority class,thus producing poor predictive accuracy over the minority class.Based on the deep analysis on current research about rare cases classification,proposes a learning framework to address the problem of relative isolation of research between data complexity and solution of imbalanced data,and lack of systematic defects to meet the increasingly urgent applications.