面向不均衡数据集的过抽样算法

合成少数类过抽样技术（SMOTE）中的噪声样本可能参与合成新样本，所以难以保证新样本的合理性。针对这个问题，结合聚类算法提出了改进算法CSMOTE。该算法抛弃了SMOTE在最近邻间线性插值的思想，使用少数类的簇心与其对应簇中的样本进行线性插值合成新样本，并且对参与合成的样本进行了筛选，降低了噪声样本参与合成的可能。在六个实际数据集上，将CSMOTE算法与四个SMOTE的改进算法以及两种欠抽样算法进行了多次的对比实验，CSMOTE算法在所有数据集上均获得了最高的AUC值。实验结果表明，CSMOTE算法具有更高的分类性能，可以有效解决数据集中样本分布不均衡的问题。     

A critical assessment of imbalanced class distribution problem: The case of predicting freshmen student attrition

Predicting student attrition is an intriguing yet challenging problem for any academic institution. Class-imbalanced data is a common in the field of student retention, mainly because a lot of students register but fewer students drop out. Classification techniques for imbalanced dataset can yield deceivingly high prediction accuracy where the overall predictive accuracy is usually driven by the majority class at the expense of having very poor performance on the crucial minority class. In this study, we compared different data balancing techniques to improve the predictive accuracy in minority class while maintaining satisfactory overall classification performance. Specifically, we tested three balancing techniques—over-sampling, under-sampling and synthetic minority over-sampling (SMOTE)—along with four popular classification methods—logistic regression, decision trees, neuron networks and support vector machines. We used a large and feature rich institutional student data (between the years 2005 and 2011) to assess the efficacy of both balancing techniques as well as prediction methods. The results indicated that the support vector machine combined with SMOTE data-balancing technique achieved the best classification performance with a 90.24% overall accuracy on the 10-fold holdout sample. All three data-balancing techniques improved the prediction accuracy for the minority class. Applying sensitivity analyses on developed models, we also identified the most important variables for accurate prediction of student attrition. Application of these models has the potential to accurately predict at-risk students and help reduce student dropout rates.     

不均衡数据下基于SVM的故障检测新算法

针对传统支持向量机(SVM)算法在数据不均衡情况下无法有效实现故障检测的不足,提出一种基于过抽样和代价敏感支持向量机相结合的故障检测新算法。该算法首先利用边界人工少数类过抽样技术(BSMOTE)实现训练样本的均衡。为减少人工增加样本带来的噪声影响,利用K近邻构造一个代价敏感的支持向量机(CSSVM)算法,利用每个样本的代价函数消除噪声样本对SVM算法分类精度的影响。将该算法应用在轴承故障检测中,并同传统的SVM算法,不同类代价敏感SVM-C算法,SVM和SMOTE相结合的算法进行比较,试验结果表明当样本不均衡时,建议算法的故障检测性能较其它算法有显著提高。     

基于遗传算法改进的少数类样本合成过采样技术的非平衡数据集分类算法

针对少数类样本合成过采样技术(SMOTE)在处理非平衡数据集分类问题时,为少数类的不同样本设置相同的采样倍率,存在一定的盲目性的问题,提出了一种基于遗传算法(GA)改进的SMOTE方法--GASMOTE.首先,为少数类的不同样本设置不同的采样倍率,并将这些采样倍率取值的组合编码为种群中的个体;然后,循环使用GA的选择、交叉、变异等算子对种群进行优化,在达到停机条件时获得采样倍率取值的最优组合;最后,根据找到的最优组合对非平衡数据集进行SMOTE采样.在10个典型的非平衡数据集上进行的实验结果表明:与SMOTE算法相比,GASMOTE在F-measure值上提高了5.9个百分点,在G-mean值上提高了1.6个百分点;与Borderline-SMOTE算法相比,GASMOTE在F-measure值上提高了3.7个百分点,在G-mean值上提高了2.3个百分点.该方法可作为一种新的解决非平衡数据集分类问题的过采样技术.     

不平衡数据下基于PSO-BP算法的输电线路弧垂预测

针对架空输电线路弧垂在计算过程中易受测量数据(温度、风速、档距等参数)影响的问题,提出了基于数据预处理的PSO-BP神经网络弧垂预测模型.对收集数据中部分样本缺失的情况,使用合成少数过采样技术(SMOTE)对不平衡样本进行合成;构建PSO-BP神经网络用于弧垂预测,使用不同工况条件的数据训练网络,实现弧垂预测的目的,并将网络的性能与传统的BP神经网络性能进行对比.实验结果表明,与传统BP神经网络模型相比,本文提出的模型进行弧垂值预测后所得的误差绝对值显著降低.本文提出的模型可以加快训练速度、提高预测精度.     

Decision support in machine vision system for monitoring of TFT-LCD glass substrates manufacturing

This study addresses classification methodology for the automatic inspection of a range of defects on the surface of glass substrates in thin film transistor liquid crystal display glass substrate manufacturing. The proposed methodology consisted of four stages: (1) feature extraction by calculating the wavelet co-occurrence signature from the substrate images, (2) handling of imbalanced dataset using the Synthetic Minority Over-sampling TEchnique (SMOTE), (3) reduction of the feature's dimension by principal component analysis, and (4) finally choosing the best classifier between three different methods: Classification And Regression Tree (CART), Multi-Layer Perceptron (MLP) and Support Vector Machine (SVM). In training the SVM and MLP classifiers, the simulated annealing algorithm was used to obtain the optimal tuning parameters for the classifiers. From the industrial case study, the proposed feature extraction algorithm could remove the defect-irrelevant image features and SMOTE increased the accuracy of all three methods. Furthermore, the optimized SVM and MLP models were more accurate than the CART model whereas a higher accuracy of 89.5% was observed for the proposed SVM model.     

基于分形SMOTE重采样集成算法圈定区域化探异常

基于分形自相似性理论改进SMOTE算法,实现数据集的均衡化。结合集成学习Adaboost技术更新样本权值,改善非均衡数据的分类性能,并对云南个旧锡铜多金属矿床进行了仿真实验,结果表明新算法预测结果能较好地检测成矿异常,为成矿预测与评价提供新的解决途径。     

Improving Routine Immunization Coverage Through Optimally Designed Predictive Models

Routine immunization (RI) of children is the most effective and timely public health intervention for decreasing child mortality rates around the globe. Pakistan being a low-and-middle-income-country (LMIC) has one of the highest child mortality rates in the world occurring mainly due to vaccine-preventable diseases (VPDs). For improving RI coverage, a critical need is to establish potential RI defaulters at an early stage, so that appropriate interventions can be targeted towards such population who are identified to be at risk of missing on their scheduled vaccine uptakes. In this paper, a machine learning (ML) based predictive model has been proposed to predict defaulting and non-defaulting children on upcoming immunization visits and examine the effect of its underlying contributing factors. The predictive model uses data obtained from Paigham-e-Sehat study having immunization records of 3,113 children. The design of predictive model is based on obtaining optimal results across accuracy, specificity, and sensitivity, to ensure model outcomes remain practically relevant to the problem addressed. Further optimization of predictive model is obtained through selection of significant features and removing data bias. Nine machine learning algorithms were applied for prediction of defaulting children for the next immunization visit. The results showed that the random forest model achieves the optimal accuracy of 81.9% with 83.6% sensitivity and 80.3% specificity. The main determinants of vaccination coverage were found to be vaccine coverage at birth, parental education, and socio-economic conditions of the defaulting group. This information can assist relevant policy makers to take proactive and effective measures for developing evidence based targeted and timely interventions for defaulting children.     

Type 2 Diabetes Risk Prediction Using Deep Convolutional Neural Network Based-Bayesian Optimization

Diabetes mellitus is a long-term condition characterized by hyperglycemia. It could lead to plenty of difficulties. According to rising morbidity in recent years, the world’s diabetic patients will exceed 642 million by 2040, implying that one out of every ten persons will be diabetic. There is no doubt that this startling figure requires immediate attention from industry and academia to promote innovation and growth in diabetes risk prediction to save individuals’ lives. Due to its rapid development, deep learning (DL) was used to predict numerous diseases. However, DL methods still suffer from their limited prediction performance due to the hyperparameters selection and parameters optimization. Therefore, the selection of hyper-parameters is critical in improving classification performance. This study presents Convolutional Neural Network (CNN) that has achieved remarkable results in many medical domains where the Bayesian optimization algorithm (BOA) has been employed for hyperparameters selection and parameters optimization. Two issues have been investigated and solved during the experiment to enhance the results. The first is the dataset class imbalance, which is solved using Synthetic Minority Oversampling Technique (SMOTE) technique. The second issue is the model's poor performance, which has been solved using the Bayesian optimization algorithm. The findings indicate that the Bayesian based-CNN model superbases all the state-of-the-art models in the literature with an accuracy of 89.36%, F1-score of 0.88.6, and Matthews Correlation Coefficient (MCC) of 0.88.6.     

A dynamic over-sampling procedure based on sensitivity for multi-class problems

Classification with imbalanced datasets supposes a new challenge for researches in the framework of machine learning. This problem appears when the number of patterns that represents one of the classes of the dataset (usually the concept of interest) is much lower than in the remaining classes. Thus, the learning model must be adapted to this situation, which is very common in real applications. In this paper, a dynamic over-sampling procedure is proposed for improving the classification of imbalanced datasets with more than two classes. This procedure is incorporated into a memetic algorithm (MA) that optimizes radial basis functions neural networks (RBFNNs). To handle class imbalance, the training data are resampled in two stages. In the first stage, an over-sampling procedure is applied to the minority class to balance in part the size of the classes. Then, the MA is run and the data are over-sampled in different generations of the evolution, generating new patterns of the minimum sensitivity class (the class with the worst accuracy for the best RBFNN of the population). The methodology proposed is tested using 13 imbalanced benchmark classification datasets from well-known machine learning problems and one complex problem of microbial growth. It is compared to other neural network methods specifically designed for handling imbalanced data. These methods include different over-sampling procedures in the preprocessing stage, a threshold-moving method where the output threshold is moved toward inexpensive classes and ensembles approaches combining the models obtained with these techniques. The results show that our proposal is able to improve the sensitivity in the generalization set and obtains both a high accuracy level and a good classification level for each class.