基于特征熵相关度差异的KNN算法

传统K最近邻(KNN)法在进行样本分类时容易产生无法判断或判断错误的问题。为此，将特征熵与KNN相结合，提出一种新的分类算法(FECD-KNN)。该算法采用熵作为类相关度，以其差异值计算样本距离。用熵理论规约分类相关度，并根据相关度间的差异值衡量特征对分类的影响程度，从而建立距离测度与类别间的内在联系。仿真实验结果表明，与KNN及Entropy-KNN法相比，FECD-KNN在保持效率的情况下，能够提高分类准确性。

KNN Algorithm Based on Feature Entropy Correlation Difference

The paper ameliorates the method that combined K-Nearest Neighbor(KNN) with entropy,a new improved algorithm that adopting entropy as correlation and taking differences values to calculate distance is proposed,which calls FECD-KNN,based on the research that KNN tested sample in misjudgment and error easily.The impacted algorithm combines information entropy theory used to statute correlation,measures strength of impact on the classification according to difference of correlation,and establishes the intrinsi...