基于条件信息熵的自主式朴素贝叶斯分类算法

朴素贝叶斯是一种简单而高效的分类算法，但其条件独立性和属性重要性相等的假设并不符合客观实际，这在某种程度上影响了它的分类性能。如何去除这种先验假设，根据数据本身的特点实现知识自主学习是机器学习中的一个难题。根据Rough Set的相关理论，提出了基于条件信息熵的自主式朴素贝叶斯分类方法，该方法结合了选择朴素贝叶斯和加权朴素贝叶斯的优点。通过在UCI数据集上的仿真实验，验证了该方法的有效性。

Classification algorithm for self-learning Naive Bayes based on conditional information entropy

Nave Bayes algorithm is an effective simple classification algorithm.But two central assumptions made by the Nave Bayes approach are that the attributes are independent within each class and the importance of the attributes is equal,which can harm the classification process to some extent.It is a very difficult problem in machine learning to carry out self-learning knowledge according to the characteristic of source data without prior domain knowledge.Based on the theory of rough set,a new Nave Bayes method named Conditional Information Entropy-based Algorithm for Self-learning Nave Bayes(CIEBASLNB)was proposed,which combined the merits of selective Nave Bayes(SNB)and Weighted Nave Bayes(WNB).Simulation results on a variety of UCI data sets illustrate the efficiency of this method.