神经网络的泛化理论和泛化方法

泛化能力是多层前向网最重要的性能,泛化问题已成为目前神经网络领域的研究热点.文中综述了神经网络泛化理论和泛化方法的研究成果.对泛化理论,重点讲述神经网络的结构复杂性和样本复杂性对泛化能力的影响;对泛化方法,则在介绍每种泛化方法的同时,尽量指出该方法与相应泛化理论的内在联系.最后对泛化理论和泛化方法的研究前景作了展望.

Generalization Theory and Generalization Methods for Neural Networks

Generalization ability is the most important performance of a feed forward neural network, and the problem of generalization has been widely studied recently among the neural network community. Research on this subject can be divided into two fields: generalization theory discusses the factors that affect the generalization ability, while generalization methods try to find algorithms for improved performance. This survey reviewed the main results on generalization research, and tried to point out the relationship between generalization theory and corresponding generalization methods. A prospect on generalization research was also given in the last part of this paper.