首页 | 本学科首页   官方微博 | 高级检索  
     

基于EM算法的对传网络学习及应用
引用本文:郝玉,叶世伟.基于EM算法的对传网络学习及应用[J].计算机研究与发展,2006,43(5):856-861.
作者姓名:郝玉  叶世伟
作者单位:1. 中国科学院研究生院,北京,100049
2. 中国科学院研究生院信息科学与工程学院,北京,100049
摘    要:为克服“胜者全得”对传网络的缺陷,提出使用基于软竞争机制的对传网络.这样增加了网络的训练复杂度.为此,把竞争层中隐单元的输出作为未观察到的缺省随机变量,使用EM算法对基于软竞争的对传网络进行训练,降低训练复杂度,加快网络的收敛速度.在实现EM算法的M步时,根据基于软竞争机制对传网络竞争层的特点,对EM算法实现进行改进,没有使用常用的迭代重新加权最小二乘算法,而利用样本加权平均求取隐层单元的权值向量,使EM算法更加简单易行,收敛速度快.仿真实验结果表明,基于软竞争机制的对传网络具有很好的泛化性能,特别在模式分类上具有很好的实际应用价值.

关 键 词:对传网络  软竞争  最大似然估计
收稿时间:04 27 2005 12:00AM
修稿时间:2005-04-272005-11-17

Study of the Counterpropagation Network Based on the EM Algorithm and Its Application
Hao Yu,Ye Shiwei.Study of the Counterpropagation Network Based on the EM Algorithm and Its Application[J].Journal of Computer Research and Development,2006,43(5):856-861.
Authors:Hao Yu  Ye Shiwei
Affiliation:1. Graduate University of Chinese Academy of Sciences, Beijing 100049 ;2.School of Information Science and Engineering, Graduate University of Ch inese Academy of Sciences, Beijing 100049
Abstract:The paper is concerned with the counterpropagation network(CPN) based on the soft-competition mechanism instead of that of the winner-take-all to overcome the later's faults, and the complexity of the network is raised too. By regarding the output of the hidden node in the competition layer as the unknown default random variable, the CPN based on the soft-competition mechanism is trained by the EM algorithm in order to decrease the complexity and accelerate the velocity of convergence of the network. In the M step of the EM algotithm, the algorithm in common use is modified according to the characterstic of the competition layer of the improved CPN, replacing the iteratively reweighted least-squares method with the sample reweighted average method. The results of simulating experiments show that the modified network has a better performance while the training time is greatly reduced. The practicability and convergence of the network is improved rapidly, being particularly useful in the field of classification of patterns.
Keywords:CPN  soft-competition  maximum likelihood estimation
本文献已被 CNKI 维普 万方数据 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号