首页 | 官方网站   微博 | 高级检索  
     

一种新型随机二进制神经网络
引用本文:赵杰煜,张泉方,汪加才.一种新型随机二进制神经网络[J].自动化学报,2002,28(5):736-744.
作者姓名:赵杰煜  张泉方  汪加才
作者单位:1.宁波大学信息科学与技术研究所,宁波;
基金项目:国家自然科学基金(6980 5 0 0 2 ),教育部优秀青年教师资助项目,浙江省自然科学基金青年人才培养专项资助
摘    要:二进制数据表示具有简洁高效的特点,随机噪声有助于系统摆脱局部极小.新型的随 机神经网络模型采用随机加权联接,内部数据表示为随机二进制序列形式,实现十分高效.文中 分别就前馈型网络和反馈型网络进行了深入的讨论,给出了前馈型网络的梯度下降学习算法, 为反馈型网络设计了快速有效的模拟退火算法和渐进式Boltzmann学习算法.通过对PARITY 问题的测试,发现了新模型的一些有趣特征,实验结果表明梯度下降学习效果显著.利用渐进式 Boltzmann学习,反馈型网络被成功地用于带噪声人脸识别.

关 键 词:随机计算    随机二元神经网络    平稳分布    模拟退火    渐近式Boltzmann学习
收稿时间:2000-9-22
修稿时间:2000年9月22日

A NOVEL STOCHASTIC BINARY NEURAL NETWORK
ZHAO Jie-Yu,ZHANG Quan-Fang,WANG Jia-Cai.A NOVEL STOCHASTIC BINARY NEURAL NETWORK[J].Acta Automatica Sinica,2002,28(5):736-744.
Authors:ZHAO Jie-Yu  ZHANG Quan-Fang  WANG Jia-Cai
Affiliation:1.The IST Research Institute,Ningbo University,Ningbo;Department of Computer Science,Zhejiang University,Hangzhou
Abstract:The highly efficient binary representation scheme has dominated the world of computation for a long time. However, the deterministic binary representation seems to be challenged in stochastic neural computation which makes use of the random noise to escape from local minima. This paper presents a novel stochastic binary neural network which uses stochastic weights and the 'stochastic binary sequence' data representation. It is very attractive with its great potential to be implemented efficiently. Both the feedforward and the recurrent stochastic binary networks have been discussed in depth. The gradient descent learning techniques are described for the feedforward network. A novel simulated annealing method and an incremental Boltzmann learning algorithm have been proposed. Simulation results on the PARITY problem and a face recognition task show the excellent performance of the model.
Keywords:Stochastic computing  stochastic binary neural network  stationary distribution  simulated annealing  incremental Boltzmann learning
本文献已被 CNKI 维普 万方数据 等数据库收录!
点击此处可从《自动化学报》浏览原始摘要信息
点击此处可从《自动化学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司    京ICP备09084417号-23

京公网安备 11010802026262号