| 自适应前馈神经网络结构优化设计 |
| |
| 引用本文： | 张昭昭,乔俊飞,杨刚. 自适应前馈神经网络结构优化设计[J]. 智能系统学报, 2011, 0(4): 312-317. DOI: 10.3969/j.issn.1673-4785.2011.04.005 |
| |
| 作者姓名： | 张昭昭 乔俊飞 杨刚 |
| |
| 作者单位： | 1. 北京工业大学电子信息与控制工程学院,北京100124;辽宁工程技术大学电子与信息工程学院,辽宁葫芦岛125105
2. 北京工业大学电子信息与控制工程学院,北京,100124 |
| |
| 基金项目： | 国家自然科学基金资助项目(60873043); 国家“863”计划资助项目(2009AA04Z155); 北京市自然科学基金资助项目(4092010); 教育部博士点基金资助项目目(PHR201006103) |
| |
| 摘 要： | 针对多数前馈神经网络结构设计算法采取贪婪搜索策略而易陷入局部最优结构的问题,提出一种自适应前馈神经网络结构设计算法.该算法在网络训练过程中采取自适应寻优策略合并和分裂隐节点,达到设计最优神经网络结构的目的.在合并操作中,以互信息为准则对输出线性相关的隐节点进行合并;在分裂操作中,引入变异系数,有助于跳出局部最优网络结构.算法将合并和分裂操作之后的权值调整与网络对样本的学习过程结合,减少了网络对样本的学习次数,提高了网络的学习速度,增强了网络的泛化性能.非线性函数逼近结果表明,所提算法能得到更小的检测误差,最终网络结构紧凑.
|
| 关 键 词： | 前馈神经网络 结构设计 自适应搜索策略 互信息 |
An adaptive algorithm for designing optimal feed-forward neural network architecture |
| |
| ZHANG Zhaozhao,QIAO Junfei,YANG Gang. An adaptive algorithm for designing optimal feed-forward neural network architecture[J]. CAAL Transactions on Intelligent Systems, 2011, 0(4): 312-317. DOI: 10.3969/j.issn.1673-4785.2011.04.005 |
| |
| Authors: | ZHANG Zhaozhao QIAO Junfei YANG Gang |
| |
| Affiliation: | ZHANG Zhaozhao1,2,QIAO Junfei1,YANG Gang1 (1.College of Electronic and Control Engineering,Beijing University of Technology,Beijing 100124,China,2.Institute of Electronic and Information Engineering,Liaoning Technical University,Huludao 125105,China) |
| |
| Abstract: | Due to the fact that most algorithms use a greedy strategy in designing artificial neural networks which are susceptible to becoming trapped at the architectural local optimal point,an adaptive algorithm for designing an optimal feed-forward neural network was proposed.During the training process of the neural network,the adaptive optimization strategy was adopted to merge and split the hidden unit to design optimal neural network architecture.In the merge operation,the hidden units were merged based on mut... |
| |
| Keywords: | feed-forward neural network architecture design adaptive search strategy mutual information |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
|
