首页 | 本学科首页   官方微博 | 高级检索  
     

径向基函数(RBF)神经网络的一种极大熵学习算法
引用本文:张志华,郑南宁,郑海兵.径向基函数(RBF)神经网络的一种极大熵学习算法[J].计算机学报,2001,24(5):474-479.
作者姓名:张志华  郑南宁  郑海兵
作者单位:西安交通大学人工智能与机器人所
基金项目:国家自然科学基金! ( 6973 5 0 10 ),西安交通大学研究生院博士学位论 文基金!资助
摘    要:RBF神经网络中心向量的确定是整个网络学习的关键,该文基于信息论中的极大熵原理构造了训练中心向量的极大熵聚类算法,由此给出了网络的极大熵学习算法。文中最后分别用一个时间序列预测和系统辨识问题验证了该学习算法的有效性,同RBF网络和多层感知机的误差回传算法相比,该算法不仅在学习精度和泛化推广能力上有一定程度的提高,而且学习时间有显著的降低。

关 键 词:径向基函数  极大熵原理  拉格朗日乘子  神经网络  学习算法
修稿时间:1999年9月10日

A Maximum-Entropy Learning Algorithm of Radial Basis Function(RBF) Neural Networks
ZHANG Zhi-Hua,ZHENG Nan-ning,ZHENG Hai-Bing.A Maximum-Entropy Learning Algorithm of Radial Basis Function(RBF) Neural Networks[J].Chinese Journal of Computers,2001,24(5):474-479.
Authors:ZHANG Zhi-Hua  ZHENG Nan-ning  ZHENG Hai-Bing
Abstract:The key point in the design of RBF networks is to specify the number and the location of the centers. Several heuristic hybrid learning methods, which apply a clustering algorithm for locating the centers and subsequently a linear least squares method for the linear weights, have been previously suggested. A maximum entropy clustering method for training the center vectors is constructed via the maximum entropy principle in the information theory. Accordingly, a maximum entropy learning algorithm (MELA) of the RBF networks is given. Two experiments, including time series prediction and system identification, are given to test MELA. The results show, compared with the error back propagating algorithm of the multi layer perceptions (MLP) and RBF, MELA not only improves learning precision and generalization ability, but reduces learning time as well.
Keywords:radial basis function  maximum  entropy principle  Lagrangian multiplier
本文献已被 CNKI 维普 万方数据 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号