用线性多步法训练神经网络 |
| |
引用本文: | 许少华,梁久祯,何新贵. 用线性多步法训练神经网络[J]. 计算机研究与发展, 2001, 38(12): 1486-1490 |
| |
作者姓名: | 许少华 梁久祯 何新贵 |
| |
作者单位: | 1. 北京航空航天大学计算机科学与工程系,北京,100083 2. 北京系统工程研究所,北京,100101 |
| |
基金项目: | 黑龙江省自然科学基金资助 ( F 9917) |
| |
摘 要: | 研究用微分方程数值解法--线性多步法替代神经网络的学习算法,指出在一定条件下神经网络的BP学习问题与求解一个相应的微分系统在渐近意义下是等价的,从而求解微分动力系统的数值解法也可用于神经网络的学习,给出了训练神经网络的Milne方法和BP-Milne结合算法以及Hamming方法和BP-Hamming结合算法,并以9点两类模式、随机模式识别和石油地质中沉积微相模式识别等3个问题为例进行了实验,实验结果表明利用微分动力系统的数值解法进行神经网络的学习是可行的。
|
关 键 词: | 神经网络 学习算法 微分动力系统 数值解 线性多步法 训练 |
TRAINING NEURAL NETWORKS BY USING THE LINEAR MULTI-STEP METHOD |
| |
Abstract: | Training neural networks by using the linear multi-step method is studied, which is a classical numerical method for differential dynamics. It is pointed out that the iteration formula of BP algorithm is equivalent to the Euler method of differential dynamic systems under certain conditions, and the asymptotic solutions of the two formulas are consistent, and thus training a neural network can be converted to computing numerical solution of differential dynamic systems. Two algorithms to train neural networks are presented, namely the Milne method and the Hamming method. Finally three experiment examples are implemented to illustrate the fitness of training neural networks by the numerical method for differential dynamics. |
| |
Keywords: | neural networks learning algorithm differential dynamics numerical solution Milne method Hamming method |
本文献已被 CNKI 维普 万方数据 等数据库收录! |