A Fast Heuristic Global Learning Algorithm for Multilayer Neural Networks |
| |
Authors: | Cho Siu-yeung Chow Tommy W.S. |
| |
Affiliation: | (1) Department of Electronic Engineering, City University of Hong Kong, Hong Kong. e-mail |
| |
Abstract: | This paper presents a novel Heuristic Global Learning (HER-GBL) algorithm for multilayer neural networks. The algorithm is based upon the least squares method to maintain the fast convergence speed, and the penalized optimization to solve the problem of local minima. The penalty term, defined as a Gaussian-type function of the weight, is to provide an uphill force to escape from local minima. As a result, the training performance is dramatically improved. The proposed HER-GBL algorithm yields excellent results in terms of convergence speed, avoidance of local minima and quality of solution. |
| |
Keywords: | global learning multilayer neural networks least squares method penalized optimization |
本文献已被 SpringerLink 等数据库收录! |