A short term memory for Neural Networds which allows recognition and reproduction of complex sequences of integers with the minimum number of weights |
| |
Authors: | A J Kirke |
| |
Affiliation: | (1) Neurodynamics Research Group, School of Computing, University of Plymouth, PL4 8AA Plymouth, UK |
| |
Abstract: | An artificial short term memory, the binary kernel function, is presented to facilitate the learning of complex sequences of integers by Neural Networks, requiring far fewer weights than are usually needed. This is achieved by using only a single weight to encode repeat occurrences of an integer in a sequence. The coding used allows a complex sequence to be learned in only one presentation. The kernel's exponential complexity growth is overcome with hierarchical architectures which chunk the sequences to be learnt. Architectures are introduced for recognition and reproduction of complex sequences. |
| |
Keywords: | complex sequence learning kernel function neural network short term memory |
本文献已被 SpringerLink 等数据库收录! |
|