A Bidirectional Hetero-Associative Memory for True-Color Patterns

Classical bidirectional associative memories (BAM) have poor memory storage capacity, are sensitive to noise, are subject to spurious steady states during recall, and can only recall bipolar patterns. In this paper, we introduce a new bidirectional hetero-associative memory model for true-color patterns that uses the associative model with dynamical synapses recently introduced in Vazquez and Sossa (Neural Process Lett, Submitted, 2008). Synapses of the associative memory could be adjusted even after the training phase as a response to an input stimulus. Propositions that guarantee perfect and robust recall of the fundamental set of associations are provided. In addition, we describe the behavior of the proposed associative model under noisy versions of the patterns. At last, we present some experiments aimed to show the accuracy of the proposed model with a benchmark of true-color patterns.     

Weakly pulse-coupled oscillators, FM interactions, synchronization,and oscillatory associative memory

We study pulse-coupled neural networks that satisfy only two assumptions: each isolated neuron fires periodically, and the neurons are weakly connected. Each such network can be transformed by a piece-wise continuous change of variables into a phase model, whose synchronization behavior and oscillatory associative properties are easier to analyze and understand. Using the phase model, we can predict whether a given pulse-coupled network has oscillatory associative memory, or what minimal adjustments should be made so that it can acquire memory. In the search for such minimal adjustments we obtain a large class of simple pulse-coupled neural networks that ran memorize and reproduce synchronized temporal patterns the same way a Hopfield network does with static patterns. The learning occurs via modification of synaptic weights and/or synaptic transmission delays.     

神经网络的混沌运动与控制

本文采用一种由混沌神经元构成的联想记忆神经网络．以混沌神经网络为基础,研究其非线 性动力学特性、混沌吸引子轨迹以及对初始条件的敏感性, 实现混沌神经网络的动态联想记 忆功能．在网络输入发生较大变异情况下所发生的失忆,本文采用时空系统混沌控制的钉扎 反馈方法,使网络恢复记忆．上述研究通过对异步电动机故障的动态记忆和恢复控制的仿真 实验得到证实．本文研究结果表明,在国内外对神经网络混沌控制研究的热点中,时空系统 的钉扎反馈控制是一种值得推荐的方法;神经网络的混沌控制扩大了网络的容错性,进而提 高了混沌神经网络的实用性,这将在复杂模式识别,图象处理等工程上具有广阔的应用前景 ．     

混沌神经网络在分离叠加模式和多对多联想记忆中的应用

混沌是不含外加随机因素的完全确定性的系统表现出来的界于规则和随机之间的内秉随机行为。脑神经系统是由神经细胞组成的网络。类似于人脑思维的人工神经网络与冯·诺依曼计算机相比,在信息处理方面有很大的优越性。混沌和神经网络相互融合的研究是从90年代开始的,其主要的目标是通过分析大脑的混沌现象,建立含有混沌动力学的神经网络模型(即混沌神经网络模型),将混沌的遍历性、对初始值敏感等特点与神经网络的非线性、自适应、并行处理优势相结合,     

一种非线性可自学习的联想记忆神经网络

醉庆生物神经突触特性的基础上,提出了非线性神经突触神经元的概念,并以此为根据构造了一种可自学习的联想记忆神经网络模型。这种模型可以按照Hebb规则进行学习,学习机制由网络本身完成。在此模型中,由于非线性权重的引入,使此神经网络模型能以简单的结构实现网络的自学习功能。文中对网络的记忆容量和此种网络在以特定的学习方式学习后与Hopfield网络的等效性方面进行了讨论。试验表明,此种网络模型结构是有效的。     

A Weakly Connected Memristive Neural Network for Associative Memory

In this paper, we propose a star-like weakly connected memristive neural network which is organized in such a way that each cell only interacts with the central cells. By using the describing function method and Malkin’s theorem the phase deviation of this dynamical network is obtained. And then, under the Hebbian learning rule the phase deviation is designed as a desired model for associative memory. Moreover, we take the store and recall of digital images as an example to demonstrate the performance of associative memory. The main contribution of this paper is supply a useful mechanism which the new potential circuit element memristor can be used to realize the associative.     

基于混沌神经网络的电机故障诊断

采用全局耦合混沌神经网络模型，每个神经元的动力学行为由反对称立方映像表示。采用Hebb算法设计网络的连接权值矩阵．将记忆模式的回忆过程转化为耦合系统中参数演变的过程，从而实现了混沌神经网络的联想记忆。根据提出的能量击穿规则，扩大了样表的吸引域。在此基础上，应用该混沌神经网络对异步电机转子断条故障进行诊断。结果表明，该种方法有助于故障模式的记忆和重现。     

An evolutionary approach to associative memory in recurrent neural networks

In this paper, we investigate the associative memory in recurrent neural networks, based on the model of evolving neural networks proposed by Nolfi, Miglino and Parisi.Experimentally developed network has highly asymmetric synaptic weights and dilute connections, quite different from those of the Hopfield model.Some results on the effect of learning efficiency on the evolution are also presented.     

An RCE-based Associative Memory with Application to Human Face Recognition

Many models of neural network-based associative memory have been proposed and studied. However, most of these models do not have a rejection mechanism and hence are not practical for many real-world associative memory problems. For example, in human face recognition, we are given a database of face images and the identity of each image. Given an input image, the task is to associate when appropriate the image with the corresponding name of the person in the database. However, the input image may be that of a stranger. In this case, the system should reject the input. In this paper, we propose a practical associative memory model that has a rejection mechanism. The structure of the model is based on the restricted Coulomb energy (RCE) network. The capacity of the proposed memory is desibed by two measures: the ability of the system to correctly identify known individuals, and the ability of the system to reject individuals who are not in the database. Experimental results are given which show how the performance of the system varies as the size of the database increases up to 1000 individuals.     

Stability analysis of discrete-time recurrent neural networks based on standard neural network models

In order to conveniently analyze the stability of various discrete-time recurrent neural networks (RNNs), including bidirectional associative memory, Hopfield, cellular neural network, Cohen-Grossberg neural network, and recurrent multiplayer perceptrons, etc., the novel neural network model, named standard neural network model (SNNM) is advanced to describe this class of discrete-time RNNs. The SNNM is the interconnection of a linear dynamic system and a bounded static nonlinear operator. By combining Lyapunov functional with S-Procedure, some useful criteria of global asymptotic stability for the discrete-time SNNMs are derived, whose conditions are formulated as linear matrix inequalities. Most delayed (or non-delayed) RNNs can be transformed into the SNNMs to be stability analyzed in a unified way. Some application examples of the SNNMs to the stability analysis of the discrete-time RNNs shows that the SNNMs make the stability conditions of the RNNs easily verified.     

非线性连续联想记忆神经网络的分析和优化设计

研究非线性连续联想记忆神经网络的渐近稳定性,得出几个定理.在此基础上,提出了一 种优化设计方法,并给出了理论证明.目前已有的若干结论是本文所得定理的特例.     

Exponential periodicity and stability of delayed neural networks

In this paper, exponential periodicity and stability of delayed neural networks is investigated. Without assuming the boundedness and differentiability of the activation functions, some new sufficient conditions ensuring existence and uniqueness of periodic solution for a general class of neural systems are obtained. The delayed Hopfield network, bidirectional associative memory network, and cellular neural network are special cases of the neural system model considered.     

具有内连接的指数多值双向联想记忆模型

C_C Wang的多值指数双向联想记忆模型(MVeBAM)是一种高存储容量的联想神经网络.本文在MVeBAM的基础上通过引入自相关项(或内连接)提出了一个新的具有内连接的多值指数双向联想记忆模型,推广了MVeBAM.通过定义简单的能量函数证明了其在同、异步方式下的稳定性,从而保证了所学模式对成为被推广的MVeBAM(EMVeBAM)的稳定点.最后,计算机模拟证实了EMVeBAM比MVeBAM具有更高的存储容量和更好的纠错性能.     

Associative Neural Network

An associative neural network (ASNN) is a combination of an ensemble of the feed-forward neural networks and the K-nearest neighbor technique. The introduced network uses correlation between ensemble responses as a measure of distance among the analyzed cases for the nearest neighbor technique and provides an improved prediction by the bias correction of the neural network ensemble both for function approximation and classification. Actually, the proposed method corrects a bias of a global model for a considered data case by analyzing the biases of its nearest neighbors determined in the space of calculated models. An associative neural network has a memory that can coincide with the training set. If new data become available the network can provide a reasonable approximation of such data without a need to retrain the neural network ensemble. Applications of ASNN for prediction of lipophilicity of chemical compounds and classification of UCI letter and satellite data set are presented. The developed algorithm is available on-line at http://www.virtuallaboratory.org/lab/asnn.     

具有内连接的指数多值双向联想记忆模型

C_CWang的多值指数双向联想记忆模型 (MVeBAM)是一种高存储容量的联想神经网络. 本文在MVe BAM的基础上通过引入自相关项 (或内连接 )提出了一个新的具有内连接的多值指数双向联想记忆模型, 推广了MVeBAM. 通过定义简单的能量函数证明了其在同、异步方式下的稳定性, 从而保证了所学模式对成为被推广的MVeBAM(EMVeBAM)的稳定点. 最后, 计算机模拟证实了EMVeBAM比MVeBAM具有更高的存储容量和更好的纠错性能.     

LINEAR PROGRAMMING AND RECURRENT ASSOCIATIVE MEMORIES

Many optimization procedures presume the availability of an initial approximation in the neighborhood of a local or global optimum. Unfortunately, finding a set of good starting conditions is itself a nontrivial proposition. We describe a procedure for identifying approximate solutions to constrained optimization problems. Recurrent neural network structures are interpreted in the context of linear associative memory matrices. A recurrent associative memory (RAM) is trained to map the inputs of closely related transportation linear programs to optimal solution vectors. The procedure performs well when training cases are selected according to a simple rule, identifying good heuristic solutions for representative test cases. Modest infeasibilities exist in some of these estimated solutions, but the basic variables associated with true optimums are usually apparent. In the great majority of cases, rounding identifies the true optimum.     

Multilayer associative neural networks (MANN''s): storage capacityversus perfect recall

The objective of this paper is to to resolve important issues in artificial neural nets-exact recall and capacity in multilayer associative memories. These problems have imposed restrictions on coding strategies. We propose the following triple-layered hybrid neural network: the first synapse is a one-shot associative memory using the modified Kohonen's adaptive learning algorithm with arbitrary input patterns; the second one is Kosko's bidirectional associative memory consisting of orthogonal input/output basis vectors such as Walsh series satisfying the strict continuity condition; and finally, the third one is a simple one-shot associative memory with arbitrary output images. A mathematical framework based on the relationship between energy local minima (capacity of the neural net) and noise-free recall is established. The robust capacity conditions of this multilayer associative neural network that lead to forming the local minima of the energy function at the exact training pairs are derived. The chosen strategy not only maximizes the total number of stored images but also completely relaxes any code-dependent conditions of the learning pairs.     

Continuous classifying associative memory

In this article we present the so‐called continuous classifying associative memory, able to store continuous patterns avoiding the problems of spurious states and data dependency. This is a memory model based on our previously developed classifying associative memory, which enables continuous patterns to be stored and recovered. We will also show that the behavior of this continuous classifying associative memory may be adjusted to some predetermined goals by selecting some internal operating functions. © 2002 Wiley Periodicals, Inc.     

联想记忆神经网络的训练

提出了一种联想记忆神经网络的优化训练方案,说明网络的样本吸引域可用阱深参数作 一定程度的控制,使网络具有尽可能好的容错性.计算表明,训练网络可达到α＜1(α=M/ N,N是神经元数,M是贮存样本数),而仍有良好的容错性,明显优于外积法、正交化外积法、 赝逆法等常用方案.文中还对训练网络的对称性与收敛性问题进行了讨论.     

Design of Hopfield network for cryptographic application by spintronic memristors

Memory being one of the essential credential in today’s computer world seeks forward newer research interests in its types. Hopfield neural networks of artificial neural networks are one of its classes that can be modelled to form an associative memory. In this paper, we have shown the Hopfield neural network constructed with spintronic memristor bridges accounting to act as an associative memory unit. The memristors are nanoscaled, in terms of size, which possess synaptic behaviour in the artificial neuromorphic system. The associative behaviour is realised by the updation of synaptic weights of memristive Hopfield with single- and multiple-bit associativity which is simulated in MATLAB. The application of the hardware in the field of cryptography is also proposed.