基于约束区域的BSB联想记忆模型

提出一种根据联想记忆点设计基于约束区域的ＢＳＢ（Ｂｒａｉｎ－Ｓｔａｔｅ－ｉｎｍ－ａ－Ｂｏｘ）神经网络模型,它保证了渐近稳定的平衡点集与样本点集相同,不渐近稳定的平衡点恰为实际的拒识状态,并且吸引域分布合理,从而将ＥＳＢ完善为理想的联想记忆器。     

基于约束区域的连续时间联想记忆神经网络

传统的联想记忆神经网络模型是根据联想记忆点设计权值。文中提出一种根据联想记忆点设计基于约束区域的神经网络模型,它保证了渐近稳定的平衡点集与样要点集相同,不渐近稳定的平衡点恰为实际的拒识状态,并且吸引域分布合理。它具有学习和遗忘能力,还具有记忆容量大和电路可实现优点,是理想的联想记忆器。     

基于线性规划的联想记忆神经网络模型

提出一种基于优化线性函数的神经网络联想记忆器,打破了将待识别模式作为网络起始点的常规,它能保证渐近稳定的平衡点集与样本点集相同,吸引域分布合理,不渐近稳定的平衡点恰为实际的拒识模式,并且电路实现容易,对拒识模式有清楚的解释。理论分析和计算机模拟都表明本文的模型是理想的联想记忆器,还可降低对硬件的精度要求。     

Equivalence between local exponential stability of the uniqueequilibrium point and global stability for Hopfield-type neural networkswith two neurons

Fang and Kincaid (1996) proposed an open problem about the relationship between the local stability of the unique equilibrium point and the global stability for a Hopfield-type neural network with continuously differentiable and monotonically increasing activation functions. As a partial answer to the problem, in the two-neuron case it is proved that for each given specific interconnection weight matrix, a Hopfield-type neural network has a unique equilibrium point which is also locally exponentially stable for any activation functions and for any other network parameters if and only if the network is globally asymptotically stable for any activation functions and for any other network parameters. If the derivatives of the activation functions of the network are bounded, then the network is globally exponentially stable for any activation functions and for any other network parameters.     

Synthesis of Brain-State-in-a-Box (BSB) based associative memories

Presents a novel synthesis procedure to realize an associative memory using the Generalized-Brain-State-in-a-Box (GBSB) neural model. The implementation yields an interconnection structure that guarantees that the desired memory patterns are stored as asymptotically stable equilibrium points and that possesses very few spurious states. Furthermore, the interconnection structure is in general non-symmetric. Simulation examples are given to illustrate the effectiveness of the proposed synthesis method. The results obtained for the GBSB model are successfully applied to other neural network models.     

离散Hopfield双向联想记忆神经网络的稳定性分析

首先将离散Hopfield双向联想记忆神经网络转化成一个特殊的离散Hopfield网络 模型.在此基础上,对离散Hopfield双向联想记忆神经网络的全局渐近稳定性和全局指数稳 定性进行了新的分析.证明了神经网络连接权矩阵在给定的约束条件下有唯一的而且是渐近 稳定的平衡点.利用Lyapunov方程正对角解的存在性得到了几个判定平衡点为全局渐近稳 定和全局指数稳定的充分条件.这些条件可以用于设计全局渐近稳定和全局指数稳定的神经 网络.所做的分析扩展了以前的稳定性结果.     

On the synthesis of brain-state-in-a-box neural models with application to associative memory

In this article we present techniques for designing associative memories to be implemented by a class of synchronous discrete-time neural networks based on a generalization of the brain-state-in-a-box neural model. First, we address the local qualitative properties and global qualitative aspects of the class of neural networks considered. Our approach to the stability analysis of the equilibrium points of the network gives insight into the extent of the domain of attraction for the patterns to be stored as asymptotically stable equilibrium points and is useful in the analysis of the retrieval performance of the network and also for design purposes. By making use of the analysis results as constraints, the design for associative memory is performed by solving a constraint optimization problem whereby each of the stored patterns is guaranteed a substantial domain of attraction. The performance of the designed network is illustrated by means of three specific examples.     

A new method for the control of discrete nonlinear dynamic systems using neural networks

A new controller design method for nonaffine nonlinear dynamic systems is presented in this paper. An identified neural network model of the nonlinear plant is used in the proposed method. The method is based on a new control law that is developed for any discrete deterministic time-invariant nonlinear dynamic system in a subregion Psi(x), of an asymptotically stable equilibrium point of the plant. The performance of the control law is not necessarily dependent on the distance between the current state of the plant and the equilibrium state if the nonlinear dynamic system satisfies some mild requirements in Psi(x). The control law is simple to implement and is based on a novel linearization of the input-output model of the plant at each instant in time. It can be used to control both minimum phase and nonminimum phase nonaffine nonlinear plants. Extensive empirical studies have confirmed that the control law can be used to control a relatively general class of highly nonlinear multiinput-multioutput (MIMO) plants.     

二阶神经网络的全局指数稳定性分析

当神经网络应用于最优化计算时,理想的情形是只有一个全局渐近稳定的平衡点,并且以指数速度趋近于平衡点,从而减少神经网络所需计算时间,二阶神经网络较一般神经网络具有更快的收敛速度,对于二阶连续型Hopfield神经网络,用Lyapunov方法讨论平衡点的全局指数稳定性,给出了平衡点全局指数稳定的几个判别准则,作为特例,获得了连续型Hopfield神经网络全局指数稳定的新判据。     

Associative Memory Design via Path Embedding into a Graph

A graph theoretical procedure for storing a set of n-dimensional binary vectors as asymptotically stable equilibrium points of a discrete Hopfield neural network is presented. The method gives an auto-associative memory which stores an arbitrary memory set completely. Spurious memories might occur only in a small neighborhood of the original memory vectors, so cause small errors.     

A competitive associative memory model and its dynamics

Conventional associative memory networks perform "noncompetitive recognition" or "competitive recognition in distance". In this paper a "competitive recognition" associative memory model is introduced which simulates the competitive persistence of biological species. Unlike most of the conventional networks, the proposed model takes only the prototype patterns as its equilibrium points, so that the spurious points are effectively excluded. Furthermore, it is shown that, as the competitive parameters vary, the network has a unique stable equilibrium point corresponding to the winner competitive parameter and, in this case, the unique stable equilibrium state can be recalled from any initial key.     

具有时变时滞的递归神经网络的渐近稳定性分析

当神经网络应用于最优化计算时,理想的情形是只有一个全局渐近稳定的平衡点,并且以指数速度趋近于平衡点,从而减少神经网络所需计算时间.研究了带时变时滞的递归神经网络的全局渐近稳定性.首先将要研究的模型转化为描述系统模型,然后利用Lyapunov-Krasovskii稳定性定理、线性矩阵不等式(LMI)技术、S过程和代数不等式方法,得到了确保时变时滞递归神经网络渐近稳定性的新的充分条件,并将它应用于常时滞神经网络和时滞细胞神经网络模型,分别得到了相应的全局渐近稳定性条件.理论分析和数值模拟显示,所得结果为时滞递归神经网络提供了新的稳定性判定准则.     

A new feedback neural network with supervised learning

A model is introduced for continuous-time dynamic feedback neural networks with supervised learning ability. Modifications are introduced to conventional models to guarantee precisely that a given desired vector, and its negative, are indeed stored in the network as asymptotically stable equilibrium points. The modifications entail that the output signal of a neuron is multiplied by the square of its associated weight to supply the signal to an input of another neuron. A simulation of the complete dynamics is then presented for a prototype one neuron with self-feedback and supervised learning; the simulation illustrates the (supervised) learning capability of the network.     

An optimization approach to design of generalized BSB neural associative memories

This article is concerned with the synthesis of the optimally performing GBSB (generalized brain-state-in-a-box) neural associative memory given a set of desired binary patterns to be stored as asymptotically stable equilibrium points. Based on some known qualitative properties and newly observed fundamental properties of the GBSB model, the synthesis problem is formulated as a constrained optimization problem. Next, we convert this problem into a quasi-convex optimization problem called GEVP (generalized eigenvalue problem). This conversion is particularly useful in practice, because GEVPs can be efficiently solved by recently developed interior point methods. Design examples are given to illustrate the proposed approach and to compare with existing synthesis methods.     

A recurrent neural network with finite-time convergence for convex quadratic bilevel programming problems

In this paper, a recurrent neural network with a new tunable activation is proposed to solve a kind of convex quadratic bilevel programming problem. It is proved that the equilibrium point of the proposed neural network is stable in the sense of Lyapunov, and the state of the proposed neural network converges to an equilibrium point in finite time. In contrast to the existing related neurodynamic approaches, the proposed neural network in this paper is capable of solving the convex quadratic bilevel programming problem in finite time. Moreover, the finite convergence time can be quantitatively estimated. Finally, two numerical examples are presented to show the effectiveness of the proposed recurrent neural network.

     

TWO-LAYER STABILIZATION OF CONTINUOUS NEURAL NETWORKS WITH FEEDBACKS

Methods of stabilization as applied to Hopfield-type continuous neural networks with a unique equilibrium point are considered. These methods permit the design of stable networks where the elements of the interconnection matrix and nonlinear activation functions of separate neurons vary with time. For stabilization with a variable interconnection matrix it is suggested that a new second layer of neurons be introduced to the initial single-layer network and some additional connections be added between the new and old layers. This approach gives us a system with a unique equilibrium point that is globally asymptotically stable, i.e. the entire space serves as the domain of attraction of this point, and the stability does not depend on the interconnection matrix of the system. In the case of the variable activation functions, some results from a recent investigation of the absolute stability problem for neural networks are presented, along with some recommendations.     

抗HIV感染治疗模型及临床数据模拟

基于饱和发生率和艾滋病病毒（HIV）诱导CD4+ T细胞凋亡的机制,提出了一个改进的抗HIV感染治疗模型。新模型有病毒清除平衡点和持续带毒平衡点。证明了若模型的基本再生数[R0]小于1,则病毒清除平衡点全局渐近稳定;若模型的[R0]大于1,则持续带毒平衡点局部渐近稳定。基于斯坦福大学HIV耐药性数据库,用新模型模拟一组患者抗HIV感染治疗并做疗效的长期预测。数值模拟结果说明抗病毒治疗无法抑制HIV诱导CD4+ T细胞凋亡;HIV耐药性出现后若不及时更换治疗方案,耐药性会增强;长期预测表明该组患者的抗HIV感染治疗以失败告终。     

Design of GBSB neural associative memories using semidefiniteprogramming

This paper concerns reliable search for the optimally performing GBSB (generalized brain-state-in-a-box) neural associative memory given a set of prototype patterns to be stored as stable equilibrium points. First, we observe some new qualitative properties of the GBSB model. Next, we formulate the synthesis of GBSB neural associative memories as a constrained optimization problem. Finally, we convert the optimization problem into a semidefinite program (SDP), which can be solved efficiently by recently developed interior point methods. The validity of this approach is illustrated by a design example.     

Second-order bounds on the domain of attraction and the rate ofconvergence of nonlinear dynamical systems and neural networks

We present a method for analyzing the convergence properties of nonlinear dynamical systems yielding second-order bounds on the domain of attraction of an asymptotically stable equilibrium point and on the time of convergence in the estimated domain. We show that under certain conditions on the system, there exists an analytic solution to the corresponding optimization problem. The method is applied in analyzing the dynamics of a neural network model.     

Subgradient-based feedback neural networks for non-differentiable convex optimization problems

1 Introduction Optimization problems arise in a broad variety of scientific and engineering applica- tions. For many practice engineering applications problems, the real-time solutions of optimization problems are mostly required. One possible and very pr…