New results for neutral-type delayed projection neural network to solve linear variational inequalities

Recently, a neutral-type delayed projection neural network (NDPNN) was developed for solving variational inequality problems. This paper addresses the global stability and convergence of the NDPNN and presents new results for it to solve linear variational inequality (LVI). Compared with existing convergence results for neural networks to solve LVI, our results do not require the LVI that is monotone so as to guarantee the NDPNN that can solve a class of non-monotone LVI. All the results are expressed in terms of linear matrix inequalities, which can be easily checked. Simulation examples demonstrate the effectiveness of the obtained results.     

梯度神经网络解线性矩阵方程之收敛性分析

为了求解线性矩阵方程问题,应用一种基于负梯度法的递归神经网络模型,并探讨了该递归神经网络实时求解线性矩阵方程的全局指数收敛问题.在讨论渐近收敛性基础上,进一步证明了该类神经网络在系数矩阵满足有解条件的情况下具有全局指数收敛性,在不能满足有解条件的情况下具有全局稳定性.计算机仿真结果证实了相关理论分析和该网络实时求解线性矩阵方程的有效性.     

Discrete-time delayed standard neural network model and its application

The research on the theory and application of artificial neural networks has achieved a great success over the past two decades. Recently, increasing attention has been paid to recurrent neural networks, which are rich in dynamics, highly parallelizable, and easily implementable with VLSI. Due to these attractive features, RNNs have widely been applied to system identification, control, optimization and associative memories[1]. Stability analysis, which is critical to any applications of R…     

A new result for projection neural networks to solve linear variational inequalities and related optimization problems

In recent years, a projection neural network was proposed for solving linear variational inequality (LVI) problems and related optimization problems, which required the monotonicity of LVI to guarantee its convergence to the optimal solution. In this paper, we present a new result on the global exponential convergence of the projection neural network. Unlike existing convergence results for the projection neural network, our main result does not assume the monotonicity of LVI problems. Therefore, the projection neural network can be further guaranteed to solve a class of non-monotone LVI and non-convex optimization problems. Numerical examples illustrate the effectiveness of the obtained result.     

时滞标准神经网络模型及其应用

提出一种新的神经网络模型---时滞标准神经网络模型(DSNNM),它由线性动力学系统和有界静态时滞非线性算子连接而成.利用不同的Lyapunov泛函和S方法推导出DSNNM全局渐近稳定性和全局指数稳定性的充分条件,这些条件可表示为线性不等式(LMI)形式.大多数时滞(或非时滞)动态神经网络(DANN)稳定性分析或神经网络控制系统都可以转化为DSNNM,以便用统一的方法进行稳定性分析或镇定控制.从DSNNM应用于时滞联想记忆(BAM)神经网络的稳定性分析以及PH中和过程神经控制器的综合实例,可以看出,得到的稳定性判据扩展并改进了以往文献中的稳定性定理,而且可将稳定性分析推广到非线性控制系统的综合.     

New delay-dependent exponential stability criteria of BAM neural networks with time delays

In this paper, the global exponential stability is investigated for the bi-directional associative memory networks with time delays. Several new sufficient conditions are presented to ensure global exponential stability of delayed bi-directional associative memory neural networks based on the Lyapunov functional method as well as linear matrix inequality technique. To the best of our knowledge, few reports about such “linearization” approach to exponential stability analysis for delayed neural network models have been presented in literature. The method, called parameterized first-order model transformation, is used to transform neural networks. The obtained conditions show to be less conservative and restrictive than that reported in the literature. Two numerical simulations are also given to illustrate the efficiency of our result.     

区间时变细胞神经网络的全局鲁棒指数稳定性

研究了一类区间时变扰动、变时滞细胞神经网络的全局鲁棒指数稳定性问题．利用Leibniz-Newton公式对原系统进行模型变换,并分析了变换模型和原始模型的等价性．基于变换模型,运用线性矩阵不等式的方法,通过选择适当的Lyapunov-Krasovskii泛函,推导了该系统全局鲁棒指数稳定的时滞相关的充分条件．通过数值实例将所得结果与前人的结果相比较,表明了本文所提出的稳定判据具有更低的保守性．     

Solving Pseudomonotone Variational Inequalities and Pseudoconvex Optimization Problems Using the Projection Neural Network

In recent years, a recurrent neural network called projection neural network was proposed for solving monotone variational inequalities and related convex optimization problems. In this paper, we show that the projection neural network can also be used to solve pseudomonotone variational inequalities and related pseudoconvex optimization problems. Under various pseudomonotonicity conditions and other conditions, the projection neural network is proved to be stable in the sense of Lyapunov and globally convergent, globally asymptotically stable, and globally exponentially stable. Since monotonicity is a special case of pseudomononicity, the projection neural network can be applied to solve a broader class of constrained optimization problems related to variational inequalities. Moreover, a new concept, called componentwise pseudomononicity, different from pseudomononicity in general, is introduced. Under this new concept, two stability results of the projection neural network for solving variational inequalities are also obtained. Finally, numerical examples show the effectiveness and performance of the projection neural network     

Unified stabilizing controller synthesis approach for discrete-time intelligent systems with time delays by dynamic output feedback

A novel model, termed the standard neural network model (SNNM), is advanced to describe some delayed (or non-delayed) discrete-time intelligent systems com- posed of neural networks and Takagi and Sugeno (T-S) fuzzy models. The SNNM is composed of a discrete-time linear dynamic system and a bounded static nonlinear operator. Based on the global asymptotic stability analysis of the SNNMs, linear and nonlinear dynamic output feedback controllers are designed for the SNNMs to stabilize the closed-loop systems, respectively. The control design equations are shown to be a set of linear matrix inequalities (LMIs) which can be easily solved by various convex optimization algorithms to determine the control signals. Most neural-network-based (or fuzzy) discrete-time intelligent systems with time delays or without time delays can be transformed into the SNNMs for controller synthesis in a unified way. Three application examples show that the SNNMs not only make controller synthesis of neural-network-based (or fuzzy) discrete-time intelligent systems much easier, but also provide a new approach to the synthesis of the controllers for the other type of nonlinear systems.     

Stability analysis of discrete-time recurrent neural networks based on standard neural network models

In order to conveniently analyze the stability of various discrete-time recurrent neural networks (RNNs), including bidirectional associative memory, Hopfield, cellular neural network, Cohen-Grossberg neural network, and recurrent multiplayer perceptrons, etc., the novel neural network model, named standard neural network model (SNNM) is advanced to describe this class of discrete-time RNNs. The SNNM is the interconnection of a linear dynamic system and a bounded static nonlinear operator. By combining Lyapunov functional with S-Procedure, some useful criteria of global asymptotic stability for the discrete-time SNNMs are derived, whose conditions are formulated as linear matrix inequalities. Most delayed (or non-delayed) RNNs can be transformed into the SNNMs to be stability analyzed in a unified way. Some application examples of the SNNMs to the stability analysis of the discrete-time RNNs shows that the SNNMs make the stability conditions of the RNNs easily verified.     

New delay-dependent global asymptotic stability condition for Hopfield neural networks with time-varying delays

This paper deals with the global asymptotic stability problem for Hopfield neural networks with time-varying delays. By resorting to the integral inequality and constructing a Lyapunov-Krasovskii functional, a novel delay-dependent condition is established to guarantee the existence and global asymptotic stability of the unique equilibrium point for a given delayed Hopfield neural network. This criterion is expressed in terms of linear matrix inequalities （LMIs）, which can be easily checked by utilizing the recently developed algorithms for solving LMIs. Examples are provided to demonstrate the effectiveness and reduced conservatism of the proposed condition.     

A Hopfield neural network with multi-compartmental activation

The Hopfield network is a form of recurrent artificial neural network. To satisfy demands of artificial neural networks and brain activity, the networks are needed to be modified in different ways. Accordingly, it is the first time that, in our paper, a Hopfield neural network with piecewise constant argument of generalized type and constant delay is considered. To insert both types of the arguments, a multi-compartmental activation function is utilized. For the analysis of the problem, we have applied the results for newly developed differential equations with piecewise constant argument of generalized type beside methods for differential equations and functional differential equations. In the paper, we obtained sufficient conditions for the existence of an equilibrium as well as its global exponential stability. The main instruments of investigation are Lyapunov functionals and linear matrix inequality method. Two examples with simulations are given to illustrate our solutions as well as global exponential stability.

     

Delayed standard neural network models for control systems.

In order to conveniently analyze the stability of recurrent neural networks (RNNs) and successfully synthesize the controllers for nonlinear systems, similar to the nominal model in linear robust control theory, the novel neural network model, named delayed standard neural network model (DSNNM) is presented, which is the interconnection of a linear dynamic system and a bounded static delayed (or nondelayed) nonlinear operator. By combining a number of different Lyapunov functionals with S-procedure, some useful criteria of global asymptotic stability and global exponential stability for the continuous-time DSNNMs (CDSNNMs) and discrete-time DSNNMs (DDSNNMs) are derived, whose conditions are formulated as linear matrix inequalities (LMIs). Based on the stability analysis, some state-feedback control laws for the DSNNM with input and output are designed to stabilize the closed-loop systems. Most RNNs and neurocontrol nonlinear systems with (or without) time delays can be transformed into the DSNNMs to be stability-analyzed or stabilization-synthesized in a unified way. In this paper, the DSNNMs are applied to analyzing the stability of the continuous-time and discrete-time RNNs with or without time delays, and synthesizing the state-feedback controllers for the chaotic neural-network-system and discrete-time nonlinear system. It turns out that the DSNNM makes the stability conditions of the RNNs easily verified, and provides a new idea for the synthesis of the controllers for the nonlinear systems.     

A Simplified Neural Network for Linear Matrix Inequality Problems

A simplified neural network model is proposed to solve a class of linear matrix inequality problems. The stability and solvability of the proposed neural network are analyzed and discussed theoretically. In comparison with the previous neural network models (Lin and Huang, Neural Process Lett 11:153–169, 2000; Lin et al., IEEE Trans Neural Netw 11:1078–1092, 2000), the simplified one is composed of two layers rather than three layers, and the neuron array in each layer is triangular rather than square. The proposed approach can therefore reduce the complexity of the neural network architecture. In addition, the simplified neural network can also be extended to solve multiple linear matrix inequalities with specific constraints, which enlarges the application domain of the proposed approach. Finally, examples are given to illustrate the effectiveness and efficiency of the simplified neural network.     

New cooperative projection neural network for nonlinearly constrained variational inequality

This paper proposes a new cooperative projection neural network (CPNN), which combines automatically three individual neural network models with a common projection term. As a special case, the proposed CPNN can include three recent recurrent neural networks for solving monotone variational inequality problems with limit or linear constraints, respectively. Under the monotonicity condition of the corresponding Lagrangian mapping, the proposed CPNN is theoretically guaranteed to solve monotone variational in...     

神经网络在线投影算法及非线性建模应用

针对神经网络难以在线学习的缺点,把神经网络当作结构已知的非线性系统,权系数的学习看成非线性系统的参数估计,基于新估计准则的非线性系统在线参数估计投影算法,给出前馈神经网络的一种在线运行投影学习算法.理论上证明该算法的全局收敛性,讨论算法参数的物理意义和取值范围.通过2个非线性时变系统的神经网络建模应用的仿真,验证算法的全局收敛性和在线运行能力.     

A neural network-based approximation method for discrete-timenonlinear servomechanism problem

A feedback controller that solves the discrete-time nonlinear servomechanism problem relies on the solution of a set of nonlinear functional equations known as the discrete regulator equations. The exact solution of the discrete regulator equations is usually unavailable due to the nonlinearity of the system. The paper proposes to approximately solve the discrete regulator equations using a feedforward neural network. This approach leads to an effective way to practically solve the discrete nonlinear servomechanism problem. The approach has been illustrated using the well-known inverted pendulum on a cart system. The simulation shows that the control law designed by the proposed approach performs much better than the conventional linear control law.     

A New Projection-Based Neural Network for Constrained Variational Inequalities

This paper presents a new neural network model for solving constrained variational inequality problems by converting the necessary and sufficient conditions for the solution into a system of nonlinear projection equations. Five sufficient conditions are provided to ensure that the proposed neural network is stable in the sense of Lyapunov and converges to an exact solution of the original problem by defining a proper convex energy function. The proposed neural network includes an existing model, and can be applied to solve some nonmonotone and nonsmooth problems. The validity and transient behavior of the proposed neural network are demonstrated by some numerical examples.      

3D face reconstruction using images from cameras with varying parameters

In this paper, we present a new technique of 3D face reconstruction from a sequence of images taken with cameras having varying parameters without the need to grid. This method is based on the estimation of the projection matrices of the cameras from a symmetry property which characterizes the face, these projections matrices are used with points matching in each pair of images to determine the 3D points cloud, subsequently, 3D mesh of the face is constructed with 3D Crust algorithm. Lastly, the 2D image is projected on the 3D model to generate the texture mapping. The strong point of the proposed approach is to minimize the constraints of the calibration system: we calibrated the cameras from a symmetry property which characterizes the face, this property gives us the opportunity to know some points of 3D face in a specific well-chosen global reference, to formulate a system of linear and nonlinear equations according to these 3D points, their projection in the image plan and the elements of the projections matrix. Then to solve these equations, we use a genetic algorithm which consists of finding the global optimum without the need of the initial estimation and allows to avoid the local minima of the formulated cost function. Our study is conducted on real data to demonstrate the validity and the performance of the proposed approach in terms of robustness, simplicity, stability and convergence.     

基于LMI方法的时滞细胞神经网络稳定性分析

神经网络是一个复杂的大规模非线性系统，而时滞神经网络的动态行为更为丰富和复杂．现有的研究时滞神经网络稳定性的方法中最为流行的是Lyapunov方法．它把稳定性问题变为某些适当地定义在系统轨迹上的泛函，通过这些泛函相应的稳定性条件就可以获得．该文得到了时滞细胞神经网络渐近稳定性的一些充分条件．作者利用了泛函微分方程的Lyapunov—Krasovskii稳定性理论和线性矩阵不等式(LMI)方法，精炼和推广了一些已有的结果．它们比目前文献报道的结果更少保守．该文还给出了确定时滞细胞神经网络稳定性更多的判定准则．