基于连续时间的二阶多智能体分布式资源分配算法

针对二阶多智能体系统中的分布式资源分配问题, 本文设计两种连续时间算法. 基于KKT (Karush?Kuhn?Tucker, 卡罗需?库恩?塔克)优化条件, 第一种控制算法利用节点局部不等式及其梯度信息来约束节点状态. 与上述梯度方法不同, 第二种控制算法包括一致性梯度下降法和固定时间收敛映射算子, 其中固定时间收敛映射算子确保算法的节点状态在固定时间收敛到局部约束集, 一致性梯度下降法目的是确保节点迭代到资源分配问题最优解. 两种控制算法都对状态无初始值约束, 且控制参数都是常数. 利用凸优化理论和固定时间李雅普诺夫方法, 分别分析了上述控制策略在有向平衡网络条件下的渐近和指数收敛性. 最后通过数值仿真验证了所设计算法在一维和高维资源分配问题的有效性.     

定步长压缩感知锥束CT重建算法

针对锥束CT成像系统中投影数据不完全的图像重建问题,提出了一种定步长压缩感知锥束CT重建算法。首先将锥束CT重建问题归结为投影数据均方误差作为数据保真项、全变分作为正则项的无约束优化问题,分析目标函数的Lipschitz连续性;然后近似计算Lipschitz常数,求出梯度下降步长,利用梯度下降法进行重建;最后对CT投影数据采用联合代数重建算法更新重建图像。在每次迭代过程中调整梯度下降步长,提高重建算法的收敛速度。Shepp-Logan模型的无噪声实验结果表明,该算法的重建图像信噪比分别比联合代数重建算法、自适应最速下降-凸集投影算法、BB梯度投影算法的重建图像信噪比高出13.7728dB、12.8205dB、7.3580dB。仿真试验表明该重建算法提高了收敛速度,同时减少了重建图像的相对误差,极大提高了用少量投影数据重建的图像质量。     

Wei–Yao–Liu conjugate gradient projection algorithm for nonlinear monotone equations with convex constraints

In this paper, the Wei–Yao–Liu (WYL) conjugate gradient projection algorithm will be studied for nonlinear monotone equations with convex constraints, which can be viewed as an extension of the WYL conjugate gradient method for solving unconstrained optimization problems. These methods can be applied to solving large-scale nonlinear equations due to the low storage requirement. We can obtain global convergence of our algorithm without requiring differentiability in the case that the equation is Lipschitz continuous. The numerical results show that the new algorithm is efficient.     

Two stochastic optimization algorithms for convex optimization with fixed point constraints

Two optimization algorithms are proposed for solving a stochastic programming problem for which the objective function is given in the form of the expectation of convex functions and the constraint set is defined by the intersection of fixed point sets of nonexpansive mappings in a real Hilbert space. This setting of fixed point constraints enables consideration of the case in which the projection onto each of the constraint sets cannot be computed efficiently. Both algorithms use a convex function and a nonexpansive mapping determined by a certain probabilistic process at each iteration. One algorithm blends a stochastic gradient method with the Halpern fixed point algorithm. The other is based on a stochastic proximal point algorithm and the Halpern fixed point algorithm; it can be applied to nonsmooth convex optimization. Convergence analysis showed that, under certain assumptions, any weak sequential cluster point of the sequence generated by either algorithm almost surely belongs to the solution set of the problem. Convergence rate analysis illustrated their efficiency, and the numerical results of convex optimization over fixed point sets demonstrated their effectiveness.     

非平衡有向网络下带约束的连续时间分布式优化算法设计EI北大核心CSCD

本文基于权重不平衡有向网络,对一类分布式约束优化问题进行研究,其中全局目标函数等于具有李普希兹梯度的强凸目标函数之和,并且每个智能体的状态都有一个局部约束集.每个智能体仅知道自身的局部目标函数和非空约束集.本文的目标是用分布式方法求解该问题的最优解.针对优化问题,提出了一种新的分布式投影梯度连续时间协调算法,利用拉普拉斯矩阵的零特征值对应的左特征向量消除了图的不平衡性.在某些假设下,结合凸分析理论和李雅普诺夫稳定性理论,证明了算法能够获得问题的最优解.最后,通过仿真验证了算法的有效性.     

基于SL0范数的改进稀疏信号重构算法

平滑范数（Smoothed l0,SL0）压缩感知重构算法通过引入平滑函数序列将求解最小l0范数问题转化为平滑 函数优化问题,可以有效地用于稀疏信号重构。针对平滑函数的选取和算法稳健性问题,提出一种新的平滑函数序列近似范数,结合梯度投影法优化求解,并进一步提出采用奇异值分解（Singular value decomposition, SVD）方法改进算法的稳健性,实现稀疏度信号的精确重构。仿真结果表明,在相同的测试条件下,本文算法相比OMP算法、SL0算法以及L1-magic算法在重构精度、峰值信噪比方面都有较大改善。     

求解多集分裂可行问题的一种共轭梯度法

基于求解多集分裂可行问题与非线性最优化问题的等价性,考虑Jinling Zhao and Qingzhi Yang在[1]中提出的求解SFP的共轭梯度法和Censor等在[2]中提出的梯度投影法,尝试运用共轭梯度法求解多集分裂可行问题;并且证明了所构造算法的收敛性．提出的新算法克NT求矩阵逆的缺点．初步的数值结果表明新算法对于不同的问题都能够有较快的收敛速度,具有良好的稳定性和可行性,在问题维数增大时表现得越发明显．     

多运动体分布式最优编队构型形成算法

针对分布式通信条件下的多运动体编队构型形成问题进行研究.考虑到个体的有限通信与感知能力,传统集中式求解算法无法适应实际需求,提出一种基于分布式交替映射凸优化的分布式时间最优编队构型形成算法,使得个体间仅依赖局部通信与局部计算实现编队构型的快速形成;将该问题建模为含有等式约束的分布式Minimax凸优化问题,提出基于虚拟等式约束函数的分布式交替映射凸优化算法实现求解;根据求解结果,各运动体采用RVO避障策略实现最优构型形成.针对含有100个运动体的最优编队构型形成问题进行仿真,验证了所提出算法的有效性.     

DC programming and DCA for enhancing physical layer security via cooperative jamming

The explosive development of computational tools these days is threatening security of cryptographic algorithms, which are regarded as primary traditional methods for ensuring information security. The physical layer security approach is introduced as a method for both improving confidentiality of the secret key distribution in cryptography and enabling the data transmission without relaying on higher-layer encryption. In this paper, the cooperative jamming paradigm - one of the techniques used in the physical layer is studied and the resulting power allocation problem with the aim of maximizing the sum of secrecy rates subject to power constraints is formulated as a nonconvex optimization problem. The objective function is a so-called DC (Difference of Convex functions) function, and some constraints are coupling. We propose a new DC formulation and develop an efficient DCA (DC Algorithm) to deal with this nonconvex program. The DCA introduces the elegant concept of approximating the original nonconvex program by a sequence of convex ones: at each iteration of DCA requires solution of a convex subproblem. The main advantage of the proposed approach is that it leads to strongly convex quadratic subproblems with separate variables in the objective function, which can be tackled by both distributed and centralized methods. One of the major contributions of the paper is to develop a highly efficient distributed algorithm to solve the convex subproblem. We adopt the dual decomposition method that results in computing iteratively the projection of points onto a very simple structural set which can be determined by an inexpensive procedure. The numerical results show the efficiency and the superiority of the new DCA based algorithm compared with existing approaches.     

Support Vector的几何解释及其在联想记忆中的应用

利用闭凸集上的投影解释support vector的几何意义，利用支持超平面讨论线性分类器的设计问题，对线性可分情形，Support vector由一类数据集合闭凸包在另一类数据集合闭凸包上投影的非零系数向量组成，SVM所决定的超平面位于两投影点关于各自数据集合支持超平面的中间，作为应用，文中给出一种设计理想联想记忆前馈神经网络的方法，它是FP算法的一般化。     

一种任意多面体剖分成四面体的改进算法

针对原相关算法中存在的不足,提出了凸顶点的凸空间从原多面体中完整剖分出去的充要条件。引入平面切角和空间切角的概念,使剖分思想更加直观、简化。对空间多边形进行Delaunay三角剖分时,充分考虑了凸空间的结构特点,采用了透视投影的思想,使投影后的平面多面形保持了原空间多边形的拓扑结构和顶点的凹凸性,保证了三角剖分的合理性、正确性。基于空间相关性的思想,对凸顶点的邻接点生成有向空间包围盒,快速排除与凸空间不相交的面,加快了多面体剖分的速度;最后给出了改进后的剖分算法,对相关应用有着极大的实用价值。     

基于有序简单多边形的平面点集凸包快速求取算法

凸包问题是计算几何的基本问题之一，在许多领域均有应用。传统平面点集凸包算法和简单多边形凸包算法平行发展，互不相干。本文将改进的简单多边形凸包算法应用于平面点集凸包问题中，提出了新的点集凸包算法。该算法首先淘汰掉明显不位于凸包上的点，然后对剩余点集排序，再将点集按照一定顺序串联成有序简单多边形，最后利用前瞻回溯方法搜索多边形凸包，从而得到点集的凸包。本文算法不仅达到了Ｏ的理论时间复杂度下限，而且算法     

SENSC: 一个稳定高效的非负稀疏编码算法

非负稀疏编码(Nonnegative sparse coding, NSC)已成功应用在很多领域的研究中. 目前使用的NSC算法通过梯度投影法和基于辅助函数的乘性更新法相结合来实现, 其性能受迭代步长的影响很大, 且效率较低. 为增强NSC的可应用性, 本文通过对一组凸超抛物面函数做交替最小化来实现NSC, 并依据凸超抛物面特性、点到非负数集合的投影规则以及点到原点处单位超球的投影规则构造了一个无用户定义优化参数的稳定高效的NSC算法---SENSC. 从数学角度, 文中推断了SENSC比现有算法高效且它的解优于当前算法的解, 证明了它的稳定性和收敛性. 实验验证了上述理论推断的正确, 说明了SENSC调节编码稀疏性的能力比已有算法更强.     

集合约束下多智能体系统分布式固定时间优化控制

本文研究一类具有状态约束的多智能体系统优化控制问题,提出了一种具有固定时间收敛特性的分布式优化控制算法.该控制算法由局部投影模块、一致性模块和梯度模块构成,其中局部投影模块确保智能体的状态在固定时间内收敛到局部约束集合,基于时变增益的一致性模块实现所有智能体的状态在固定时间内收敛到一致值,基于时变增益的梯度模块实现智能体的状态在固定时间内收敛到最优解.利用凸优化理论和固定时间李雅普诺夫理论,分析了算法的固定时间收敛特性.算法收敛时间的上界值不依赖系统的初始条件,因而可以根据任务需求来预先设计收敛时间.最后通过数值仿真验证了理论结果的有效性.     

A novel neural network for nonlinear convex programming

In this paper, we present a neural network for solving the nonlinear convex programming problem in real time by means of the projection method. The main idea is to convert the convex programming problem into a variational inequality problem. Then a dynamical system and a convex energy function are constructed for resulting variational inequality problem. It is shown that the proposed neural network is stable in the sense of Lyapunov and can converge to an exact optimal solution of the original problem. Compared with the existing neural networks for solving the nonlinear convex programming problem, the proposed neural network has no Lipschitz condition, no adjustable parameter, and its structure is simple. The validity and transient behavior of the proposed neural network are demonstrated by some simulation results.     

Implementation of a subgradient projection algorithm

This paper discusses the implementation of an algorithm due to Sreedharan [8] for the minimization, subject to linear constraints, of an objective function composed of the sum of a piecewise-affine, convex function with a smooth, strictly convex function. Successful techniques for two subproblems arising in the algorithm, a projection problem and a line search problem, are described in detail. Computational experience with the algorithm on several test problems is presented.     

A Nonfeasible Gradient Projection Recurrent Neural Network for Equality-Constrained Optimization Problems

In this paper, a recurrent neural network for both convex and nonconvex equality-constrained optimization problems is proposed, which makes use of a cost gradient projection onto the tangent space of the constraints. The proposed neural network constructs a generically nonfeasible trajectory, satisfying the constraints only as t rarr infin. Local convergence results are given that do not assume convexity of the optimization problem to be solved. Global convergence results are established for convex optimization problems. An exponential convergence rate is shown to hold both for the convex case and the nonconvex case. Numerical results indicate that the proposed method is efficient and accurate.     

An inexact continuation accelerated proximal gradient algorithm for low n-rank tensor recovery

The low n-rank tensor recovery problem is an interesting extension of the compressed sensing. This problem consists of finding a tensor of minimum n-rank subject to linear equality constraints and has been proposed in many areas such as data mining, machine learning and computer vision. In this paper, operator splitting technique and convex relaxation technique are adapted to transform the low n-rank tensor recovery problem into a convex, unconstrained optimization problem, in which the objective function is the sum of a convex smooth function with Lipschitz continuous gradient and a convex function on a set of matrices. Furthermore, in order to solve the unconstrained nonsmooth convex optimization problem, an accelerated proximal gradient algorithm is proposed. Then, some computational techniques are used to improve the algorithm. At the end of this paper, some preliminary numerical results demonstrate the potential value and application of the tensor as well as the efficiency of the proposed algorithm.     

A self-adaptive gradient projection algorithm for the nonadditive traffic equilibrium problem

Gradient projection (GP) algorithm has been shown as an efficient algorithm for solving the traditional traffic equilibrium problem with additive route costs. Recently, GP has been extended to solve the nonadditive traffic equilibrium problem (NaTEP), in which the cost incurred on each route is not just a simple sum of the link costs on that route. However, choosing an appropriate stepsize, which is not known a priori, is a critical issue in GP for solving the NaTEP. Inappropriate selection of the stepsize can significantly increase the computational burden, or even deteriorate the convergence. In this paper, a self-adaptive gradient projection (SAGP) algorithm is proposed. The self-adaptive scheme has the ability to automatically adjust the stepsize according to the information derived from previous iterations. Furthermore, the SAGP algorithm still retains the efficient flow update strategy that only requires a simple projection onto the nonnegative orthant. Numerical results are also provided to illustrate the efficiency and robustness of the proposed algorithm.     

Optimal replicator factor control in wireless sensor networks

For TDMA MAC protocols in wireless sensor networks (WSNs), redundancy and retransmission are two important methods to provide high end-to-end transmission reliability. Since reliable transmissions will lead to more energy consumption, there exists an intrinsic tradeoff between transmission reliability and energy efficiency. For each link, we name the number of its reserved time slots in each MAC superframe as a replicator factor. In the following paper, we propose a reliability-lifetime tradeoff framework (RLTF) for WSNs to study replicator factor control problem. First, for the redundancy TDMA MAC, we formulate replicator factor control problem as convex programming. By the gradient projection method, we develop a fully distributed algorithm to solve the convex programming. Second, for the retransmission TDMA MAC, we set the retransmission upper bound for each link according to the optimal replicator factors under the redundancy MAC and compute the total communication overhead for the retransmission MAC. Finally, we compare the communication overhead of these two MAC protocols under different channel conditions.