Optimal routing in multiple I/O data network using neural network with perturbed energy function

An optimal routing problem in multiple I/O data network is one of the most important problems related on the performance of the network basically, and is formulated as a constrained nonlinear optimization problem. When solving the problem considered using neural networks, we may obtain local minima, rather than global minimum, because the problem has multimodals. In this paper, we introduce a perturbed energy function into the neural network based on a penalty method to solve the multimodal nonlinear optimization problem.     

An exact penalty function algorithm for solving general constrained parameter optimization problems

An exact penalty function type of algorithm is proposed to solve a general class of constrained parameter optimization problems. The proposed algorithm has the property that any solution obtained by it will always satisfy the problem constraints, and that it will obtain a solution to the constrained problem, within a given specified tolerance, by solving a single unconstrained problem, i.e. it is not necessary to solve a sequence of unconstrained optimization problems. The algorithm applies a modification of Rosenbrock's (Rosenbrock, 1960) polynomial boundary penalty function, and a negative exponential penalty function with moving parameters, to modify the objective function in the neighborhood of the constrained region; a robust unconstrained algorithm (Davison and Wong, 1975) is then used to solve the resulting unconstrained optimization problem. Some standard test functions are included to show the performance of the algorithhm. Application of the algorithm is then made to solve some computer-aided design problems occurring in the area of control system synthesis.     

求解约束优化问题的人工鱼群算法

在利用人工鱼群算法求解约束问题时,处理好约束条件是取得好的优化效果的关键。引入了半可行域的概念,并结合人工鱼群算法(ArtificialFish-SwarmAlgorithm,AFSA)本身的特点,设计了基于竞争选择和惩罚函数的适应度函数,从而得到了一个利用ASFA算法求解约束优化问题的新的进化算法。实验证明了算法的有效性。     

基于量子粒子群算法的时延受限组播路由问题研究

对具有延时约束的最小代价的组播路由问题进行研究,提出一种收敛速度快、全局性能好、不易陷入局部最优的智能迭代算法-量子粒子群算法来实现该问题的求解.该算法采用整数编码方式,将路由优化问题转化成准连续优化,并采用惩罚函数处理约束条件.最后通过具体算例,对该算法进行了仿真验证,结果表明,在求解延时约束的组播路由问题时,量子粒子群算法要优于遗传算法、克隆算法,从而验证了该算法的可行性和有效性.     

A hybrid approach to constrained global optimization

In this paper, we propose a novel hybrid global optimization method to solve constrained optimization problems. An exact penalty function is first applied to approximate the original constrained optimization problem by a sequence of optimization problems with bound constraints. To solve each of these box constrained optimization problems, two hybrid methods are introduced, where two different strategies are used to combine limited memory BFGS (L-BFGS) with Greedy Diffusion Search (GDS). The convergence issue of the two hybrid methods is addressed. To evaluate the effectiveness of the proposed algorithm, 18 box constrained and 4 general constrained problems from the literature are tested. Numerical results obtained show that our proposed hybrid algorithm is more effective in obtaining more accurate solutions than those compared to.     

A joint convex penalty for inverse covariance matrix estimation

The paper proposes a joint convex penalty for estimating the Gaussian inverse covariance matrix. A proximal gradient method is developed to solve the resulting optimization problem with more than one penalty constraints. The analysis shows that imposing a single constraint is not enough and the estimator can be improved by a trade-off between two convex penalties. The developed framework can be extended to solve wide arrays of constrained convex optimization problems. A simulation study is carried out to compare the performance of the proposed method to graphical lasso and the SPICE estimate of the inverse covariance matrix.     

基于神经网络建模和遗传算法的重油脱盐系统优化研究

概述了重油脱盐系统的BP神经网络建模以及基于遗传算法的系统优化过程，将遗传算法与惩罚函数法相结合应用于约束优化的问题，改善了遗传算法的局限性。同时为了将不等式约束优化问题转化为单目标优化问题，对惩罚函数法进行了改进。结果表明：此方法可以有效解决静电脱盐问题。     

Directed searching optimization algorithm for constrained optimization problems

A directed searching optimization algorithm (DSO) is proposed to solve constrained optimization problems in this paper. The proposed algorithm includes two important operations — position updating and genetic mutation. Position updating enables the non-best solution vectors to mimic the best one, which is beneficial to the convergence of the DSO; genetic mutation can increase the diversity of individuals, which is beneficial to preventing the premature convergence of the DSO. In addition, we adopt the penalty function method to balance objective and constraint violations. We can obtain satisfactory solutions for constrained optimization problems by combining the DSO and the penalty function method. Experimental results indicate that the proposed algorithm can be an efficient alternative on solving constrained optimization problems.     

改进罚函数法与蝙蝠算法在约束优化中的应用

设计了一种基于自适应罚函数法和改进蝙蝠算法的约束优化问题求解方法。提出了一种自适应罚函数法,该处理方法综合考虑了约束违反的情况和进化过程的特点,如果某个约束违反的次数越多,则证明该约束越强,赋予惩罚系数越大;种群中的不可行解的数量越多,为保持种群的多样性,则约束应该取较小的值,即惩罚系数取较小的值。提出了一种改进的蝙蝠算法,利用混沌的遍历性特点产生初始种群,增强了初始种群的多样性和种群的质量;在考虑了脉冲响度的蝙蝠算法局部搜索中,融入了交叉操作;为防止算法在后期陷入局部最优解,引进了变异操作,保证了群体的多样性。将自适应罚函数法与改进的蝙蝠算法融合起来求解约束优化问题,4个复杂的标准测试函数和2个工程实际问题证明了该约束优化求解方法的可行性和有效性。     

基于罚函数内点法的泄露积分型回声状态网的参数优化

为了提升泄露积分型回声状态网（Leaky integrator echo state network,Leaky-ESN）的性能,提出利用罚函数内点法优化Leaky-ESN的全局参数,如泄漏率、内部连接权矩阵谱半径、输入比例因子等,这克服了通过反复试验法选取参数值而降低了Leaky-ESN模型的优越性和性能.Leaky-ESN的全局参数必须保障回声状态网满足回声状态特性,因此它们之间存在不等式约束条件.有学者提出利用随机梯度下降法来优化内部连接权矩阵谱半径、输入比例因子、泄露率三个全局参数,一定程度上提高了Leaky-ESN的逼近精度.然而,随机梯度下降法是解决无约束优化问题的基本算法,在利用随机梯度下降法优化参数时,没有考虑参数必须满足回声特性的约束条件（不等式约束条件）,致使得到的参数值不是最优解.由于罚函数内点法可以求解具有不等式约束的最优化问题,应用范围广,收敛速度较快,具有很强的全局寻优能力.因此,本文提出利用罚函数内点法优化Leaky-ESN的全局参数,并以时间序列预测为例,检验优化后的Leaky-ESN的预测性能,仿真结果表明了本文提出方法的有效性.     

Discrete thickness optimization via piecewise constraint penalization

Structural engineers are often constrained by cost or manufacturing considerations to select member thicknesses from a discrete set of values. Conventional, gradient-free techniques to solve these discrete problems cannot handle large problem sizes, while discrete material optimization (DMO) techniques may encounter difficulties, especially for bending-dominated problems. To resolve these issues, we propose an efficient gradient-based technique to obtain engineering solutions to the discrete thickness selection problem. The proposed technique uses a series of constraints to enforce an effective stiffness-to-mass and strength-to-mass penalty on intermediate designs. In conjunction with these constraints, we apply an exact penalty function which drives the solution towards a discrete design. We utilize a continuation approach to obtain approximate solutions to the discrete thickness selection problem by solving a sequence of relaxed continuous problems with increasing penalization. We also show how this approach can be applied to combined discrete thickness selection and topology optimization design problems. To demonstrate the effectiveness of the proposed technique, we present both compliance and stress-constrained results for in-plane and bending-dominated problems.     

求解约束优化问题的改进灰狼优化算法

针对基本灰狼优化(GWO)算法存在求解精度低、收敛速度慢、局部搜索能力差的问题,提出一种改进灰狼优化(IGWO)算法用于求解约束优化问题。该算法采用非固定多段映射罚函数法处理约束条件,将原约束优化问题转化为无约束优化问题,然后利用IGWO算法对转换后的无约束优化问题进行求解。在IGWO算法中,引入佳点集理论生成初始种群,为算法全局搜索奠定基础;为了提高局部搜索能力和加快收敛,对当前最优灰狼个体执行Powell局部搜索。采用几个标准约束优化测试问题进行仿真实验,结果表明该算法不仅克服了基本GWO的缺点,而且性能优于差分进化和粒子群优化算法。     

Performance enhancement of extreme learning machine for multi-category sparse data classification problems

This paper presents a performance enhancement scheme for the recently developed extreme learning machine (ELM) for multi-category sparse data classification problems. ELM is a single hidden layer neural network with good generalization capabilities and extremely fast learning capacity. In ELM, the input weights are randomly chosen and the output weights are analytically calculated. The generalization performance of the ELM algorithm for sparse data classification problem depends critically on three free parameters. They are, the number of hidden neurons, the input weights and the bias values which need to be optimally chosen. Selection of these parameters for the best performance of ELM involves a complex optimization problem.In this paper, we present a new, real-coded genetic algorithm approach called ‘RCGA-ELM’ to select the optimal number of hidden neurons, input weights and bias values which results in better performance. Two new genetic operators called ‘network based operator’ and ‘weight based operator’ are proposed to find a compact network with higher generalization performance. We also present an alternate and less computationally intensive approach called ‘sparse-ELM’. Sparse-ELM searches for the best parameters of ELM using K-fold validation. A multi-class human cancer classification problem using micro-array gene expression data (which is sparse), is used for evaluating the performance of the two schemes. Results indicate that the proposed RCGA-ELM and sparse-ELM significantly improve ELM performance for sparse multi-category classification problems.     

动态评价粒子群优化及风电场微观选址

提出了动态评价方法处理一类约束优化问题.将目标函数值和约束违反量进行动态归一化处理,再进行加权求和,动态评价解的优化性能.不仅解决了惩罚因子确定困难的问题,而且增加了优化算法的多样性,提高了优化算法搜索全局最优解的能力.将动态评价方法引入粒子群算法,求解风电场微观选址优化问题.仿真结果表明,动态评价方法提高了风电场发电量和风能利用效率.此外,该方法可广泛应用于其他优化算法以求解约束优化问题.     

An enhanced swarm intelligence clustering-based RBFNN classifier and its application in deep Web sources classification

The central problem in training a radial basis function neural network (RBFNN) is the selection of hidden layer neurons, which includes the selection of the center and width of those neurons. In this paper, we propose an enhanced swarm intelligence clustering (ESIC) method to select hidden layer neurons, and then, train a cosine RBFNN based on the gradient descent learning process. Also, we apply this new method for classification of deep Web sources. Experimental results show that the average Precision, Recall and F of our ESIC-based RBFNN classifier achieve higher performance than BP, Support Vector Machines (SVM) and OLS RBF for our deep Web sources classification problems.     

基于遗传算法的退火精确罚函数非线性约束优化方法

提出了一种新的基于遗传算法求解非线性约束优化的方法，通过自适应的退火罚因子和不可微精确罚函数未处理的约束条件，可以使算法逐渐收敛于可行的极值点，仿真结果表明该方法有较刘的求解精度。     

An enhanced swarm intelligence clustering-based RBFNN classifier and its application in deep Web sources classification

The central problem in training a radial basis function neural network (RBFNN) is the selection of hidden layer neurons, which includes the selection of the center and width of those neurons. In this paper, we propose an enhanced swarm intelligence clustering (ESIC) method to select hidden layer neurons, and then, train a cosine RBFNN based on the gradient descent learning process. Also, we apply this new method for classification of deep Web sources. Experimental results show that the average Precision, Recall and F of our ESIC-based RBFNN classifier achieve higher performance than BP, Support Vector Machines (SVM) and OLS RBF for our deep Web sources classification problems.     

基于群智能求解带约束问题的时域鲁棒优化算法

针对现有的时域鲁棒优化算法无法解决带约束的优化问题,基于群智能优化方法,提出一种求解带约束优化问题的时域鲁棒优化算法.首先,用约束条件构造罚函数,将带约束优化问题处理成为无约束优化问题;然后,采用一个分段函数作为粒子的适应度评价函数,通过竞争规则筛选粒子,设计带约束问题的时域鲁棒优化算法.以优化碳纤维原丝的性能为背景,将算法在多组参数下进行测试和对比分析,结果表明了所提出算法的有效性.进一步分析AR模型对算法性能的影响,指出预测模型的改进是提升算法性能的一个重要手段.     

基于分布感知的Web服务组合方法研究

提出了一种分布感知的Web 服务组合方法。移动Agent代理Web 服务,构成一个自治的感知单元,移动Agent通过语义的协商确认匹配关系,Web 服务组合可以通过移动Agent的演化完成。常见的遗传组合算法存在着复杂路径表示和罚函数难于确定的局限性,采用感知基础上的服务关系矩阵和服务相对质量的矩阵,最优服务组合的建立转化为带约束的最优化问题,并给出不带参数的罚函数动态演化算法解决方案,仿真表明这种方法可以提高适应度和性能。     

动态罚函数法求解约束优化问题

针对罚函数法在求解约束优化问题时罚系数不易选取的问题,提出一种基于动态罚函数的差分进化算法.利用罚函数法将约束优化问题转化为无约束优化问题.为平衡种群的目标函数和约束违反程度,结合ε约束法设计了一种动态罚系数策略,其中罚系数随着种群质量和进化代数的改变而改变.采用差分进化算法更新种群直到搜索到最优解.对IEEE CEC...