Cauchy mutation based on objective variable of Gaussian particle swarm optimization for parameters selection of SVM

On the basis of the slow convergence of particle swarm algorithm (PSO) during parameters selection of support vector machine (SVM), this paper proposes a hybrid mutation strategy that integrates Gaussian mutation operator and Cauchy mutation operator for PSO. The combinatorial mutation based on the fitness function value and the iterative variable is also applied to inertia weight. The results of application in parameter selection of support vector machine show the proposed PSO with hybrid mutation strategy based on Gaussian mutation and Cauchy mutation is feasible and effective, and the comparison between the method proposed in this paper and other ones is also given, which proves this method is better than sole Gaussian mutation and standard PSO.     

Hybrid forecasting model based on support vector machine and particle swarm optimization with adaptive and Cauchy mutation

This paper presents a novel hybrid forecasting model based on support vector machine and particle swarm optimization with Cauchy mutation objective and decision-making variables. On the basis of the slow convergence of particle swarm algorithm (PSO) during parameters selection of support vector machine (SVM), the adaptive mutation operator based on the fitness function value and the iterative variable is also applied to inertia weight. Then, a hybrid PSO with adaptive and Cauchy mutation operator (ACPSO) is proposed. The results of application in regression estimation show the proposed hybrid model (ACPSO–SVM) is feasible and effective, and the comparison between the method proposed in this paper and other ones is also given, which proves this method is better than other methods.     

高斯-柯西变异算子优化的LSSVM模型研究

论文针对标准量子粒子群算法易陷入局部极值的问题,提出一种改进的量子粒子优化最小二乘支持向量机的方法。利用高斯变异数的局部开发能力以及柯西变异数的全局搜索能力,在量子粒子群优化算法中,引入高斯-柯西变异算子,帮助算法跳出局部极值。并利用该优化模型进行光伏发电量预测实验,对优化的最小二乘支持向量机模型的预测结果与其他模型预测结果进行比较,结果表明:基于高斯-柯西变异算子的量子粒子群优化的最小二乘支持向量机对光伏发电量的预测具备较好的收敛速度和跳出局部收敛困境的能力。     

基于多策略协同作用的粒子群优化算法

针对粒子群优化(PSO)算法容易早熟收敛、在进化后期收敛精度低的缺点,提出了一种基于多策略协同作用的粒子群优化(MSPSO)算法。首先,设定一个概率阈值为0.3,在粒子迭代过程中,如果随机生成的概率值小于阈值,则采用对当前种群中的最优个体进行反向学习并生成其反向解,以提高算法的收敛速度和收敛精度;否则,算法执行对粒子的位置进行高斯变异策略,以增强种群的多样性;其次,提出一种将柯西分布的比例参数进行线性递减的柯西变异策略,能够产生更好的解引导粒子向最优解空间运动;最后,在8个标准测试函数上进行仿真测试,MSPSO算法在Rosenbrock、Schwefel's P2.22、Rotated Ackley、Quadric Noise、Ackley函数上收敛的平均值分别为1.68E+01、2.36E-283、8.88E-16、2.78E-05、8.88E-16,在Sphere、Griewank和Rastrigin函数上收敛达到最优解0,优于高斯扰动粒子群优化(GDPSO)算法、基于柯西变异的反向学习粒子群优化(GOPSO)算法。结果表明,所提出的算法收敛精度高,能避免粒子陷入局部最优。     

一种自适应柯西变异的反向学习粒子群优化算法

针对传统粒子群优化算法易出现早熟的问题,提出了一种自适应变异的反向学习粒子群优化算法。该算法在一般性反向学习方法的基础上,提出了自适应柯西变异策略(ACM)。采用一般性反向学习策略生成反向解,可扩大搜索空间,增强算法的全局勘探能力。为避免粒子陷入局部最优解而导致搜索停滞现象的发生,采用ACM策略对当前最优粒子进行扰动,自适应地获取变异点,在有效提高算法局部开采能力的同时,使算法能更加平稳快速地收敛到全局最优解。为进一步平衡算法的全局搜索与局部探测能力,采用非线性的自适应惯性权值。将算法在14个测试函数上与多种基于反向学习策略的PSO算法进行对比,实验结果表明提出的算法在解的精度以及收敛速度上得到了大幅度的提高。     

Car assembly line fault diagnosis based on triangular fuzzy Gaussian support vector classifier machine and modified genetic algorithm

This paper presents a new version of fuzzy support vector classifier machine to diagnose the nonlinear fuzzy fault system with multi-dimensional input variables. Since there exist problems of Gaussian noises and uncertain data in complex fuzzy fault system modeling, the input and output variables are described as fuzzy numbers. Then by integrating fuzzy theory, Gaussian loss function and v-support vector classifier machine, the fuzzy Gaussian v-support vector regression machine (Fg-SVCM) is proposed. To seek the optimal parameters of Fg-SVCM, the modified genetic algorithm (GA) is also applied to optimize parameters of Fg-SVCM. A diagnosing method based on Fg-SVCM and GA is put forward. The results of application in fault diagnosis of car assembly line show the hybrid diagnosis model based on Fg-SVCM and PSO is feasible and effective, and the comparison between the method proposed in this paper and other ones is also given, which proves this method is better than other v-SVCMs.     

带柯西变异的自学习改进烟花算法

针对烟花算法收敛速度慢和求解精度不高,论文提出了一种改进烟花算法--带柯西变异的自学习改进烟花算法.改进算法用全局搜索能力更强的柯西变异算子替代高斯变异算子,增大变异范围;用全局最优烟花个体和历史柯西火花的位置来构造新的爆炸半径使其不仅能够继承和学习历史信息,还能够自适应地调整步长;并使用可同时兼顾烟花质量与分布的"精英-随机"选择策略.使用了10个典型基准测试函数和10个0-1背包问题进行仿真实验,结果表明,与蝙蝠算法、粒子群算法、带高斯扰动的粒子群算法、烟花算法、增强烟花算法、自适应烟花算法相比.该算法在收敛速度、计算精度以及稳定性方面性能更优.     

免疫粒子群算法的改进及应用

在现有的免疫粒子群算法基础上,增加了交叉和高频变异操作,以保证种群进化的多样性,克服粒子群算法的早熟现象。本算法通过柯西变异提高算法的全局搜索能力;通过高斯变异提高算法的局部搜索能力。此外,为解决随机的、没有指导的交叉变异操作可能引起的退化现象,引入了疫苗提取和疫苗接种策略。仿真结果表明算法的收敛速度和精度都有明显提高。     

具有强开发能力的风驱动优化算法

风驱动优化算法是一种新兴的基于群体的迭代启发式全局优化算法。针对风驱动优化算法易陷入局部最优值的问题,实现了5种带有不同变异策略的风驱动优化算法,这些变异策略分别是小波变异策略、混沌变异策略、非均匀变异策略、高斯变异策略以及柯西变异策略。应用不同变异策略的风驱动优化算法对不同维度的经典测试函数进行了仿真实验,并与粒子群优化算法进行了比较。实验结果表明,小波变异风驱动优化算法具有较强的开发能力,可有效跳出局部最优,其寻优速率、收敛精度及算法稳定性均优于粒子群优化算法、风驱动优化算法和其他改进算法。     

Car assembly line fault diagnosis based on triangular fuzzy support vector classifier machine and particle swarm optimization

This paper presents a new version of fuzzy support vector classifier machine to diagnose the nonlinear fuzzy fault system with multi-dimensional input variables. Since there exist problems of finite samples and uncertain data in complex fuzzy fault system modeling, the input and output variables are described as fuzzy numbers. Then by integrating the fuzzy theory and v-support vector classifier machine, the triangular fuzzy v-support vector regression machine (TF v-SVCM) is proposed. To seek the optimal parameters of TF v-SVCM, particle swarm optimization (PSO) is also applied to optimize parameters of TF v-SVCM. A diagnosing method based on TF v-SVCM and PSO are put forward. The results of the application in fault system diagnosis confirm the feasibility and the validity of the diagnosing method. The results of application in fault diagnosis of car assembly line show the hybrid diagnosis model based on TF v-SVCM and PSO is feasible and effective, and the comparison between the method proposed in this paper and other ones is also given, which proves this method is better than standard v-SVCM.     

基于动态概率变异的Cauchy粒子群优化

介绍了标准粒子群优化（SPSO）算法,在两种粒子群改进算法Gaussian Swarm和Fuzzy PSO的基础上提出了Cauchy粒子群优化（CPSO）算法,并将遗传算法中的变异操作引入粒子群优化,形成了动态概率变异Cauchy粒子群优化（DMCPSO）算法。用3个基准函数进行实验,结果表明,DMCPSO算法性能优于SPSO和CPSO算法。     

基于加权变异免疫算法的微钙化点特征选择

给出了一种乳腺X线照片微钙化点的特征选择方法,该方法运用基于加权变异算子的免疫算法进行特征优选。加权变异算子能够动态调整抗体各部位的变异率,在高亲和力抗体的邻近小范围搜索,在低亲和力抗体的周围跳跃式搜索;为了与支持向量机的分类准则保持一致性,该免疫算法在特征空间中通过核函数计算亲和力。实验使用该方法对微钙化点的20种常用特征进行选择,其结果与经验特征集基本相符但更精简,提高了计算效率,是一种可行的特征选择方法。     

Model selection for least squares support vector regressions based on small-world strategy

Model selection plays a key role in the application of support vector machine (SVM). In this paper, a method of model selection based on the small-world strategy is proposed for least squares support vector regression (LS-SVR). In this method, the model selection is treated as a single-objective global optimization problem in which generalization performance measure performs as fitness function. To get better optimization performance, the main idea of depending more heavily on dense local connections in small-world phenomenon is considered, and a new small-world optimization algorithm based on tabu search, called the tabu-based small-world optimization (TSWO), is proposed by employing tabu search to construct local search operator. Therefore, the hyper-parameters with best generalization performance can be chosen as the global optimum based on the powerful search ability of TSWO. Experiments on six complex multimodal functions are conducted, demonstrating that TSWO performs better in avoiding premature of the population in comparison with the genetic algorithm (GA) and particle swarm optimization (PSO). Moreover, the effectiveness of leave-one-out bound of LS-SVM on regression problems is tested on noisy sinc function and benchmark data sets, and the numerical results show that the model selection using TSWO can almost obtain smaller generalization errors than using GA and PSO with three generalization performance measures adopted.     

基于混沌策略状态转移算法的混沌系统参数辨识*

针对混沌系统的参数辨识是一个多维参数的优化问题,提出了基于混沌策略状态转移算法的混沌系统参数辨识方法。该方法是在初始化时以混沌序列初始化种群,在搜索过程中引入混沌变异机制,利用遍历性对状态进行变异操作,避免了过早收敛,提高了全局搜索能力。利用该算法辨识Lorenz混沌系统参数,并与基本状态转移算法和粒子群算法进行比较。仿真结果表明,在有无噪声干扰的情况下,该算法比粒子群算法和基本状态转移算法具有更好的辨识精度且比粒子群算法具有更好的收敛速度,证明了该算法的有效性和抗干扰性,对混沌理论的发展有重要的意义。     

Multidimensional mutations in evolutionary algorithms based on real-valued representation

This work is focused on the fact that the most probable distance of mutated points in multi-dimensional Gaussian and Cauchy mutations is not in a close neighborhood of the origin, but at a certain distance from it. In the case of the Gaussian mutation, this distance is proportional to the norm of the standard deviation vector and increases with the landscape dimension. This may cause a decrease in the sensitivity of the evolutionary algorithm to narrow peaks when the landscape dimension increases, but, simultaneously, it strengthens the exploration property of the algorithm. Moreover, the influence of the reference frame orientation on the effectiveness of the non-spherical multi-dimensional Cauchy mutation is analyzed using simulation experiments. Four multi-dimensional mutations (Gaussian, modified Gaussian, non-spherical and spherical Cauchy mutations) are applied to two classes of evolutionary algorithms based on real-valued representation, i.e. Galar's evolutionary search with soft selection and evolutionary programming. A comparative analysis is provided for convergence to the local optimum, sensitivity to narrow peaks, saddle crossing and symmetry problems.     

结合梯度法的混合微粒群优化算法

在微粒群优化算法PSO中引入梯度算法,提出了一种新型的混合微粒群优化算法——GPSO。该混合优化算法是对PSO每一次进化后的所有微粒进一步执行梯度法寻优操作,并以寻找到的更优个体替代当前个体参与群体的下一代进化。GPSO既利用了PSO出色的全局搜索能力,又借助梯度法的快速局部寻优能力,很好地将两者的优势结合在一起。数值实验表明：无论是对于低维的多峰函数,还是高维的多峰和单峰病态函数,GPSO都表现出很强的优化效率、适用性和鲁棒性。     

一种多尺度协同变异的粒子群优化算法

为了改善粒子群算法易早熟收敛、精度低等缺点,提出一种多尺度协同变异的粒子群优化算法,并证明了该算法以概率1收敛到全局最优解.算法采用多尺度高斯变异机制实现局部解逃逸.在算法初期阶段,利用大尺度变异及均匀变异算子实现全局最优解空间的快速定位;随着适应值的提升,变异尺度随之降低;最终在算法后期阶段,利用小尺度变异算子完成局部精确解空间的搜索.将算法应用6个典型复杂函数优化问题,并同其他带变异操作的PSO算法比较,结果表明,该算法在收敛速度及稳定性上有显著提高.     

Quadratic interpolation based orthogonal learning particle swarm optimization algorithm

Particle swarm optimization (PSO) is a population based algorithm for solving global optimization problems. Owing to its efficiency and simplicity, PSO has attracted many researchers’ attention and developed many variants. Orthogonal learning particle swarm optimization (OLPSO) is proposed as a new variant of PSO that relies on a new learning strategy called orthogonal learning strategy. The OLPSO differs in the utilization of the information of experience from the standard PSO, in which each particle utilizes its historical best experience and globally best experience through linear summation. In OLPSO, particles can fly in better directions by constructing an efficient exemplar through orthogonal experimental design. However, the global version based orthogonal learning PSO (OLPSO-G) still have some drawbacks in solving some complex multimodal function optimization. In this paper, we proposed a quadratic interpolation based OLPSO-G (QIOLPSO-G), in which, a quadratic interpolation based construction strategy for the personal historical best experience is applied. Meanwhile, opposition-based learning, and Gaussian mutation are also introduced into this paper to increase the diversity of the population and discourage the premature convergence. Experiments are conducted on 16 benchmark problems to validate the effectiveness of the QIOLPSO-G, and comparisons are made with four typical PSO algorithms. The results show that the introduction of the three strategies does enhance the effectiveness of the algorithm.     

具有组合变异策略的回溯搜索优化算法

针对回溯搜索优化算法收敛速度慢和易陷入局部最优的缺陷,提出了一种基于组合变异策略的改进回溯搜索优化算法。为了提高历史种群的多样性并扩大算法的搜索空间,在算法迭代过程中采用柯西种群生成策略,利用柯西分布尺度系数生成历史种群;引入基于混沌映射和伽玛分布的组合变异策略,在一定概率下对较差个体进行变异生成质量较好的个体;对新种群中越界个体采用越界处理策略,确保算法在预定的搜索空间内搜索。选取了11个标准测试函数,在低维和高维状态下进行数值仿真,并与3种表现良好的算法进行比较,结果表明该改进算法在收敛速度和收敛精度上有很大优势。     

基于柯西-高斯动态消减变异的果蝇优化算法研究

针对果蝇优化算法易陷入局部极值收敛速度减慢的不足,结合柯西变异和高斯变异的各自优点,提出了变异效能系数和柯西-高斯动态消减变异因子等概念,进而提出了一种柯西-高斯动态消减变异方法,将该方法应用于改进果蝇优化算法,提出了一种基于柯西-高斯动态消减变异的果蝇优化算法。该算法兼顾了全局探索和局部开发两个特性,丰富了种群的多样性,有效地消除了易陷入局部极值的弊端,提高了算法的收敛速度。仿真实验采用经典函数用例和实际工程用例进行验证,结果表明该算法的求解速度和精度更高,稳定性更好。