混合粒子群优化算法优化前向神经网络结构和参数

提出了综合利用粒子群优化算法（PSO）和离散粒子群优化算法（D-PSO）同时优化前向神经网络结构和参数的新方法。该算法使用离散粒子群优化算法优化神经网络连接结构,用多维空间中0或1取值的粒子来描述所有可能的神经网络连接,同时使用粒子群优化算法优化神经网络权值。将经过该算法训练的神经网络应用于故障诊断,能够有效消除冗余连接结构对网络诊断能力的影响。仿真试验的结果表明,相比遗传算法等其他算法,该算法能够有效改善神经网络结构和参数的优化效率,提高故障模式识别的准确率。     

Meta-modeling using generalized regression neural network and particle swarm optimization

Swarm intelligence (SI) and evolutionary computation (EC) algorithms are often used to solve various optimization problems. SI and EC algorithms generally require a large number of fitness function evaluations (i.e., higher computational requirements) to obtain quality solutions. This requirement becomes more challenging when optimization problems are associated with computationally expensive analyses and/or simulation tasks. To tackle this issue, meta-modeling has shown successful results in improving computational efficiency by approximating the fitness or constraint functions of these complex optimization problems. Meta-modeling approaches typically use polynomial regression, kriging, radial basis function network, and support vector machines. Less attention has been given to the generalized regression neural network approach, and yet, it offers several advantages. Specifically, the model construction process does not require iterations. Its only one parameter is known to be less sensitive and usually requires less effort in selecting an optimal parameter. We use generalized regression neural network in this paper to construct meta-models and to approximate the fitness function in particle swarm optimization. To assess the performance and quality of these solutions, the proposed meta-modeling approach is tested on ten benchmark functions. The results are promising in terms of the solution quality and computational efficiency, especially when compared against the results of particle swarm optimization without meta-modeling and several other meta-modeling methods in previously published literature.     

A hybrid particle swarm optimization and its application in neural networks

In this paper, a novel particle swarm optimization model for radial basis function neural networks (RBFNN) using hybrid algorithms to solve classification problems is proposed. In the model, linearly decreased inertia weight of each particle (ALPSO) can be automatically calculated according to fitness value. The proposed ALPSO algorithm was compared with various well-known PSO algorithms on benchmark test functions with and without rotation. Besides, a modified fisher ratio class separability measure (MFRCSM) was used to select the initial hidden centers of radial basis function neural networks, and then orthogonal least square algorithm (OLSA) combined with the proposed ALPSO was employed to further optimize the structure of the RBFNN including the weights and controlling parameters. The proposed optimization model integrating MFRCSM, OLSA and ALPSO (MOA-RBFNN) is validated by testing various benchmark classification problems. The experimental results show that the proposed optimization method outperforms the conventional methods and approaches proposed in recent literature.     

改进的粒子群算法对RBF神经网络的优化

为了改进神经网络模型结构和参数的设置方法,提出了一种改进的粒子群优化径向基函数（RBF）神经网络的方法。该方法通过动态调整粒子群算法中的惯性权重因子,提高了算法的收敛速度和搜索全局最优值的能力。实验结果表明：基于改进的PSO算法训练的神经网络在函数逼近性能上优于自组织选取中心算法与标准PSO算法,提高了网络泛化能力和优化效果,有效地增强了网络对非线性问题的处理能力。     

Binary optimization using hybrid particle swarm optimization and gravitational search algorithm

The PSOGSA is a novel hybrid optimization algorithm, combining strengths of both particle swarm optimization (PSO) and gravitational search algorithm (GSA). It has been proven that this algorithm outperforms both PSO and GSA in terms of improved exploration and exploitation. The original version of this algorithm is well suited for problems with continuous search space. Some problems, however, have binary parameters. This paper proposes a binary version of hybrid PSOGSA called BPSOGSA to solve these kinds of optimization problems. The paper also considers integration of adaptive values to further balance exploration and exploitation of BPSOGSA. In order to evaluate the efficiencies of the proposed binary algorithm, 22 benchmark functions are employed and divided into three groups: unimodal, multimodal, and composite. The experimental results confirm better performance of BPSOGSA compared with binary gravitational search algorithm (BGSA), binary particle swarm optimization (BPSO), and genetic algorithm in terms of avoiding local minima and convergence rate.     

一种新的混合粒子群方法

利用混沌搜索和变异机制克服种群易停滞且易陷入局部最优点的不足。当种群出现停滞时先用混沌搜索更优点,当搜索到的点不满足变异精度要求时再进行变异。发现混沌搜索能使种群在出现停滞时持续寻优,而变异机制则能够有效地帮助种群在陷入局部最优点时跳出该点。结果表明该方法的全局寻优能力较强。     

一种新的混合粒子群优化算法

针对标准粒子群算法在优化过程中受初始值影响较大且容易陷入局部极值的缺陷,将鱼群算法中聚群行为的基本思想引入粒子群算法中,据此建立了粒子中心的基本概念,并利用粒子的聚群特性调整粒子的飞行方向与目标位置,从而提出了一种新的混合粒子群算法,旨在改进原粒子群算法的全局收敛能力。为了检验混合粒子群算法的优化特性,采用三种典型的标准函数对五种现行智能算法进行了多方面的测试和比较。实验结果表明,新算法具有良好的搜索精度与速度,有效弥补了标准粒子群算法局部收敛和鱼群算法精度不高的双重缺陷,适用于解决复杂函数优化问题。     

基于量子行为的微粒群优化算法的数据聚类

在PSO聚类算法的基础上,提出了基于量子行为的微粒群优化算法(QPSO)的数据聚类.QPSO算法不仅参数个数少、随机性强,并且能覆盖所有解空间,保证算法的全局收敛.PSO与QPSO算法的不同在于聚类中心的进化上,实验中用到四个数据集比较的结果,证明了QPSO优于PSO聚类方法.在聚类过程中使用了一种新的度量代替Euclidean标准,实验证明了新的度量方法比Euclidean标准更具有健壮性,聚类的结果更精确.     

基于AQPSO的数据聚类

提出了一种新的聚类算法——适应性的基于量子行为的微粒群优化算法的数据聚类(AQPSO)。AQPSO在全局搜索能力和局部搜索能力上优于PSO和QPSO算法,它的适应性方法比较接近于高水平智能群体的社会有机体的学习过程,并且能保证种群不断地进化。聚类过程都是根据数据向量之间的Euclidean(欧几里得的)距离。PSO和QPSO的不同在于聚类中心的进化上。QPSO和AQPSO的不同在于参数的选择上。实验中用到4个数据集比较聚类的效果,结果证明了AQPSO聚类方法优于PSO和QPSO聚类方法。     

Gene selection using hybrid particle swarm optimization and genetic algorithm

Selecting high discriminative genes from gene expression data has become an important research. Not only can this improve the performance of cancer classification, but it can also cut down the cost of medical diagnoses when a large number of noisy, redundant genes are filtered. In this paper, a hybrid Particle Swarm Optimization (PSO) and Genetic Algorithm (GA) method is used for gene selection, and Support Vector Machine (SVM) is adopted as the classifier. The proposed approach is tested on three benchmark gene expression datasets: Leukemia, Colon and breast cancer data. Experimental results show that the proposed method can reduce the dimensionality of the dataset, and confirm the most informative gene subset and improve classification accuracy.     

Audio-visual emotion recognition using FCBF feature selection method and particle swarm optimization for fuzzy ARTMAP neural networks

Multimedia Tools and Applications - Humans use many modalities such as face, speech and body gesture to express their feeling. So, to make emotional computers and make the human-computer...     

Cooperative learning for radial basis function networks using particle swarm optimization

This paper presents a new evolutionary cooperative learning scheme, able to solve function approximation and classification problems with improved accuracy and generalization capabilities. The proposed method optimizes the construction of radial basis function (RBF) networks, based on a cooperative particle swarm optimization (CPSO) framework. It allows for using variable-width basis functions, which increase the flexibility of the produced models, while performing full network optimization by concurrently determining the rest of the RBF parameters, namely center locations, synaptic weights and network size. To avoid the excessive number of design variables, which hinders the optimization task, a compact representation scheme is introduced, using two distinct swarms. The first swarm applies the non-symmetric fuzzy means algorithm to calculate the network structure and RBF kernel center coordinates, while the second encodes the basis function widths by introducing a modified neighbor coverage heuristic. The two swarms work together in a cooperative way, by exchanging information towards discovering improved RBF network configurations, whereas a suitably tailored reset operation is incorporated to help avoid stagnation. The superiority of the proposed scheme is illustrated through implementation in a wide range of benchmark problems, and comparison with alternative approaches.     

基于文化量子粒子群的模糊神经网络参数优化

模糊神经网络参数学习是一个函数优化问题。针对已有优化方法收敛精度不高的缺点,提出基于文化量子粒子群算法的模糊神经网络参数优化,并将其应用于混沌时间序列预测。仿真实例结果证实了该算法的优越性。     

改进的混合粒子群算法

从研究分析粒子群算法和郭涛算法的特点出发,提出一种综合两算法优点的混合算法。新算法改变了粒子的更新方式,以子空间搜索和串行搜索相结合的多点并行搜索,扩大了算法的搜索范围,减少了粒子对初值的依赖,增强了算法跳出局部最优的能力;通过后代较优个体变异产生子群,提高了算法局部寻优能力;实验证明,该算法正确高效。     

Generalized regression neural networks with multiple-bandwidth sharing and hybrid optimization.

This paper proposes a novel algorithm for function approximation that extends the standard generalized regression neural network. Instead of a single bandwidth for all the kernels, we employ a multiple-bandwidth configuration. However, unlike previous works that use clustering of the training data for the reduction of the number of bandwidths, we propose a distinct scheme that manages a dramatic bandwidth reduction while preserving the required model complexity. In this scheme, the algorithm partitions the training patterns to groups, where all patterns within each group share the same bandwidth. Grouping relies on the analysis of the local nearest neighbor distance information around the patterns and the principal component analysis with fuzzy clustering. Furthermore, we use a hybrid optimization procedure combining a very efficient variant of the particle swarm optimizer and a quasi-Newton method for global optimization and locally optimal fine-tuning of the network bandwidths. Training is based on the minimization of a flexible adaptation of the leave-one-out validation error that enhances the network generalization. We test the proposed algorithm with real and synthetic datasets, and results show that it exhibits competitive regression performance compared to other techniques.     

混沌时间序列的混合粒子群优化预测

提出一种混合粒子群优化算法,即在改进粒子群优化算法全局搜索模型参数的基础上,利用梯度下降法进一步确定径向基神经网络模型参数,以提高网络的收敛精度和网络性能.采用基于RBFNN的混合粒子群优化算法进行离散Henon和连续Mackey-Glass混沌时间序列预测仿真,结果表明该算法能快速精确地预测混沌时间序列,是研究复杂非线性动力系统辨识和控制的一种有效方法.     

Rotation-invariant texture image retrieval using particle swarm optimization and support vector regression

This paper presents a novel rotation-invariant texture image retrieval using particle swarm optimization (PSO) and support vector regression (SVR), which is called the RTIRPS method. It respectively employs log-polar mapping (LPM) combined with fast Fourier transformation (FFT), Gabor filter, and Zernike moment to extract three kinds of rotation-invariant features from gray-level images. Subsequently, the PSO algorithm is utilized to optimize the RTIRPS method. Experimental results demonstrate that the RTIRPS method can achieve satisfying results and outperform the existing well-known rotation-invariant image retrieval methods under considerations here. Also, in order to reduce calculation complexity for image feature matching, the RTIRPS method employs the SVR to construct an efficient scheme for the image retrieval.     

A heuristic method for learning Bayesian networks using discrete particle swarm optimization

Bayesian networks are a powerful approach for representing and reasoning under conditions of uncertainty. Many researchers aim to find good algorithms for learning Bayesian networks from data. And the heuristic search algorithm is one of the most effective algorithms. Because the number of possible structures grows exponentially with the number of variables, learning the model structure from data by considering all possible structures exhaustively is infeasible. PSO (particle swarm optimization), a powerful optimal heuristic search algorithm, has been applied in various fields. Unfortunately, the classical PSO algorithm only operates in continuous and real-valued space, and the problem of Bayesian networks learning is in discrete space. In this paper, two modifications of updating rules for velocity and position are introduced and a Bayesian networks learning based on binary PSO is proposed. Experimental results show that it is more efficient because only fewer generations are needed to obtain optimal Bayesian networks structures. In the comparison, this method outperforms other heuristic methods such as GA (genetic algorithm) and classical binary PSO.     

Synthesis of interdigital capacitors based on particle swarm optimization and artificial neural networks

This article reports on the use of the particle swarm optimization (PSO) algorithm in the synthesis of the planar interdigital capacitor (IDC). The PSO algorithm is used to optimize the geometry parameters of the IDC in order to obtain a certain capacitance value. The capacitance value of the IDC is evaluated using an artificial neural network (ANN) model with the geometry parameters of the IDC as its inputs. Several design examples are presented that illustrate the use of the PSO algorithm, and the design goal in each example is easily achieved. Full‐wave electromagnetic simulations are also performed for some of the studied IDC structures implemented using coplanar waveguide (CPW) technology. The simulation results are in good agreement with those obtained using the ANN/PSO algorithm. © 2006 Wiley Periodicals, Inc. Int J RF and Microwave CAE, 2006.