粒子群优化神经网络在动态手势识别中的应用

为了提高动态手势学习训练速度和识别准确率,本文提出一种基于粒子群优化BP神经网络的动态手势识别方法。首先基于自然人机交互需要,定义一套基于机器视觉的动态手势模型;在获取指尖运动轨迹的基础上,提取动态手势的特征向量作为神经网络的输入;利用改进的PSO算法训练BP神经网络,得到神经网络的权值和阈值;最后利用训练过的神经网络识别基于机器视觉的动态手势。测试结果表明:改进的PSO算法能够提高神经网络训练速度和精度,进而提高动态手势识别准确率。     

混合粒子群优化算法优化前向神经网络结构和参数

提出了综合利用粒子群优化算法（PSO）和离散粒子群优化算法（D-PSO）同时优化前向神经网络结构和参数的新方法。该算法使用离散粒子群优化算法优化神经网络连接结构,用多维空间中0或1取值的粒子来描述所有可能的神经网络连接,同时使用粒子群优化算法优化神经网络权值。将经过该算法训练的神经网络应用于故障诊断,能够有效消除冗余连接结构对网络诊断能力的影响。仿真试验的结果表明,相比遗传算法等其他算法,该算法能够有效改善神经网络结构和参数的优化效率,提高故障模式识别的准确率。     

Forecasting of Software Reliability Using Neighborhood Fuzzy Particle Swarm Optimization Based Novel Neural Network

This paper proposes an artificial neural network (ANN) based software reliability model trained by novel particle swarm optimization (PSO) algorithm for enhanced forecasting of the reliability of software. The proposed ANN is developed considering the fault generation phenomenon during software testing with the fault complexity of different levels. We demonstrate the proposed model considering three types of faults residing in the software. We propose a neighborhood based fuzzy PSO algorithm for competent learning of the proposed ANN using software failure data. Fitting and prediction performances of the neighborhood fuzzy PSO based proposed neural network model are compared with the standard PSO based proposed neural network model and existing ANN based software reliability models in the literature through three real software failure data sets. We also compare the performance of the proposed PSO algorithm with the standard PSO algorithm through learning of the proposed ANN. Statistical analysis shows that the neighborhood fuzzy PSO based proposed neural network model has comparatively better fitting and predictive ability than the standard PSO based proposed neural network model and other ANN based software reliability models. Faster release of software is achievable by applying the proposed PSO based neural network model during the testing period.      

基于Spark框架和PSO优化算法的电力通信网络安全态势预测

随着电力通信网络规模的不断扩大,电力通信网络不间断地产生海量通信数据。同时,对通信网络的攻击手段也在不断进化,给电力通信网络的安全造成极大威胁。针对以上问题,结合Spark大数据计算框架和PSO优化神经网络算法的优点,提出基于Spark内存计算框架的并行PSO优化神经网络算法对电力通信网络的安全态势进行预测。本研究首先引入Spark计算框架,Spark框架具有内存计算以及准实时处理的特点,符合电力通信大数据处理的要求。然后提出PSO优化算法对神经网络的权值进行修正,以增加神经网络的学习效率和准确性。之后结合RDD的并行特点,提出了一种并行PSO优化神经网络算法。最后通过实验比较可以看出,基于Spark框架的PSO优化神经网络算法的准确度高,且相较于传统基于Hadoop的预测方法在处理速度上有显著提高。     

A hybrid algorithm for artificial neural network training

Artificial neural network (ANN) training is one of the major challenges in using a prediction model based on ANN. Gradient based algorithms are the most frequent training algorithms with several drawbacks. The aim of this paper is to present a method for training ANN. The ability of metaheuristics and greedy gradient based algorithms are combined to obtain a hybrid improved opposition based particle swarm optimization and a back propagation algorithm with the momentum term. Opposition based learning and random perturbation help population diversification during the iteration. Use of time-varying parameter improves the search ability of standard PSO, and constriction factor guarantees particles convergence. Since several contingent local minima conditions may happen in the weight space, a new cross validation method is proposed to prevent overfitting. Effectiveness and efficiency of the proposed method are compared with several other famous ANN training algorithms on the various benchmark problems.     

基于改进粒子群算法的整流电路智能故障诊断

针对基本粒子群算法(PSO)收敛精度低、易陷入局部极小值的缺点。对该算法进行改进,采用自适应调整惯性权重的策略,并且引入扰动因子,平衡集中强化搜索和分散多样化的搜索过程;用改进的PSO算法优化BP神经网络的权值和阈值,并应用于整流电路的故障诊断;仿真研究结果表明,该方法与其它方法相比,收敛速度快,诊断精度高,在整流电路故障诊断中具有良好的故障识别率,便于电路故障自动诊断系统的建立。     

基于PSO算法的动态模块化神经网络结构设计

针对模块化神经网络结构设计过程中子网络输出不能最优集成的问题,提出一种基于粒子群算法的动态模块化神经网络.首先,该网络采用数据密度辨识样本分布空间,并更新数据中心;然后,根据输入数据激活相应的子网络,利用PSO算法寻找子网络的最优网络贡献度,并依据贡献度计算子网络的输出权值;最后优化模块化神经网络的集成输出.通过对非线性函数和时变系统的逼近实验,验证了集成网络中子网络数目可以根据任务动态调整,网络输出的集成权值能够通过PSO算法寻找到最优值,并且训练精度和自适应能力较其他算法均有一定的提高.     

基于粒子群算法和神经网络的人脸识别分类器研究

针对BP神经网络作为人脸识别分类器具有的收敛速度慢、易陷入局部极小等缺点,提出利用改进的粒子群优化算法(PSO)改善BP网络训练的方法,建立种基于改进的PSO-BP神经网络,更合理有效地确定神经网络的连接权值和阈值,将其应用到人脸识别系统中的分类环节中,并与单独使用BP神经网络分类的结果相比较,实验表明,该方法识别速度...     

Optimization of self-organizing polynomial neural networks

The main disadvantage of self-organizing polynomial neural networks (SOPNN) automatically structured and trained by the group method of data handling (GMDH) algorithm is a partial optimization of model weights as the GMDH algorithm optimizes only the weights of the topmost (output) node. In order to estimate to what extent the approximation accuracy of the obtained model can be improved the particle swarm optimization (PSO) has been used for the optimization of weights of all node-polynomials. Since the PSO is generally computationally expensive and time consuming a more efficient Levenberg–Marquardt (LM) algorithm is adapted for the optimization of the SOPNN. After it has been optimized by the LM algorithm the SOPNN outperformed the corresponding models based on artificial neural networks (ANN) and support vector method (SVM). The research is based on the meta-modeling of the thermodynamic effects in fluid flow measurements with time-constraints. The outstanding characteristics of the optimized SOPNN models are also demonstrated in learning the recurrence relations of multiple superimposed oscillations (MSO).     

油井作业中传感器误差补偿方法的研究

为了提高油井作业中压力传感器的测量精度,提出了一种基于粒子群优化BP神经网络的误差补偿方法.利用粒子群算法的全局寻优和收敛速度快的特点,训练网络的权值,能有效地改善BP神经网络传统算法的收敛速度和学习能力.结果表明:这种方法大大提高了压力传感器在油井作业中的测量精度和稳定性,也提高了油田作业的工作效率.     

Modeling of a proton exchange membrane fuel cell based on the hybrid particle swarm optimization with Levenberg–Marquardt neural network

This paper presents a nonlinear modeling approach of a proton exchange membrane fuel cell (PEMFC) based on the hybrid particle swarm optimization with Levenberg–Marquardt algorithm neural network (PSO-LM NN). The PSO algorithm converges rapidly during the initial stages of a global search, while it becomes extremely slow around the global optimum. On the contrary, the LM algorithm can achieve faster convergent speed around the global optimum, while it is prone to being trapped in the local minimum. Therefore the hybrid algorithm with a transition from PSO search to LM training is proposed to train the weights and thresholds of neural network, which aims to exploit the advantage of the both algorithms. An accurate mathematical model is an extremely useful tool for the fuel cell design, and neural network is an excellent optional tool for complex nonlinear dynamic system modeling such as PEMFC. In the paper, firstly a highly reduced PEMFC dynamic physical model is established to generate the data for the PSO-LM NN model training and validation, and then the neural network nonlinear autoregressive model based on the PSO-LM algorithm is applied in modeling PEMFC voltage and temperature model, and finally the validation test result demonstrates that the trained PSO-LM NN model can efficiently approach the dynamic behavior of a PEMFC.     

一种改进PSO优化RBF神经网络的新方法

为了克服神经网络模型结构和参数难以设置的缺点,提出了一种改进粒子群优化的径向基函数(RBF)神经网络的新方法.首先将最近邻聚类用于RBF神经网络隐层中心向量的确定,同时对引入适应度值择优选取的原则对基本粒子群算法进行改进,采用改进粒子群(IMPSO)算法对最近邻聚类的聚类半径进行优化,合理的确定了RBF神经网络的隐层结构.将改进PSO优化的RBF神经网络应用于非线性函数逼近和混沌时间序列预测,经实验仿真验证.与基本粒子群(PSO)算法,收缩因子粒子群(CFA PSO)算法优化的RBF神经网络相比较,其在识别精度和收敛速度上都有了显著的提高.     

基于遗传算法的前向神经网络结构优化

对近几年应用遗传算法（Genetic Algorithm,GA）优化设计前向神经网络结构的研究进行了评述。指出了神经网络结构优化设计的重要性和目前各种方法存在的不足。介绍了神经网络结构设计原理和应用GA优化设计神经网络应着重考虑的两个问题：即结构表达策略和适应度函数设计。分别对近来应用GA优化设计多层感知器、径向基函数神经网络和径向基概率神经网络结构的研究进行了细致介绍和分析。指出了目前研究工作的不足和未来研究工作的发展方向。     

粒子群算法优化BP神经网络的粉尘浓度预测

对综采工作面粉尘浓度预测的方法是建立BP神经网络预测模型.为了提高算法的拟合能力及预测的准确度,使用粒子群算法对目标函数进行改进,即将粒子群算法寻到的最优权值和阈值应用于神经网络预测模型求综采工作面粉尘浓度.比较分析新的预测模型与常用的灰色模型以及标准的BP神经网络算法,结果表明粒子群优化的神经网络算法的拟合能力和预测的准确率显著提高.     

A PSO-based weighting method for linear combination of neural networks

This paper presents a new way of computing the weights for combining multiple neural network classifiers based on particle swarm optimization, PSO. The weights are obtained so that they minimize the total classification error rate of the ensemble system. In order to evaluate the effectiveness of the proposed method, we have carried out some experiments on three data sets: 2-D normal, Satimage and Phoneme. Experimental results show that the PSO-based weighting method outperforms the MSE and simple averaging methods, especially for diverse networks.     

一种基于混沌遗传与粒子群混合优化的过程神经网络训练算法

针对时变输入/输出过程神经网络的训练问题,提出一种基于混沌遗传与带有动态惯性因子的粒子群优化相结合的学习方法。综合利用粒子群算法的经验记忆、信息共享和混沌遗传算法的混沌轨道遍历搜索性质,基于PNN训练目标函数,构建两种算法相混合的进化寻优机制,通过适应度评估和优化效率分析自适应调节混沌遗传与粒子群算法的切换,实现网络参数在可行解空间的全局优化求解。实验结果表明,该算法较大提高了PNN的训练效率。     

Controller design for synchronization of an array of delayed neural networks using a controllable probabilistic PSO

In this paper, a controllable probabilistic particle swarm optimization (CPPSO) algorithm is introduced based on Bernoulli stochastic variables and a competitive penalized method. The CPPSO algorithm is proposed to solve optimization problems and is then applied to design the memoryless feedback controller, which is used in the synchronization of an array of delayed neural networks (DNNs). The learning strategies occur in a random way governed by Bernoulli stochastic variables. The expectations of Bernoulli stochastic variables are automatically updated by the search environment. The proposed method not only keeps the diversity of the swarm, but also maintains the rapid convergence of the CPPSO algorithm according to the competitive penalized mechanism. In addition, the convergence rate is improved because the inertia weight of each particle is automatically computed according to the feedback of fitness value. The efficiency of the proposed CPPSO algorithm is demonstrated by comparing it with some well-known PSO algorithms on benchmark test functions with and without rotations. In the end, the proposed CPPSO algorithm is used to design the controller for the synchronization of an array of continuous-time delayed neural networks.     

Evolutionary multi-objective optimization of artificial neural network for classification of autism spectrum disorder screening

Evolutionary computing algorithms are computational intelligent systems that are used in a wide range of research applications, primarily for optimization. In this paper, an artificial neural network (ANN), a machine learning technique, is used to classify the data. The weights associated with each neuron and the architecture of the neural network always bias the output of the network model. With prior knowledge or trial and error techniques, different metrics or objectives can be used to optimise these weights. The optimization of weights using multiple objectives refers to a "multi-objective optimization problem." In this paper, an evolutionary cultural algorithm is used to optimise weights in ANN, and the results are reported with improved accuracy. Three benchmark datasets for autism screening data are used, trained, and tested for model accuracy in the classification: toddlers (1054,19), children (292,21), and adults (704,21).With the support of the domain expert, real-time data were collected from parents and caregivers and totalled over 1000 records, with a moderate difference in attributes based on CARS-2 (Childhood Autism Rating Scale, 2nd Edition) for ASD screening. In this paper, the proposed model is compared using a curve-fitting mathematical technique. The proposed model is trained and tested, and the results showed that it outperformed other algorithms in terms of precision, accuracy, sensitivity, and specificity.

     

基于差分进化的BP神经网络预测混沌时间序列

针对BP神经网络预测模型收敛速度慢和容易陷入局部极小值的缺点,将差分进化算法和神经网络结合起来,提出了一种基于差分进化算法的BP神经网络预测混沌时间序列的方法,利用差分进化算法的全局寻优能力对BP神经网络的权值和阈值进行优化,然后训练BP神经网络预测模型求得最优解,将该预测方法用到3个典型的混沌时间序列进行算法的有效性验证,并与BP算法的预测精度进行了比较,仿真结果表明该方法对混沌时间序列预测具有更好的非线性拟合能力和更高的预测准确性。     

Prediction of seismic slope stability through combination of particle swarm optimization and neural network

One of the main concerns in geotechnical engineering is slope stability prediction during the earthquake. In this study, two intelligent systems namely artificial neural network (ANN) and particle swarm optimization (PSO)–ANN models were developed to predict factor of safety (FOS) of homogeneous slopes. Geostudio program based on limit equilibrium method was utilized to obtain 699 FOS values with different conditions. The most influential factors on FOS such as slope height, gradient, cohesion, friction angle and peak ground acceleration were considered as model inputs in the present study. A series of sensitivity analyses were performed in modeling procedures of both intelligent systems. All 699 datasets were randomly selected to 5 different datasets based on training and testing. Considering some model performance indices, i.e., root mean square error, coefficient of determination (R ²) and value account for (VAF) and using simple ranking method, the best ANN and PSO–ANN models were selected. It was found that the PSO–ANN technique can predict FOS with higher performance capacities compared to ANN. R ² values of testing datasets equal to 0.915 and 0.986 for ANN and PSO–ANN techniques, respectively, suggest the superiority of the PSO–ANN technique.