首页 | 本学科首页   官方微博 | 高级检索  
     

基于PSO算法的神经网络集成构造方法
引用本文:傅强,胡上序,赵胜颖. 基于PSO算法的神经网络集成构造方法[J]. 浙江大学学报(工学版), 2004, 38(12): 1596-1600
作者姓名:傅强  胡上序  赵胜颖
作者单位:[1]浙江大学智能信息工程研究所浙江杭州310027 [2]UTStarcom通信有限公司浙江杭州310027
摘    要:为合理选择组成神经网络集成的个体,使各个体间保持较大的差异度,从而提高集成所建模型的仿真精度,提出一种新的神经网络集成构造方法.独立训练出一批神经网络,采用离散粒子群优化(PSO)算法,用多维空间中0或1取值的粒子描述所有可能的神经网络集成.网络集成预测误差的估计值用组成集成的个体网络之间的相关度表示,并作为优化过程中的适应度函数.优选得到参与构成神经网络集成的部分差异度较大网络个体.对8个典型数据集回归问题的实验结果表明,该方法构造的神经网络集成普遍使用了较少的网络个体,而预测精度均好于Bagging方法等传统方法.

关 键 词:神经网络  集成  粒子群优化(PSO)
文章编号:1008-973X(2004)12-1596-05
修稿时间:2004-03-22

PSO-based approach for neural network ensembles
FU Qiang,HU Shang-xu,ZHAO Sheng-ying. PSO-based approach for neural network ensembles[J]. Journal of Zhejiang University(Engineering Science), 2004, 38(12): 1596-1600
Authors:FU Qiang  HU Shang-xu  ZHAO Sheng-ying
Affiliation:FU Qiang~1,HU Shang-xu~1,ZHAO Sheng-ying~2
Abstract:To improve the prediction accuracy of model represented by artificial neural networks(ANN) ensemble, a new approach for constructing neural network ensemble was proposed. The basic idea of this novel approach was to optimally construct neural network ensemble with the aid of particle swarm optimizations (PSO). After a number of neural networks (NN) were properly trained, all possible NN ensembles were represented by particles in a multi-dimensional space, in which each dimension represented a particular NN, and the value 0 or 1 for each dimension meant whether or not the corresponding NN was to be included in the ensemble. Then discrete PSO algorithm was used to optimally select the ensembles. The results of the selection caused the optimized ensemble to include individual NN members with higher diversity. The prediction error of the model expressed by ensemble was determined by the degree of correlation between NN components, which was also used as the fitness function. Empirical studies on regression upon eight typical data sets show that this approach yields ensemble with significantly smaller size, while achieving much better performance than other traditional ones such as Bagging method.
Keywords:neural network  ensemble  particle swarm optimization (PSO)
本文献已被 CNKI 维普 万方数据 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号