| 基于信赖域Newton 算法的ELM网络 |
| |
| 引用本文： | 韩敏,王新迎.基于信赖域Newton 算法的ELM网络[J].控制与决策,2011,26(5):757-760. |
| |
| 作者姓名： | 韩敏 王新迎 |
| |
| 作者单位： | 大连理工大学电子信息与电气工程学部,辽宁大连,116024 |
| |
| 基金项目： | 国家自然科学基金，国家科技支撑计划项目，国家973计划项目 |
| |
| 摘 要： | 针对极端学习机(ELM)网络伪逆输出权值计算方法的运算复杂度制约其训练速度问题,提出一种基于信赖域Newton算法的新型ELM网络(TRON-ELM),并采用信赖域Newton算法求解ELM网络的输出权值.该算法首先构造一个ELM网络代价函数的Newton方程,并将其作为一个无约束优化问题,采用共轭梯度法求解,避免了求代价函数Hessian矩阵逆的运算,提高了训练速度,信赖域条件的存在保证了算法的整体收敛性.仿真实验结果验证了所提出方法的有效性.
|
| 关 键 词： | 极端学习机 信赖域Newton法 共轭梯度法 回归 |
| 收稿时间： | 2010/2/23 0:00:00 |
| 修稿时间： | 2010/4/6 0:00:00 |
ELM based on trust region Newton method |
| |
| HAN Min,WANG Xin-ying.ELM based on trust region Newton method[J].Control and Decision,2011,26(5):757-760. |
| |
| Authors: | HAN Min WANG Xin-ying |
| |
| Affiliation: | (Faculty of Electronic Information and Electrical Engineering,Dalian University of Technology,Dalian 116024,China.) |
| |
| Abstract: | Considering the problems that the complexity of generalized inverse limits the learning speed of extreme machine
learning(ELM), a novel ELM, called TRON-ELM, is proposed based on the trust region Newton method in which the trust
region Newton method is used to derive the output weights. The proposed method takes the Newton equation of the cost
funcion of ELM as an unconstrained optimization, and a conjugate gradient method is used to solve the equation, which
avoids solving the inverse of the Hessian matrix, thus the operation speed is improved. Meanwhile, the existence of trust
region guarantees the global convergence. The experimental results show the effectiveness of the proposed method. |
| |
| Keywords: | |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
| 点击此处可从《控制与决策》浏览原始摘要信息 |
|
点击此处可从《控制与决策》下载全文 |
|
