| 一种基于L1范数正则化的回声状态网络 |
| |
| 引用本文： | 韩敏,任伟杰,许美玲.一种基于L1范数正则化的回声状态网络[J].自动化学报,2014,40(11):2428-2435. |
| |
| 作者姓名： | 韩敏 任伟杰 许美玲 |
| |
| 作者单位： | 1.大连理工大学电子信息与电气工程学部 大连 116024 |
| |
| 基金项目： | 国家重点基础研究发展计划(973计划)，国家自然科学基金(61374154)资助@@@@Supported by National Basic Research Program of China (973 Program)，National Natural Science Foun-dation of China |
| |
| 摘 要： | 针对回声状态网络存在的病态解以及模型规模控制问题,本文提出一种基于L1范数正则化的改进回声状态网络.该方法通过在目标函数中添加L1范数惩罚项,提高模型求解的数值稳定性,同时借助于L1范数正则化的特征选择能力,控制网络的复杂程度,防止出现过拟合.对于L1范数正则化的求解,采用最小角回归算法计算正则化路径,通过贝叶斯信息准则进行模型选择,避免估计正则化参数.将模型应用于人造数据和实际数据的时间序列预测中,仿真结果证明了本文方法的有效性和实用性.
|
| 关 键 词： | 回声状态网络 正则化 最小角回归 信息准则 多元时间序列 |
| 收稿时间： | 2013-11-06 |
An Improved Echo State Network via L 1-Norm Regularization |
| |
| HAN Min,REN Wei-Jie,XU Mei-Ling.An Improved Echo State Network via L 1-Norm Regularization[J].Acta Automatica Sinica,2014,40(11):2428-2435. |
| |
| Authors: | HAN Min REN Wei-Jie XU Mei-Ling |
| |
| Affiliation: | 1.Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian 116024 |
| |
| Abstract: | Considering the ill-posed problem and the model scale control of echo state network, an improved echo state network based on L1-norm regularization is proposed. In order to improve the numerical stability, the proposed method adds an L1-norm penalty term in the objective function. Meanwhile, the method can also control the complexity of the network and prevent overfitting by using feature selection capability of L1-norm regularization. To solve the L1-norm regularization model, we adopt the least angle regression algorithm to calculate regularization path and select suitable model through Bayesian information criterion, which can avoid the estimations of regularization parameter. The model is applied to the time series predictions of both synthetic dataset and practical dataset. The simulation results show the effectiveness and practicality of the proposed method. |
| |
| Keywords: | Echo state network (ESN) regularization least angle regression (LARS) information criterion multivariate time series |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
| 点击此处可从《自动化学报》浏览原始摘要信息 |
|
点击此处可从《自动化学报》下载全文 |
