| L1+L2正则化逻辑斯蒂模型分类算法 |
| |
| 引用本文： | 刘建伟,付捷,罗雄麟.L1+L2正则化逻辑斯蒂模型分类算法[J].计算机工程,2012,38(13):148-151. |
| |
| 作者姓名： | 刘建伟 付捷 罗雄麟 |
| |
| 作者单位： | 中国石油大学(北京)自动化研究所,北京,102249 |
| |
| 基金项目： | 中国石油大学(北京)基础学科研究基金资助项目 |
| |
| 摘 要： | 提出一种L1+L2范数正则化逻辑斯蒂模型分类算法。该算法引入L2范数正则化，解决L1正则化逻辑斯蒂算法迭代过程奇异问题，通过引入样本向量的扩展和新的权值向量完成L1范数非平滑问题，最终使用共轭梯度方法求解经过转化的最优化问题。在各种实际数据集上的实验结果表明，该算法优于L2范数、L1范数和Lp范数正则化逻辑斯蒂模型，具有较好的特征选择和分类性能。
|
| 关 键 词： | L1范数 L2范数 共轭梯度 特征选择 正则化 逻辑斯蒂模型 |
| 收稿时间： | 2011-08-01 |
Logistic Model Classification Algorithm via L1+L2 Regularization |
| |
| LIU Jian-wei
,
FU Jie
,
LUO Xiong-lin.Logistic Model Classification Algorithm via L1+L2 Regularization[J].Computer Engineering,2012,38(13):148-151. |
| |
| Authors: | LIU Jian-wei FU Jie LUO Xiong-lin |
| |
| Affiliation: | (Research Institute of Automation,China University of Petroleum(Beijing),Beijing 102249,China) |
| |
| Abstract: | This paper proposes an L1+L2 norm regularized logistic model classification algorithm,and the singularity of iterative process in L1 norm regularized logistic classification algorithm is solved by using L2 norm regularization.The non-smooth problem is transformed into smooth one via argumentation of vector of samples and introduction of new weight vector,and classification object function is solved using the conjugate gradient method.Performance of classification and feature selection on real datasets shows that the algorithm is better than L2 norm,L1 nrom and Lp norm regularized logistic model. |
| |
| Keywords: | L1 norm L2 norm conjugate gradient feature selection regularization Logistic model |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
| 点击此处可从《计算机工程》浏览原始摘要信息 |
|
点击此处可从《计算机工程》下载全文 |
