首页 | 本学科首页   官方微博 | 高级检索  
     

一种基于核函数的非线性感知器算法
引用本文:许建华,张学工,李衍达.一种基于核函数的非线性感知器算法[J].计算机学报,2002,25(7):689-695.
作者姓名:许建华  张学工  李衍达
作者单位:清华大学智能技术与系统国家重点实验室,北京,100084;清华大学自动化系,北京,100084
基金项目:国家自然科学基金 (69885 0 0 4)资助
摘    要:为了提高经典Rosenblatt感知器算法的分类能力,该文提出一种基于核函数的非线性感知器算法,简称核感知器算法,其特点是用简单的迭代过程和核函数来实现非线性分类器的一种设计,核感知器算法能够处理原始属性空间中线性不可分问题和高维特征空间中线性可分问题。同时,文中详细分析了其算法与径向基函数神经网络、势函数方法和支持向量机等非线性算法的关系。人工和实际数据的计算结果表明:与线性感知器算法相比,核感知器算法可以有效地提高分类精度。

关 键 词:核函数  非线性感知器算法  支持向量机  机器学习  人工神经网络
修稿时间:2001年4月10日

A Nonlinear Perceptron Algorithm Based on Kernel Functions
XU Jian,Hua,ZHANG Xue,Gong,LI Yan,Da.A Nonlinear Perceptron Algorithm Based on Kernel Functions[J].Chinese Journal of Computers,2002,25(7):689-695.
Authors:XU Jian  Hua  ZHANG Xue  Gong  LI Yan  Da
Abstract:This paper briefly reviews the perceptron algorithm and introduce its equivalent statement based on inner product. In order to enhance the classification ability of Rosenblatt's perceptron algorithm, authors generalize this algorithm by using kernel idea to yield a nonlinear perceptron algorithm based on kernels, e.g., kernel perceptron algorithm. It combines a simply iterative procedure with kernel functions to fulfill a design of nonlinear classifiers and can deal with the nonlinearly separable problems in the original attribute space and the linearly separable ones in the feature space. For the non separable cases, several heuristic strategies are suggested. Compared with other kernel machines such as SVM, KFD and KPCA, the algorithm structure of kernel perceptron algorithms is the simplest. This paper also analyzes the relation between the algorithm and radial basis function network, potential function method and support vector machine in detail. In the experiment aspects, the results of two artificial data and two benchmark databases are reported and analyzed. For the linear example, the classical and kernel perceptron methods both find the separated hyperplanes, which can classify all samples. About two spirals problem, the nonlinear decision plane obtained by kernel perceptron with radial basis function kernel can separate all samples lying in two spirals. For the image segmentation data, the correct rates of linear and kernel perceptron algorithm are 74.0% and 90.76% respectively. Since there exist 100 realizations in thyroid data set, the average error rate and variation from the linear perceptron are 14.23% and 5.74% respectively, while those from kernel one are 4.65% and 2.39%. Such experiment results show that kernel perceptron algorithm effectively improves the classification precision compared with the linear one.
Keywords:kernel function  perceptron  nonlinear  support vector machine  classifier
本文献已被 CNKI 维普 万方数据 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号