一种基于核的监督流形学习算法

针对流形学习算法——局部保持映射存在的参数选择及不能进行非线性特征提取的问题,提出一种基于核的监督流形学习算法.该算法作为局部保持映射算法的改进算法用样本类标识信息指导建立局部最近邻图,并在建立局部最近邻图使用无参数的相似度量.利用核方法来解决局部保持映射算法在处理线性不可分问题上的局限性问题.在两个常用数据库上验证本文算法的可行性和有效性.     

基于数据依赖核函数的核优化算法

为了克服核学习中核函数及参数选择问题并提升算法性能,文中提出一种基于数据依赖核函数的核优化算法,用最大间隔准则建立最优目标函数求解数据依赖核的最优参数。实验表明文中算法可有效提高核学习机的性能。     

Kernel class-wise locality preserving projection

In the recent years, the pattern recognition community paid more attention to a new kind of feature extraction method, the manifold learning methods, which attempt to project the original data into a lower dimensional feature space by preserving the local neighborhood structure. Among them, locality preserving projection (LPP) is one of the most promising feature extraction techniques. However, when LPP is applied to the classification tasks, it shows some limitations, such as the ignorance of the label information. In this paper, we propose a novel local structure based feature extraction method, called class-wise locality preserving projection (CLPP). CLPP utilizes class information to guide the procedure of feature extraction. In CLPP, the local structure of the original data is constructed according to a certain kind of similarity between data points, which takes special consideration of both the local information and the class information. The kernelized (nonlinear) counterpart of this linear feature extractor is also established in the paper. Moreover, a kernel version of CLPP namely Kernel CLPP (KCLPP) is developed through applying the kernel trick to CLPP to increase its performance on nonlinear feature extraction. Experiments on ORL face database and YALE face database are performed to test and evaluate the proposed algorithm.     

Supervised optimal locality preserving projection

In the past few years, the computer vision and pattern recognition community has witnessed a rapid growth of a new kind of feature extraction method, the manifold learning methods, which attempt to project the original data into a lower dimensional feature space by preserving the local neighborhood structure. Among these methods, locality preserving projection (LPP) is one of the most promising feature extraction techniques. Unlike the unsupervised learning scheme of LPP, this paper follows the supervised learning scheme, i.e. it uses both local information and class information to model the similarity of the data. Based on novel similarity, we propose two feature extraction algorithms, supervised optimal locality preserving projection (SOLPP) and normalized Laplacian-based supervised optimal locality preserving projection (NL-SOLPP). Optimal here means that the extracted features via SOLPP (or NL-SOLPP) are statistically uncorrelated and orthogonal. We compare the proposed SOLPP and NL-SOLPP with LPP, orthogonal locality preserving projection (OLPP) and uncorrelated locality preserving projection (ULPP) on publicly available data sets. Experimental results show that the proposed SOLPP and NL-SOLPP achieve much higher recognition accuracy.     

最大子分类间隔准则的核函数优化

在分析现有基于经验特征空间核函数优化方法局限性的基础上,提出一种基于最大子分类间隔准则的核函数优化方法。该方法首先建立最大子分类间隔准则,然后结合数据在经验特征空间中的特点给出样本数据的类间散布矩阵和类内散布矩阵的表达式,最后利用奇异值分解实现核函数参数的优化选取。本文利用UCI(University of California, Irvine)数据对算法进行仿真实验,仿真结果表明了本文方法的正确性和有效性。     

基于POEM_SLPP的人脸识别算法

针对方向边缘幅值模式(Patterns of Oriented Edge Magnitudes,POEM)提取的人脸特征维数过高和计算复杂度较大的问题,提出了结合方向边缘幅值模式和有监督的局部保持投影(Patterns of Oriented Edge Magnitudes _Supervised Locality Preserving Projections,POEM_SLPP)的人脸识别算法。首先,采用POEM算子进行特征提取;其次,将高维特征数据投影到SLPP算法求出的低维样本空间进行降维;最后,采用最近邻法对测试样本进行分类。在CAS-PEAL-R1人脸库上的实验结果表明,在姿态、背景、修饰、年龄、距离测试集上,该算法的平均识别率较POEM LPP算法提高了22%,较POEM PCA提高了2%。     

Local structure based supervised feature extraction

In the past few years, the computer vision and pattern recognition community has witnessed the rapid growth of a new kind of feature extraction method, the manifold learning methods, which attempt to project the original data into a lower dimensional feature space by preserving the local neighborhood structure. Among them, locality preserving projection (LPP) is one of the most promising feature extraction techniques. However, when LPP is applied to the classification tasks, it shows some limitations, such as the ignorance of the label information. In this paper, we propose a novel feature extraction method, called locally discriminating projection (LDP). LDP utilizes class information to guide the procedure of feature extraction. In LDP, the local structure of the original data is constructed according to a certain kind of similarity between data points, which takes special consideration of both the local information and the class information. The similarity has several good properties which help to discover the true intrinsic structure of the data, and make LDP a robust technique for the classification tasks. We compare the proposed LDP approach with LPP, as well as other feature extraction methods, such as PCA and LDA, on the public available data sets, FERET and AR. Experimental results suggest that LDP provides a better representation of the class information and achieves much higher recognition accuracies.     

基于改进的保局投影视频特征提取

提出一种视频镜头特征提取方法。针对保局投影变换要预先指定降维后的维数和近邻参数K,根据降维前后的结构误差提出确定最佳降维维数的方法,结合各个数据点邻域的统计特征实现近邻参数K的动态选择。在此基础上,将多个视频镜头的高维特征投影到低维空间获得最佳投影矩阵,新的视频特征根据此投影矩阵进行降维处理。对比实验结果表明,通过保局投影变换提取出来的特征比其它特征更加有利于视频的镜头分割。     

基于局部保持投影的神经尖峰电位特征提取与分类

神经元尖峰电位的识别和分类,是神经信息处理中的关键环节之一,而尖峰电位的特征提取是识别和分类的重要基础。针对尖峰电位的特征提取和分类,提出一种基于局部保持投影(LPP)的无监督算法,对近邻参数进行了自动识别和选择,使用基于原型向量的分布离散度标准,尖峰电位的特征得到充分提取和分离。仿真和实际数据实验结果表明：基于局部保持投影的无监督特征提取和分类算法,比传统主成分分析(PCA)方法能更加有效地实现特征提取和分离。     

有监督的无参数核局部保持投影及人脸识别

针对发掘人脸图像中的高维非线性结构,将加核及构造无参数近邻图两种思想同时引入到局部保持投影算法中,在有监督的模式下,提出了一种新的有监督的无参数核局部保持投影(Parameter-less Supervised Kernel Locality Preserving Projection,PSKLPP)算法并给出了其推导过程。该算法通过将欧氏距离改为对离群数据更为鲁棒的余弦距离,构造无参数近邻图,利用核方法提取人脸图像中的非线性信息,并将其投影在一个高维非线性空间,运用局部保持投影算法得到一线性映射,有效避免了在计算相似矩阵过程中面临的复杂参数选择问题。在ORL和Yale人脸库上的仿真实验验证了所提算法的有效性。     

基于成对约束半监督学习的数据相关核优化方法

核函数及其参数的选择决定着核方法的性能。本文基于半监督学习思想,通过构建一个目标函数,利用无标签数据和成对约束信息来优化核函数,使得核函数尽可能适应数据集,从而改善核函数性能。为验证方法的有效性,将其应用于核主成分分析(KPCA)的核函数优化中,在人工数据和UCI数据集上对KPCA提取特征的分类和聚类性能进行评估,实验结果说明提出方法改进了分类和聚类性能。     

无监督模式下统计不相关最佳鉴别平面

统计不相关最佳鉴别平面是一种重要的特征抽取方法,在模式识别领域中具有广泛的应用。然而,统计不相关最佳鉴别平面是基于Fisher准则和总体散布矩阵共轭正交条件的,需要通过样本类别信息计算Fisher最佳鉴别矢量,因而只能用于有监督模式。提出了一种将统计不相关最佳鉴别平面扩展到无监督模式下的方法,其基本思想是将模糊概念引入Fisher线性判别分析,通过对模糊Fisher准则的优化,在无监督模式下计算出最佳鉴别矢量及模糊散布矩阵,再根据共轭正交约束条件,求得第二条最佳鉴别矢量,进而获得一种基于无监督统计不相关最佳鉴别平面的特征抽取方法。对UCI数据集及CMU-PIE人脸数据库进行实验,结果表明,在样本类别信息缺失的情况下,该方法尽管无法具有与有监督模式下的统计不相关最佳鉴别平面特征抽取方法同样的性能,但当类别差异较大时,能够抽取有利于分类的统计不相关特征,获得优于主成分分析与独立成分分析等常见无监督特征抽取方法的性能。     

FKA算法迭代收敛性分析

《核选择和非线性特征提取的双线性分析》一文提出了一种新颖的核Fisher准则FKC, 并用迭代分析算法FKA求得最优解,但其迭代收敛性缺乏理论上的证明。从理论上对FKA算法的迭代收敛性进行了分析和探讨,并运用Radermacher复杂性分析法进行证明。     

基于无监督最佳鉴别平面的人脸识别*

最佳鉴别平面作为一种重要的特征抽取方法,在人脸特征降维中具有重要的影响。然而,传统的最佳鉴别平面是基于Fisher准则的,只能用于有监督模式。为此,提出了一种将最佳鉴别平面扩展到无监督模式下的方法,其基本思想是以投影空间中模糊类间离散度和模糊类内离散度的比值最大为优化目标,计算出无监督模式下最佳鉴别矢量及模糊离散度矩阵,进而获得一种新的基于无监督最佳鉴别平面的特征抽取方法。较之同属于无监督特征抽取的主成分分析,该方法更容易获得有利于分类的特征。对CMU-PIE人脸数据库进行实验,结果表明,在样本类别信息缺失的情况下,该方法尽管无法具有与有监督模式下的最佳鉴别平面特征抽取方法同样的性能,但当不同类之间差异较大时,将优于主成分分析方法。     

Subspace learning for unsupervised feature selection via matrix factorization

Dimensionality reduction is an important and challenging task in machine learning and data mining. Feature selection and feature extraction are two commonly used techniques for decreasing dimensionality of the data and increasing efficiency of learning algorithms. Specifically, feature selection realized in the absence of class labels, namely unsupervised feature selection, is challenging and interesting. In this paper, we propose a new unsupervised feature selection criterion developed from the viewpoint of subspace learning, which is treated as a matrix factorization problem. The advantages of this work are four-fold. First, dwelling on the technique of matrix factorization, a unified framework is established for feature selection, feature extraction and clustering. Second, an iterative update algorithm is provided via matrix factorization, which is an efficient technique to deal with high-dimensional data. Third, an effective method for feature selection with numeric data is put forward, instead of drawing support from the discretization process. Fourth, this new criterion provides a sound foundation for embedding kernel tricks into feature selection. With this regard, an algorithm based on kernel methods is also proposed. The algorithms are compared with four state-of-the-art feature selection methods using six publicly available datasets. Experimental results demonstrate that in terms of clustering results, the proposed two algorithms come with better performance than the others for almost all datasets we experimented with here.     

小波核局部Fisher判别分析的高光谱遥感影像特征提取

为了提高高光谱遥感影像的分类精度,充分利用影像的光谱和局部信息,文中提出小波核局部Fisher判别分析的高光谱遥感影像特征提取方法.通过小波核函数将数据集从低维原始空间映射至高维特征空间,考虑到数据的局部信息,利用加权矩阵计算散度矩阵,对局部Fisher判别准则函数求解最优特征矩阵,使不同类别的样本在高维特征空间中的可分离性更佳.在2个公开高光谱数据集上的实验表明,文中方法的总体分类精度和Kappa系数都有所提高.     

基于ISE 的核密度估计和随机置换的单一或协同特征的选择方法

针对数据的特征存在单一和协同特征的选择问题,基于平方误差标准核密度估计和随机置换理论,首先提出一种针对单一特征的特征选择方法(FSKDE-RP);然后,针对协同特征的情况,通过拓展随机置换理论,提出多维协同特征选择算法(SFSKDE-MRP),并利用核神经网络(KNN)分类器的分类精度选择最优特征子集.在模拟数据和真实数据集上的实验结果表明了所提出算法的有效性.     

基于一种小波核优化学习的KSPP子空间故障特征提取*

针对电子系统故障诊断中有效特征提取困难,核属性约简方法中核函数与核参数选择繁琐等问题,提出了一种基于自优化小波核稀疏保持投影的子空间特征提取方法。通过对核极化准则的改进,使得新准则不仅可以处理多类别信息,而且可以保留同一类别数据间的局部结构特征。以墨西哥帽小波核函数为对象,基于改进的核评估准则构建优化目标函数,并采用粒子群优化算法进行核参数选择。将优化的小波核作为核稀疏保持投影的核函数,最终实现了在核子空间中对有效特征的提取。实验结果表明,相比于其它流形的子空间特征提取方法,提出的方法有效提升了分类精度,具有良好的泛化性能。     

基于多核Fisher判别分析的人脸特征提取

核Fisher判别分析法是一种有效的非线性判别分析法。传统的核Fisher判别分析仅选用单个核函数,在人脸特征提取方面仍显不足。鉴于此,提出多核Fisher判别分析法,即通过将多个单核Fisher判别得到的投影进行加权组合得到加权投影,以加权投影为依据进行特征提取和分类。实验表明,在进行人脸特征提取和分类时,多核Fisher判别分析法优于单核Fisher判别分析法。     

2DPCA+2DLDA和改进的LPP相结合的人脸识别算法

针对局部保持投影（LPP）算法无监督且只保留局部信息的特性,提出一种2DPCA+2DLDA和改进的LPP相结合的人脸识别算法。将训练集样本用2DPCA+2DLDA算法进行投影,保留数据整体空间信息和分类信息;引入类内、类间信息对LPP算法的关系矩阵进行优化,使LPP成为有监督的非线性学习方法,采用改进的LPP（ILPP）算法对训练集图像进行二次投影,提取样本的局部流形信息,并作为人脸识别信息进行鉴别。在Yale和ORL人脸库的测试结果验证了该方法的有效性。