Face recognition using recursive Fisher linear discriminant.

Fisher linear discriminant (FLD) has recently emerged as a more efficient approach for extracting features for many pattern classification problems as compared to traditional principal component analysis. However, the constraint on the total number of features available from FLD has seriously limited its application to a large class of problems. In order to overcome this disadvantage, a recursive procedure of calculating the discriminant features is suggested in this paper. The new algorithm incorporates the same fundamental idea behind FLD of seeking the projection that best separates the data corresponding to different classes, while in contrast to FLD the number of features that may be derived is independent of the number of the classes to be recognized. Extensive experiments of comparing the new algorithm with the traditional approaches have been carried out on face recognition problem with the Yale database, in which the resulting improvement of the performances by the new feature extraction scheme is significant.     

基于互信息梯度优化计算的信息判别特征提取

该文将互信息梯度优化引入特征提取矩阵求解,提出一种信息判别分析的特征提取方法。首先,分析了现有线性判别方法的特点和局限,建立了类条件分布参数模型下互信息最大化的信息判别模型。其次,证明了互信息判别的线性变换不变性和贝叶斯一致优化,构造了一个互信息梯度优化计算的特征提取算法。最后通过实际数据上试验验证了该方法的有效性。     

核不相关空间算法及其在人脸识别中的应用

不相关空间算法是求解不相关鉴别矢量集的快速算法,但是将其应用在人脸识别中将遇到小样本问题,并且算法只是一种线性的特征提取方法。该文提出一种核不相关空间算法,该方法的关键是高维特征空间中不相关空间的计算,对此提出一种简单的计算方法,即根据eigenface中将高阶矩阵计算转化成低阶矩阵计算的思想,将高维特征空间中不相关空间的计算仍归结为标准的特征值分解问题。所提出的算法能够有效地解决小样本问题。在ORL人脸库上的实验结果验证了所提出的算法的可行性和有效性。     

一种核正交鉴别保局投影算法

 正交鉴别保局投影算法是一种有效的特征提取方法,但是将其应用在人脸识别中将遇到小样本问题,并且算法只是一种线性的特征提取方法,因此提出一种核保局正交鉴别投影算法。实现这一算法的关键是高维特征空间中总体散布矩阵的非零空间的计算,对此根据eigenfaces中将高阶矩阵计算转化成低阶矩阵计算的思想及核函数技术,将高维特征空间中总体散布矩阵的非零空间的计算仍归结为标准的特征值分解问题,并且所提出的算法能够有效地解决小样本问题。在人脸库上的实验结果验证了所提出的算法是可行的和有效的。     

基于部分标记数据进行人脸图像特征提取

针对无监督特征提取的识别率低与监督特征提取需要大量标记的问题,提出一种基于部分标记数据的半监督判别分析(SSDPA)特征提取法。本文方法能实现图像数据降维,避免线性判别分析(LDA)存在的小样本问题,达到提高识别率的目的。算法对图像进行离散余弦变换(DCT)变换;根据DCT图像的频率分布,利用部分标记数据计算SSDP;优先搜索SSDP高的DCT图像信息。将本文方法与其它方法进行组合,在不同人脸数据库上进行了实验。实验证明了本文方法的有效性,用较低的代价获得了优于传统方法的识别率。     

Local appearance based face recognition method using block based steerable pyramid transform

In this paper, an efficient local appearance feature extraction method based on Steerable Pyramid (S-P) wavelet transform is proposed for face recognition. Local information is extracted by computing the statistics of each sub-block obtained by dividing S-P sub-bands. The obtained local features of each sub-band are combined at the feature and decision level to enhance face recognition performance. The purpose of this paper is to explore the usefulness of S-P as feature extraction method for face recognition. The proposed approach is compared with some related feature extraction methods such as principal component analysis (PCA), as well as linear discriminant analysis LDA and boosted LDA. Different multi-resolution transforms, wavelet (DWT), gabor, curvelet and contourlet, are also compared against the block-based S-P method. Experimental results on ORL, Yale, Essex and FERET face databases convince us that the proposed method provides a better representation of the class information, and obtains much higher recognition accuracies in real-world situations including changes in pose, expression and illumination.     

High-dimensional feature extraction using bit-plane decomposition of local binary patterns for robust face recognition

Transforming an original image into a high-dimensional (HD) feature has been proven to be effective in classifying images. This paper presents a novel feature extraction method utilizing the HD feature space to improve the discriminative ability for face recognition. We observed that the local binary pattern can be decomposed into bit-planes, each of which has scale-specific directional information of the face image. Each bit-plane not only has the inherent local-structure of the face image but also has an illumination-robust characteristic. By concatenating all the decomposed bit-planes, we generate an HD feature vector with an improved discriminative ability. To reduce the computational complexity while preserving the incorporated local structural information, a supervised dimension reduction method, the orthogonal linear discriminant analysis, is applied to the HD feature vector. Extensive experimental results show that existing classifiers with the proposed feature outperform those with other conventional features under various illumination, pose, and expression variations.     

基于图像矩阵的广义主分量分析

传统的主分量分析在处理图像识别问题时是基于向量的,且没有充分利用训练样本的类别信息。该文提出了一种直接基于图像矩阵的广义主分量分析方法,该方法能够提取包含在类平均图像中的鉴别信息,与传统的主分量分析相比,具有更强的鉴别力。在ORL标准人脸库上的试验结果表明,所提出的方法不仅识别性能优于传统的主分量分析和Fisher线性鉴别分析,而且极大地提高了特征抽取的速度。     

Spare L1-norm-based maximum margin criterion

Maximum margin criterion (MMC) is a popular method for dimensionality reduction or feature extraction. MMC can alleviate the small size sample (SSS) problem encountered by linear discriminant analysis (LDA) and extract more discriminant vectors than LDA. However, the objective function of MMC is derived from L2-norm, which makes MMC be sensitive to noise and outliers. Besides, the basis vectors of MMC are dense, which makes it hard to explain the obtained features. To address the drawbacks of MMC, in this paper, we propose a novel sparse L1-norm-based maximum margin criterion (SMMC-L1). L1-norm rather than L2-norm is used in the objective function of SMMC-L1. Besides, L1-norm is also used as a lasso penalty to regularize the basis vectors. An iterative algorithm for solving SMMC-L1 is proposed. Experiment results on some databases show the effectiveness of the proposed SMMC-L1.     

一种基于奇异值分解的特征抽取方法

特征抽取是模式识别的基本问题之一,Fisher线性鉴别分析是特征抽取中最为经典和广泛使用的方法之一。该文分析了Fisher线性鉴别分析在求解过程中可能存在的问题:鉴别矢量的分量可能是复数;特征值对扰动的敏感性;鉴别矢量之间未必具有正交性。由此提出了均衡散布矩阵的概念,并利用均衡散布矩阵构造了一种新的线性鉴别准则。利用奇异值分解定理,将求取鉴别矢量转化为对矩阵求奇异向量。用该方法进行求解可以有效地避免前述的问题。试验结果表明,该鉴别准则具有良好的鉴别能力。     

Generalized multiple maximum scatter difference feature extraction using QR decomposition

Multiple maximum scatter difference (MMSD) discriminant criterion is an effective feature extraction method that computes the discriminant vectors from both the range of the between-class scatter matrix and the null space of the within-class scatter matrix. However, singular value decomposition (SVD) of two times is involved in MMSD, rendering this method impractical for high dimensional data. In this paper, we propose a generalized MMSD (GMMSD) criterion for feature extraction and classification. GMMSD allows relatively-free selection of a suitable transformation matrix to reduce dimensions. Based on GMMSD criterion, we demonstrate that the same discriminant information can be extracted by QR decomposition, which is more efficient than SVD. Next, GMMSD is compared with several classical feature extraction methods to justify the validity of the proposed method. Our experiments on three face databases and two facial expression databases demonstrate that GMMSD provides favorable recognition performance with high computational efficiency.     

基于块双向Fisher线性判别分析人脸识别

为解决二维Fisher线性判别(2DFLD)分析需要较多系数用以表示图像的特征阵、只考虑了图像的列间相关性从而忽略行间相关性以及作为全局特征提取方法可能会失去一些重要的局部特征等问题,提出一种基于块双向二维Fisher线性判别分析(B2DFLD)算法。首先利用块图像获取保持重要局部信息;然后基于行列双向投影,获取提取特征信息;最后计算特征阵的Frobenius距离,并进行分类。在ORL、YALE与FERET人脸数据库上进行了实验,并同传统的8种人脸识别方法比较。实验结果表明,在确定图像块大小、改变训练样本数以及特征维数的前提下,本文方法的最好识别率都高于93.08,平均误识率高于0.15,明显优于其他方法,表明本文方法对有光照、表情以及遮挡的人脸图像识别具有较高的鲁棒性。     

基于两空间核鉴别分析的人脸识别

指出了几种线性鉴别分析方法在处理小样本人脸识别问题时存在的不足,结合核方法的思想,提出了一种基于两空间核鉴别分析的人脸识别方法.首先使用KPCA方法在核变换后的特征空间中对样本进行处理;进面将变换后的类内散布矩阵分成非零空间和零空间进行鉴别向量确定和鉴别特征提取,最后将得到的两种鉴别特征融合,从而使用最近邻法进行分类....     

基于递归和SVM的特征选择方法研究

特征选择是模式识别领域的一个重要的研究方向,它可以提高分类的效率与效果。本文将递归特征排除算法与SVM决策树结合起来运用于特征选择,首先利用递归特征排除算法对所选择的特征进行初排序,然后依次将特征送入SVM决策树中进行优化评估,对数据中起显著作用的特征进行筛选,除去冗余和次要特征,得到特征子集。最后,通过对Linux主机和相关网络的27个入侵特征数据进行特征选择实验,实验结果表明,特征个数降至21个,而测试精度仍然能达到94%,从而证明本文所提出的递归和SVM相结合的方法是解决特征选择问题的一种有效方法。     

基于正则化零空间鉴别分析的人脸识别

提取有效的特征对高维数据的模式分类起着关键 作用,针对现有故障特征维数过高的问题,本文提 出了一种基于正则化零空间线性鉴别分析(Exponential Regularized Null Space Linear Discriminant Analysis, ERNSLDA)的特征提取方法。零空间线性判别分析已经在数据降维和特征提取上展现出良好 的性能,在 本文中,首先对类内样本矩阵进行正则化处理,避免小样本问题,其次对判别准则进行指数 化处理。所提 方法集成了NSLDA和RLDA在模式识别上的优势,有效地提高了人脸识别的精度,在ORL和YALE 数据库上的仿真实验证了本文所提方法的有效性。     

Gait recognition using radon transform and linear discriminant analysis.

A new feature extraction process is proposed for gait representation and recognition. The new system is based on the Radon transform of binary silhouettes. For each gait sequence, the transformed silhouettes are used for the computation of a template. The set of all templates is subsequently subjected to linear discriminant analysis and subspace projection. In this manner, each gait sequence is described using a low-dimensional feature vector consisting of selected Radon template coefficients. Given a test feature vector, gait recognition and verification is achieved by appropriately comparing it to feature vectors in a reference gait database. By using the new system on the Gait Challenge database, very considerable improvements in recognition performance are seen in comparison to state-of-the-art methods for gait recognition.     

Sparse matrix transform-based linear discriminant analysis for hyperspectral image classification

Due to the high dimensionality of hyperspectral image (HSI), dimension reduction or feature extraction is usually needed before the HSI classification. Traditional linear discriminant analysis (LDA) method for feature extraction usually encounters difficulty because the available training samples in HSI classification are limited, which causes the singularity of data scatter matrix. In this paper, we propose a sparse matrix transform-based LDA (SMT-LDA) algorithm for the HSI classification. By using SMT, the total scatter matrix used in LDA can be constrained to have an eigen-decomposition where the eigenvectors can be sparsely parametrized by a limited number of Givens rotations. In this way, the estimated scatter matrix is always positive definite and well conditioned even in the case of limited training samples. The proposed SMT-LDA method is compared with regularized LDA and PCA-LDA methods on two benchmark hyperspectral data sets. Experimental results indicate that the performance of the proposed method is overall superior to these methods, especially for small-sample-size classification.     

特征提取在人脸自动识别技术中的研究

人脸识别技术目前是生物特征识别中研究的热点之一,在商业、司法、监控和视频检索等领域有着广泛的应用前景。人脸特征的自动提取则是人脸自动识别过程中至关重要的环节。主要基于主成分分析PCA、线性差别分析LDA和非负矩阵分析NMF三种常用的子空间分析方法进行人脸特征提取的研究。     

UFKLDA: An unsupervised feature extraction algorithm for anomaly detection under cloud environment

In a cloud environment, performance degradation, or even downtime, of virtual machines (VMs) usually appears gradually along with anomalous states of VMs. To better characterize the state of a VM, all possible performance metrics are collected. For such high‐dimensional datasets, this article proposes a feature extraction algorithm based on unsupervised fuzzy linear discriminant analysis with kernel (UFKLDA). By introducing the kernel method, UFKLDA can not only effectively deal with non‐Gaussian datasets but also implement nonlinear feature extraction. Two sets of experiments were undertaken. In discriminability experiments, this article introduces quantitative criteria to measure discriminability among all classes of samples. The results show that UFKLDA improves discriminability compared with other popular feature extraction algorithms. In detection accuracy experiments, this article computes accuracy measures of an anomaly detection algorithm (i.e., C‐SVM) on the original performance metrics and extracted features. The results show that anomaly detection with features extracted by UFKLDA improves the accuracy of detection in terms of sensitivity and specificity.     

Phase congruency features for palm-print verification

The existing palm-print verification schemes have demonstrated good verification performance when identity claims have to be verified based on palm-print images of adequate quality (e.g. acquired in controlled illumination conditions, free from distortions caused by the pressure applied to the surface of the scanner etc.). However, most of these schemes struggle with their verification performance when features have to be extracted from palm-print images of a poorer quality. In this study the authors present a novel palm-print feature extraction approach which deals with the presented problem by employing the two-dimensional phase congruency model for line-feature extraction. The proposed approach first computes a set of phase congruency features from a palm-print image and subsequently performs linear discriminant analysis on the computed features to represent them in a more compact manner. The approach was tested on two contrasting databases, namely, on the FE-LUKS and on the PolyU database. Encouraging results were achieved on both databases.