Adaptive linear discriminant regression classification for face recognition

Linear discriminant regression classification (LDRC) was presented recently in order to boost the effectiveness of linear regression classification (LRC). LDRC aims to find a subspace for LRC where LRC can achieve a high discrimination for classification. As a discriminant analysis algorithm, however, LDRC considers an equal importance of each training sample and ignores the different contributions of these samples to learn the discriminative feature subspace for classification. Motivated by the fact that some training samples are more effectual in learning the low-dimensional feature space than other samples, in this paper, we propose an adaptive linear discriminant regression classification (ALDRC) algorithm by taking special consideration of different contributions of the training samples. Specifically, ALDRC makes use of different weights to characterize the different contributions of the training samples and utilizes such weighting information to calculate the between-class and the within-class reconstruction errors, and then ALDRC seeks to find an optimal projection matrix that can maximize the ratio of the between-class reconstruction error over the within-class reconstruction error. Extensive experiments carried out on the AR, FERET and ORL face databases demonstrate the effectiveness of the proposed method.     

基于谱域特征提取与线性回归分类的智能人脸识别算法

针对人脸识别中由于光线、表情变化和遮挡导致人脸图像变化的问题,提出了一种谱域特征提取与线性回归分类算法相结合的智能人脸识别方法。为了实现特征提取的目的,首先使用Viola-Jones算法从原始图像中提取初始人脸部分,并将其转换为120×120像素大小的灰度图像;然后提出了一种计算极坐标傅里叶变换（FFT）以获得预处理人脸图像主要幅度谱特征的新框架,进一步在预处理的图像上执行2D-DFT,并表示为1D P-FFT。特征值是1D P-FFT幅值中的最大值,提取的特征值用于构造表示人脸图像的符号对象。最后利用快速有效的线性回归分类算法实现分类。在AR和GT数据库上进行了各种实验,分别取得了97.51％和98.02％的准确率,与最近报道的一些人脸识别技术相比,提出的方法识别准确率更高。     

Kernel linear regression for face recognition

Linear regression uses the least square algorithm to solve the solution of linear regression equation. Linear regression classification (LRC) shows good classification performance on face image data. However, when the axes of linear regression of class-specific samples have intersections, LRC could not well classify the samples that distribute around intersections. Moreover, the LRC could not perform well at the situation of severe lighting variations. This paper proposes a new classification method, kernel linear regression classification (KLRC), based on LRC and the kernel trick. KLRC is a nonlinear extension of LRC and can offset the drawback of LRC. KLRC implicitly maps the data into a high-dimensional kernel space by using the nonlinear mapping determined by a kernel function. Through this mapping, KLRC is able to make the data more linearly separable and can perform well for face recognition with varying lighting. For comparison, we conduct on three standard databases under some evaluation protocols. The proposed methodology not only outperforms LRC but also takes the better performance than typical kernel methods such as kernel linear discriminant analysis and kernel principal component analysis.     

Incremental linear discriminant analysis for face recognition.

Dimensionality reduction methods have been successfully employed for face recognition. Among the various dimensionality reduction algorithms, linear (Fisher) discriminant analysis (LDA) is one of the popular supervised dimensionality reduction methods, and many LDA-based face recognition algorithms/systems have been reported in the last decade. However, the LDA-based face recognition systems suffer from the scalability problem. To overcome this limitation, an incremental approach is a natural solution. The main difficulty in developing the incremental LDA (ILDA) is to handle the inverse of the within-class scatter matrix. In this paper, based on the generalized singular value decomposition LDA (LDA/GSVD), we develop a new ILDA algorithm called GSVD-ILDA. Different from the existing techniques in which the new projection matrix is found in a restricted subspace, the proposed GSVD-ILDA determines the projection matrix in full space. Extensive experiments are performed to compare the proposed GSVD-ILDA with the LDA/GSVD as well as the existing ILDA methods using the face recognition technology face database and the Carneggie Mellon University Pose, Illumination, and Expression face database. Experimental results show that the proposed GSVD-ILDA algorithm gives the same performance as the LDA/GSVD with much smaller computational complexity. The experimental results also show that the proposed GSVD-ILDA gives better classification performance than the other recently proposed ILDA algorithms.     

Combination of linear regression classification and collaborative representation classification

Classification using the l ₂-norm-based representation is usually computationally efficient and is able to obtain high accuracy in the recognition of faces. Among l ₂-norm-based representation methods, linear regression classification (LRC) and collaborative representation classification (CRC) have been widely used. LRC and CRC produce residuals in very different ways, but they both use residuals to perform classification. Therefore, by combining the residuals of these two methods, better performance for face recognition can be achieved. In this paper, a simple weighted sum based fusion scheme is proposed to integrate LRC and CRC for more accurate recognition of faces. The rationale of the proposed method is analyzed. Face recognition experiments illustrate that the proposed method outperforms LRC and CRC.     

A novel adaptive crossover bacterial foraging optimization algorithm for linear discriminant analysis based face recognition

This paper presents a modified bacterial foraging optimization algorithm called adaptive crossover bacterial foraging optimization algorithm (ACBFOA), which incorporates adaptive chemotaxis and also inherits the crossover mechanism of genetic algorithm. First part of the research work aims at improvising evaluation of the optimal objective function values. The idea of using adaptive chemotaxis is to make it computationally efficient and crossover technique is to search nearby locations by offspring bacteria. Four different benchmark functions are considered for performance evaluation. The purpose of this research work is also to investigate a face recognition algorithm with improved recognition rate. In this connection, we propose a new algorithm called ACBFO-Fisher. The proposed ACBFOA is used for finding optimal principal components for dimension reduction in linear discriminant analysis (LDA) based face recognition. Three well-known face databases, FERET, YALE and UMIST, are considered for validation. A comparison with the results of earlier methods is presented to reveal the effectiveness of the proposed ACBFO-Fisher algorithm.     

Incremental two-dimensional linear discriminant analysis with applications to face recognition

Two dimensional linear discriminant analysis (2DLDA) has been verified as an effective method to solve the small sample size (SSS) problem in linear discriminant analysis (LDA). However, most of the existing 2DLDA techniques do not support incremental subspace analysis for updating the discriminant eigenspace. Incremental learning has proven to enable efficient training if large amounts of training data have to be processed or if not all data are available in advance as, for example, in on-line situations. Instead of having to re-training across the entire training data whenever a new sample is added, this paper proposed an incremental two-dimensional linear discriminant analysis (I2DLDA) algorithm with closed-form solution to extract facial features of the appearance image on-line. The proposed I2DLDA inherits the advantages of the 2DLDA and the Incremental LDA (ILDA) and overcomes the number of the classes or chunk size limitation in the ILDA because the size of the between-class scatter matrix and the size of the within-class scatter matrix in the I2DLDA are much smaller than the ones in the ILDA. The results on experiments using the ORL and XM2VTS databases show that the I2DLDA is computationally more efficient than the batch 2DLDA and can achieve better recognition results than the ILDA.     

Efficient linear discriminant analysis with locality preserving for face recognition

Linear discriminant analysis (LDA) is one of the most popular techniques for extracting features in face recognition. LDA captures the global geometric structure. However, local geometric structure has recently been shown to be effective for face recognition. In this paper, we propose a novel feature extraction algorithm which integrates both global and local geometric structures. We first cast LDA as a least square problem based on the spectral regression, then regularization technique is used to model the global and local geometric structures. Furthermore, we impose penalty on parameters to tackle the singularity problem and design an efficient model selection algorithm to choose the optimal tuning parameter which balances the tradeoff between the global and local structures. Experimental results on four well-known face data sets show that the proposed integration framework is competitive with traditional face recognition algorithms, which use either global or local structure only.     

Adaptively weighted sub-directional two-dimensional linear discriminant analysis for face recognition

A novel image classification algorithm named Adaptively Weighted Sub-directional Two-Dimensional Linear Discriminant Analysis (AWS2DLDA) is proposed in this paper. AWS2DLDA can extract the directional features of images in the frequency domain, and it is applied to face recognition. Some experiments are conducted to demonstrate the effectiveness of the proposed method. Experimental results confirm that the recognition rate of the proposed system is higher than the other popular algorithms.     

稀疏表示和贪婪搜索的人脸分类

目的 随着稀疏表示方法在图像重建问题中的巨大成功,研究人员提出了一种特殊的分类方法,即基于稀疏表示的分类方法.为了加强样本间的协作表示能力以及减弱稀疏分解时的强L1约束,提出了一种在稀疏分类框架下的迭代剔除机制和贪婪搜索策略的人脸识别方法.方法 将测试样本表示成训练样本线性组合的方式,并在所有训练样本中通过迭代计算来消除对分类影响较小的类别和单个样本,在系数分解的过程中采用最小误差正交匹配追踪(EcOMP)算法,进而选择出贡献程度大的类别样本并进行分类.结果 在迭代更新样本字典的过程中,强化了真实类别的表示能力,并弱化了分解系数的强L1约束.在所有的实验中,正则化参数λ的取值为0.001,在ORL、FERET和AR 3个人脸数据库上,本文算法的识别率可分别达到97.88％、67.95％和94.50％,进而验证了本文算法的有效性.结论 提出的在稀疏分类框架下的迭代剔除机制和贪婪搜索策略的人脸识别方法,在动态迭代的机制中完成了样本字典的更新,平衡了协作表示和稀疏约束的关系,相比较原始的稀疏分类模型有更好的准确性和稳定性.     

基于判别低秩矩阵恢复和协同表示的遮挡人脸识别

针对训练样本和测试样本均受到严重的噪声污染的人脸识别问题,传统的子空间学习方法和经典的基于稀疏表示的分类(SRC)方法的识别性能都将急剧下降。另外,基于稀疏表示的方法也存在算法复杂度较高的问题。为了在一定程度上缓解上述问题,提出一种基于判别低秩矩阵恢复和协同表示的遮挡人脸识别方法。首先,低秩矩阵恢复可以有效地从被污损的训练样本中恢复出干净的、具备低秩结构的训练样本,而结构非相关性约束的引入可以有效提高恢复数据的鉴别能力。然后,通过学习原始污损数据与恢复出的低秩数据之间的低秩投影矩阵,将受污损的测试样本投影到相应的低维子空间,以修正污损测试样本。最后,利用协同表示的分类方法(CRC)对修正后的测试样本进行分类,获取最终的识别结果。在Extended Yale B和AR数据库上的实验结果表明,本文方法对遮挡人脸识别具有更好的识别性能。     

Locally linear discriminant embedding: An efficient method for face recognition

In this paper an efficient feature extraction method named as locally linear discriminant embedding (LLDE) is proposed for face recognition. It is well known that a point can be linearly reconstructed by its neighbors and the reconstruction weights are under the sum-to-one constraint in the classical locally linear embedding (LLE). So the constrained weights obey an important symmetry: for any particular data point, they are invariant to rotations, rescalings and translations. The latter two are introduced to the proposed method to strengthen the classification ability of the original LLE. The data with different class labels are translated by the corresponding vectors and those belonging to the same class are translated by the same vector. In order to cluster the data with the same label closer, they are also rescaled to some extent. So after translation and rescaling, the discriminability of the data will be improved significantly. The proposed method is compared with some related feature extraction methods such as maximum margin criterion (MMC), as well as other supervised manifold learning-based approaches, for example ensemble unified LLE and linear discriminant analysis (En-ULLELDA), locally linear discriminant analysis (LLDA). Experimental results on Yale and CMU PIE face databases convince us that the proposed method provides a better representation of the class information and obtains much higher recognition accuracies.     

Image classification using local linear regression

In the past several decades, classifier design has attracted much attention. Inspired by the locality preserving idea of manifold learning, here we give a local linear regression (LLR) classifier. The proposed classifier consists of three steps: first, search k nearest neighbors of a pointed sample from each special class, respectively; second, reconstruct the pointed sample using the k nearest neighbors from each special class, respectively; and third, classify the test sample according to the minimum reconstruction error. The experimental results on the ETH80 database, the CENPAMI handwritten number database and the FERET face image database demonstrate that LLR works well, leading to promising image classification performance.     

Pose invariant face recognition based on hybrid-global linear regression

The paper presents a simple but efficient novel H-eigenface (Hybrid-eigenface) method for pose invariant face recognition ranging from frontal to profile view. H-eigenfaces are entirely new basis for face image representation under different poses and are used for virtual frontal view synthesis. The proposed method is based on the fact that face samples of same person under different poses are similar in terms of the combination pattern of facial features. H-eigenfaces exploit this fact and thus two H-eigenfaces under different poses capture same features of the face. Thereby providing a compact view-based subspace, which can be further used to generate virtual frontal view from inputted non-frontal face image using least square projection technique. The use of proposed methodology on FERET and ORL face database shows an impressive improvement in recognition accuracy and a distinct reduction in online computation when compared to global linear regression method.     

新的局部线性嵌入下的人脸识别方法

针对LLE算法无法对后续采集的测试样本单独进行降维处理和未能利用样本点分类信息的两点不足之处,提出了一种有监督的增量式局部线性嵌入算法（SILLE）,并采取小波变换对图像进行预处理。通过对ORL数据库实验证明,SILLE算法与LLE算法相比大大降低了处理新增样本点的计算时间,并且提高了识别精度。     

A linear discriminant analysis framework based on random subspace for face recognition

Linear discriminant analysis (LDA) often suffers from the small sample size problem when dealing with high-dimensional face data. Random subspace can effectively solve this problem by random sampling on face features. However, it remains a problem how to construct an optimal random subspace for discriminant analysis and perform the most efficient discriminant analysis on the constructed random subspace. In this paper, we propose a novel framework, random discriminant analysis (RDA), to handle this problem. Under the most suitable situation of the principal subspace, the optimal reduced dimension of the face sample is discovered to construct a random subspace where all the discriminative information in the face space is distributed in the two principal subspaces of the within-class and between-class matrices. Then we apply Fisherface and direct LDA, respectively, to the two principal subspaces for simultaneous discriminant analysis. The two sets of discriminant analysis features from dual principal subspaces are first combined at the feature level, and then all the random subspaces are further integrated at the decision level. With the discriminating information fusion at the two levels, our method can take full advantage of useful discriminant information in the face space. Extensive experiments on different face databases demonstrate its performance.     

NMF与LDA相结合的彩色人脸识别

为了提高彩色人脸识别的性能,提出了一种非负矩阵分解与线性判别分析相结合的彩色人脸识别算法。首先采用非负矩阵分解算法对彩色人脸图像不同颜色通道的信息进行编码,计算彩色人脸图像空间的基图像;然后根据非负矩阵分解计算得到的图像分解系数,融入人脸对象的类别信息,采用线性判别分析算法计算最优的鉴别子空间;最后以彩色人脸图像的投影系数为特征,采用最近邻分类算法进行人脸识别。在CVL和CMUPIE人脸数据库上的实验结果验证了提出的彩色人脸识别算法的正确性和有效性。     

Two-dimensional discriminant transform for face recognition

This paper develops a new image feature extraction and recognition method coined two-dimensional linear discriminant analysis (2DLDA). 2DLDA provides a sequentially optimal image compression mechanism, making the discriminant information compact into the up-left corner of the image. Also, 2DLDA suggests a feature selection strategy to select the most discriminative features from the corner. 2DLDA is tested and evaluated using the AT&T face database. The experimental results show 2DLDA is more effective and computationally more efficient than the current LDA algorithms for face feature extraction and recognition.