基于小波和非负稀疏矩阵分解的人脸识别方法

提出了利用小波变换(WT)、非负稀疏矩阵分解(NMFs)和Fisher线性判别(FLD)来进行人脸识别。用小波变换分解人脸图像,选择最低分辨率的子段,既能捕获到人脸的实质特征,又有效地降低了计算复杂性;非负稀疏矩阵分解能显示地控制分解稀疏度和发现人脸图像的局部化表征;Fisher线性判别能在低维子空间中形成良好的分类。实验结果表明,这种方法对光照变化、人脸表情和部分遮挡不敏感,具有良好的健壮性和较高的识别效率。     

基于信息融合的面部表情识别

文章提出用支持向量机融合四种基于不同特征表示的面部表情识别方法进行面部表情识别,即几何表示、PCA人脸表示、ICA人脸表示和FLD人脸表示。在用FLD和ICA提取表情特征前先进行PCA,把训练样本的人脸图像向量投影到一个较低维的空间,以达到降维和去除相关性的目的。然后对每一种表情特征表示都用最小距离分类器进行初步分类,最后用支持向量机融合这些分类结果来进行面部表情的最终识别,实验证明本文提出的方案是有效的。     

基于MB-LBP算子和Multilinear PCA算法的人脸识别

针对运用MB-LBP算法提取的人脸特征维数较高、而直接用MB-LBP算法提取的特征进行人脸识别时计算量较大的问题,提出一种融合MB-LBP和Multilinear PCA算法的新的人脸识别方法。首先利用MB-LBP算法提取人脸图像的特征;然后用Multilinear PCA算法对提取的人脸特征进行降维;最后用最近邻分类器进行人脸识别。在FERET人脸库上进行验证,实验结果表明,该方法的识别率高于传统PCA、分块PCA、LBP和PCA相结合的方法。     

Facial expression recognition based on local region specific features and support vector machines

Facial expressions are one of the most powerful, natural and immediate means for human being to communicate their emotions and intensions. Recognition of facial expression has many applications including human-computer interaction, cognitive science, human emotion analysis, personality development etc. In this paper, we propose a new method for the recognition of facial expressions from single image frame that uses combination of appearance and geometric features with support vector machines classification. In general, appearance features for the recognition of facial expressions are computed by dividing face region into regular grid (holistic representation). But, in this paper we extracted region specific appearance features by dividing the whole face region into domain specific local regions. Geometric features are also extracted from corresponding domain specific regions. In addition, important local regions are determined by using incremental search approach which results in the reduction of feature dimension and improvement in recognition accuracy. The results of facial expressions recognition using features from domain specific regions are also compared with the results obtained using holistic representation. The performance of the proposed facial expression recognition system has been validated on publicly available extended Cohn-Kanade (CK+) facial expression data sets.     

小波变换和特征加权融合的人脸识别

在人脸识别领域,提取人脸特征和降低维数是人脸识别的关键。传统的基于小波变换的人脸识别算法仅在小波分解的低频分量上提取用于分类的图像特征,造成了高频分量中部分对识别有利信息的丢失。为了更有效地提取人脸图像特征,提出一种基于小波变换和特征加权融合的人脸识别算法。首先通过小波变换对人脸图像进行降维处理,然后对4个小波子图分别运用主成分分析法(PCA)提取特征,并把这4部分特征加权融合,最后利用支持向量机(SVM)进行分类识别。在ORL人脸库上进行实验验证,识别准确率可达到97.5%,实验结果表明该算法能够有效提高人脸识别能力,与传统识别算法相比具有较高的识别准确率和识别速度。     

基于局部融合特征与分层增量树的快速人脸识别算法

传统的人脸识别模型采用离线方式进行训练,同时由于人脸特征维数较高导致算法的实时性不足。文中分别从人脸特征与分类器两方面来构建快速的人脸识别算法。首先使用 SDM(Supervised Descent Method)算法进行人脸特征点定位,提取每个人脸特征点邻域内的局部(Multi Block-Center Symmetric Local Binary Patterns,MB-CSLBP)特征,并将所有的人脸特征点邻域特征以串联的方式构成局部融合特征,即所提出的局部融合MB-CSLBP特征LFP-MB-CSLBP(Local Fusion Feature of MB-CSLBP)。将以上特征送入分层增量树HI-tree(Hierarchical Incremental tree)中进行人脸识别模型的在线训练。分层增量树是使用分层聚类算法来实现增量式学习的,因此其能够以在线的方式对识别模型进行训练,具有较高的实时性与准确性。最后在3种不同的人脸库以及摄像头采集的人脸视频上对算法的识别率与实时性进行测试。实验结果表明,相比于当前其他算法,所提算法具有较高的人脸识别率与实时性。     

Recognizing faces using Adaptively Weighted Sub-Gabor Array from a single sample image per enrolled subject

In this paper, we propose a new approach for face representation and recognition based on Adaptively Weighted Sub-Gabor Array (AWSGA) when only one sample image per enrolled subject is available. Instead of using holistic representation of face images which is not effective under different facial expressions and partial occlusions, the proposed algorithm utilizes a local Gabor array to represent faces partitioned into sub-patterns. Especially, in order to perform matching in the sense of the richness of identity information rather than the size of a local area and to handle the partial occlusion problem, the proposed method employs an adaptively weighting scheme to weight the Sub-Gabor features extracted from local areas based on the importance of the information they contain and their similarities to the corresponding local areas in the general face image. An extensive experimental investigation is conducted using AR and Yale face databases covering face recognition under controlled/ideal condition, different illumination condition, different facial expression and partial occlusion. The system performance is compared with the performance of four benchmark approaches. The promising experimental results indicate that the proposed method can greatly improve the recognition rates under different conditions.     

基于深度神经网络的特征加权融合人脸识别方法

针对目前难以提取到适合用于分类的人脸特征以及在非限条件下进行人脸识别准确率低的问题,提出了一种基于深度神经网络的特征加权融合人脸识别方法(DLWF)。首先,应用主动形状模型(ASM)提取出人脸面部的主要特征点,并根据主要特征点对人脸不同器官区域进行采样;然后,将所得采样块分别输入到对应的深度信念网络(DBN)中进行训练,获得网络最优参数;最后,利用Softmax回归求出各个区域的相似度向量,将多区域的相似度向量加权融合得到综合相似度评分进行人脸识别。经ORL和WFL人脸库上进行实验验证,DLWF算法的识别准确率分别达到97%和88.76%,与传统算法主成分分析(PCA)、支持向量机(SVM)、DBN及FIP+线性判别式分析(LDA)相比,无论是限制条件还是非限制条件下,识别率均有提高。实验结果表明,该算法具有高效的人脸识别能力。     

基于全局与局部特征融合的人脸识别方法

针对现有预处理算法存在的缺陷及单一人脸特征在识别中的局限性,本文在基于双眼独立动态阈值的人脸预处理方法的基础上,研究全局特征PCA、2DPCA与局部特征LBP、Gabor,分析对比这几种特征的识别效果及适用情况;根据对这几种特征的研究分析,采用特征融合的方式对PCA和LBP特征进行融合;实验结果验证了在ORL库和ESSEX库上采用决策级融合的识别率优于特征级融合及单一特征的识别率。      

基于卷积特征和贝叶斯分类器的人脸识别

为解决传统人脸识别算法特征提取困难的问题,提出了基于卷积特征和贝叶斯分类器的人脸识别方法,利用卷积神经网络提取人脸特征,通过主成分分析法对特征降维,最后利用贝叶斯分类器进行判别分类,在ORL（olivetti research laboratory）人脸库上进行实验,获得了99.00%的识别准确率。实验结果表明,卷积神经网络提取的人脸图像特征具有很强的辨识度,与PCA（principal component analysis）和贝叶斯分类器结合之后可有效提高人脸识别的准确率。     

基于偏最小二乘回归的人脸身份和表情同步识别方法

将偏最小二乘回归方法用于人脸身份和表情的同步识别。首先,对每幅人脸图像进行脸部特征提取以及相应的语义特征定义。在脸部特征提取方面,从每幅图像中标定出若干脸部关键点位置,并提取图像在该关键点处的Gabor小波系数（Gabor特征）以及关键点的坐标值（几何特征）,作为该图像的输入特征。语义特征则定义为该人脸图像所属的表情类别信息以及所对应的人脸身份信息。其次,利用核主成分分析(KPCA)方法对脸部Gabor特征和几何特征进行融合,使得输入特征具有更好的识别特性;最后,运用偏最小二乘回归(PLSR)方法建立脸部特征和语义特征之间的关系模型,并运用此模型对某一测试人脸图像进行表情和身份的同步识别。通过在JAFFE国际表情数据库和AR人脸数据库上的对比实验,证实了所提方法的有效性。     

基于子模式的Gabor特征融合的单样本人脸识别

针对传统人脸识别方法在单训练样本条件下效果不佳的缺点,提出基于子模式的Gabor特征融合方法并用于单样本人脸识别。首先采用Gabor变换抽取人脸局部信息,为有效利用面部器官的空间位置信息,将Gabor人脸图像分块构成子模式,采用最小距离分类器对各子模式分类。最后对各子模式分类结果做决策级融合得出分类结果。根据子模式构成原则和决策级融合策略不同,提出两种子模式Gabor特征融合方法。利用ORL人脸库和CAS-PEAL-R1人脸库进行实验和比较分析,实验结果表明文中方法有效提高单样本人脸识别的正确率,改善单样本人脸识别系统的性能。     

基于多种LBP特征集成学习的人脸识别*

单一的特征与分类器只能对限定条件下的人脸进行较好的识别,当在非限定条件下(如光照、背景等发生变化时)将出现人脸识别率较低问题,针对该问题,提出了一种基于多种局部二进制特征集成学习的人脸识别算法。首先,使用监督梯度下降法 (SDM)对人脸特征点定位,应用中心对称局部二进制(CSLBP)算子提取每个特征点邻域特征,将所有人脸特征点邻域特征合成为精细的纹理特征;同时运用分区LBP直方图算法提取人脸区域的微观空间结构特征;然后,使用K最近邻算法(KNN)和支持向量机(SVM)分别训练这两种特征,得到类别排序列表和投票决策矩阵;最后,利用加权求和的规则融合决策矩阵,构成最优集成分类器,从而得到输出类别。通过在非限制性人脸库LFW上实验结果表明,所提算法采用集成的方法明显优于单一的特征和分类器。     

A twice face recognition algorithm

The theory of compressive sensing applies the sparse representation to the extraction of useful information from signals and brings a breakthrough to the theory of signal sampling. Based on compressive sensing, sparse representation-based classification (SRC) is proposed. SRC uses the compressibility of the image data to represent the facial image sparsely and could solve the problems of both massive calculation and information loss in dealing with signals. SRC does not, however, deal with the effects of variable illumination, posture and incomplete face image, which could result in severe performance degradation. This paper studies the differences between SRC recognition and human recognition. We find that there is an obvious disadvantage in the SRC algorithm, and it will significantly affect the face recognition performance in actual environment, especially for the variable illumination, posture and incomplete face image. To overcome the disadvantage of SRC algorithm, we propose an SRC-based twice face recognition algorithm named T_SRC. T_SRC uses bidirectional PCA, linear discriminant analysis and GradientFace to execute multichannel analysis, which could extract more “holistic/configural” face features in actual environment than by using SRC algorithm directly. Based on the multichannel analysis, we identify the test image by SRC firstly. Then, by analyzing the residual, this algorithm could decide whether the twice recognition is needed. If the twice recognition is needed, T_SRC extracts the facial details (“featural” face features) by the improved Harris point and Gabor filter detector. We suppose that the facial details are more stable than the whole face in actual environment, and later experiments verify our assumption. At last, this algorithm identifies the class of the test image by SRC again. The results of the experiments prove that the T_SRC algorithm has better recognition rate than SRC.     

Application of image correction and bit-plane fusion in generalized PCA based face recognition

A novel generalized PCA based face recognition algorithm is proposed in this paper. Two approaches to improve the illumination robustness of the algorithm are presented, symmetrical image correction (SIC) and bit-plane feature fusion (BPFF). Specifically, for an assumed eudipleural face image, SIC first compares a pixel with the mean of this pixel and its symmetrical one and constructs a weight using the difference, then performs correction of the face image by adding the weight image to it to reduce bright speckles and shadows caused by over lighting. BPFF decomposes a face image into its eight bit-planes and extracts outline features and texture features respectively from them, then it constructs a new virtual face by combining those two features. Finally, Generalized PCA is applied to the virtual faces to achieve face recognition. Experimental results show that, the proposed combined approach can effectively reduce the sensitivity of face recognition algorithm to illumination variances and thus fewer projection vectors are required to achieve the same recognition rate than the comparing approaches.     

Fusion of appearance-based face recognition algorithms

Although many algorithms have been proposed, face recognition and verification systems can guarantee a good level of performances only for controlled environments. In order to improve the performance and robustness of face recognition and verification systems, multi-modal and mono-modal systems based on the fusion of multiple recognisers using different or similar biometrics have been proposed, especially for verification purposes. In this paper, a recognition and verification system based on the combination of two well-known appearance-based representations of the face, namely, principal component analysis (PCA) and linear discriminant analysis (LDA), is proposed. Both PCA and LDA are used as feature extractors from frontal view images. The benefits of such a fusion are shown for different environmental conditions, namely, ideal conditions, characterised by a very limited variability of environmental parameters, and real conditions with a large variability of lighting, scale and facial expression.     

Near infrared face recognition by combining Zernike moments and undecimated discrete wavelet transform

This study proposes a novel near infrared face recognition algorithm based on a combination of both local and global features. In this method local features are extracted from partitioned images by means of undecimated discrete wavelet transform (UDWT) and global features are extracted from the whole face image by means of Zernike moments (ZMs). Spectral regression discriminant analysis (SRDA) is then used to reduce the dimension of features. In order to make full use of global and local features and further improve the performance, a decision fusion technique is employed by using weighted sum rule. Experiments conducted on CASIA NIR database and PolyU-NIRFD database indicate that the proposed method has superior overall performance compared to some other methods in the presence of facial expressions, eyeglasses, head rotation, image noise and misalignments. Moreover its computational time is acceptable for on-line face recognition systems.     

对表情鲁棒的面部轮廓线3维人脸识别

目的表情变化是3维人脸识别面临的主要问题。为克服表情影响,提出了一种基于面部轮廓线对表情鲁棒的3维人脸识别方法。方法首先,对人脸进行预处理,包括人脸区域切割、平滑处理和姿态归一化,将所有的人脸置于姿态坐标系下;然后,从3维人脸模型的半刚性区域提取人脸多条垂直方向的轮廓线来表征人脸面部曲面;最后,利用弹性曲线匹配算法计算不同3维人脸模型间对应的轮廓线在预形状空间(preshape space)中的测地距离,将其作为相似性度量,并且对所有轮廓线的相似度向量加权融合,得到总相似度用于分类。结果在FRGC v2.0数据库上进行识别实验,获得97.1%的Rank-1识别率。结论基于面部轮廓线的3维人脸识别方法,通过从人脸的半刚性区域提取多条面部轮廓线来表征人脸,在一定程度上削弱了表情的影响,同时还提高了人脸匹配速度。实验结果表明,该方法具有较强的识别性能,并且对表情变化具有较好的鲁棒性。     

基于Bit平面和广义PCA的人脸识别

提出了一种结合Bit平面信息和广义PCA进行人脸识别的新算法。利用人脸图像的Bit平面信息，经特征融合来构造新的人脸，在此基础上再进行广义PCA分析。实验表明，该文提出的方法不仅能提高人脸的识别率，而且在人脸特征空间的维数较低时，识别率已经达到稳定。