Face recognition under varying illumination based on a 2D face shape model

This paper proposes a novel illumination compensation algorithm, which can compensate for the uneven illuminations on human faces and reconstruct face images in normal lighting conditions. A simple yet effective local contrast enhancement method, namely block-based histogram equalization (BHE), is first proposed. The resulting image processed using BHE is then compared with the original face image processed using histogram equalization (HE) to estimate the category of its light source. In our scheme, we divide the light source for a human face into 65 categories. Based on the category identified, a corresponding lighting compensation model is used to reconstruct an image that will visually be under normal illumination. In order to eliminate the influence of uneven illumination while retaining the shape information about a human face, a 2D face shape model is used. Experimental results show that, with the use of principal component analysis for face recognition, the recognition rate can be improved by 53.3% to 62.6% when our proposed algorithm for lighting compensation is used.     

基于有效光照估计的复杂光照人脸识别

基于光照估计的光照不变量提取是提高复杂光照人脸识别性能的一种有效方法。以往算法仅考虑光照缓慢变化特性从人脸图像中估计光照,无法获取准确的光照和光照不变量。综合考虑图像的成像原理、光照缓慢变化特性和复杂照明环境,结合图像融合和平滑滤波,提出一种有效的人脸图像光照估计、光照不变量提取方法。所提算法能较好地处理阴影边缘问题,提取含有丰富面部细节特征、更接近于人脸本征的光照不变量。复杂光照Yale B+和CAS-PEAL-R1人脸库上的实验结果表明所提算法具有高效性。     

基于球面谐波基图像的任意光照下的人脸识别

提出了一种基于球面谐波基图像的光照补偿算法,用以在任意光照条件下进行人脸识别.算法分两步进行：光照估计和光照补偿.基于人脸形状大致相同和每个人脸的反射率基本相等的假设,首先估计了输入人脸图像光照的9个低频谐波系数.根据光照估计的结果,提出了两种光照补偿方法：纹理图像和差图像.纹理图像为输入图像与其光照辐照图之商,与输入图像的光照条件无关.差图像为输入图像与平均人脸在相同光照下的图像之差,通过减去平均人脸在相同光照下的图像,减弱了光照的影响.在CMU-PIE人脸库和Yale B人脸库上的实验表明,通过光照补偿,不同光照下人脸图像识别率有了很大提高.     

基于总变分模型的光照不变人脸识别算法

提出了一种基于L1总变分模型的对数商图像光照不变人脸识别算法。用L1总变分模型作为低通滤波算子对图像平滑滤波,得到图像光照分量的估计,然后在对数域中定义原图像与其光照分量的商为光照归一化图像,并用该图像作为光照不变量进行人脸识别。基于L1总变分模型的平滑滤波具有较好的边缘保持作用,能有效地消除光晕现象,并且参数设置简单。在YaleB和CMU PIE 人脸图像库上的试验结果表明,该算法能有效地提高人脸识别系统在不同光照条件下的识别率。     

Face recognition under arbitrary illumination using illuminated exemplars

Recently, the importance of face recognition has been increasingly emphasized since popular CCD cameras are distributed to various applications. However, facial images are dramatically changed by lighting variations, so that facial appearance changes caused serious performance degradation in face recognition. Many researchers have tried to overcome these illumination problems using diverse approaches, which have required a multiple registered images per person or the prior knowledge of lighting conditions. In this paper, we propose a new method for face recognition under arbitrary lighting conditions, given only a single registered image and training data under unknown illuminations. Our proposed method is based on the illuminated exemplars which are synthesized from photometric stereo images of training data. The linear combination of illuminated exemplars can represent the new face and the weighted coefficients of those illuminated exemplars are used as identity signature. We make experiments for verifying our approach and compare it with two traditional approaches. As a result, higher recognition rates are reported in these experiments using the illumination subset of Max-Planck Institute face database and Korean face database.     

A hybrid method based on dynamic compensatory fuzzy neural network algorithm for face recognition

Human face recognition skills can make simultaneous use of a variety of information from the face, including information about the age, sex, race, identity, and even current mood of the person. In this paper, a hybrid method combined Eigenface-LDA with Dynamic Compensatory Fuzzy Neural Network (DCFNN) is proposed for face recognition. Eigenfaces-LDA algorithm is used for face image of dimensionality reduction and finding a best subspace for classification, the extracted feature will be considered as the input of DCFNN. An improved Dynamic Fuzzy Neural Network is proposed by combing Dynamic Fuzzy Neural Network and Compensatory Fuzzy Neural Network to solve the problem of feature classification. The proposed method has been tested on ORL and Yale face database; the experimental results show that our method can reduce the dimension of facial features well and recognize faces that under different illumination, pose and expression accurately.     

有效用于人脸识别的光照不变特征表示算法

在光照变化环境下,人脸识别的鲁棒性是人脸识别系统中一大挑战。针对光照变化对人脸识别的影响,对经典光照不变特征表示算法进行了研究,提出一种基于局部标准差光照不变的人脸特征表示算法及其加权形式。结合完备线性鉴别分析（Complete-Linear Discriminant Analysis,C-LDA）算法提取特征,在Extended Yale-B与YALE 人脸库中,与其他处理光照变化的经典方法相比,如多尺度Retinex（Multi Scale Retinex,MSR）、韦伯脸（Weber-Face,WF）和局部归一化（Local Normalization,LN）,提出的算法能获得更高识别率。     

一种光照不变人脸识别的预处理算法

提出了一种新的光照不变人脸识别的图像预处理算法称为分段局部归一化方法(SLN)。其思想是对图像像素分段,使得每段中各像素对应的物体表面点具有相近的表面法向量分布,因而对光源具有相似的灰度响应,然后局部归一化在各段中进行以削弱光照影响。该算法首先建立物体的朗伯(Lambert)表面反射模型,用奇异值分解方法估计出人脸形状的平均表面法向量分布矩阵,根据法向量方向利用聚类算法对像素进行分段,然后在各段中进行局部的像素归一化处理,最后传统的人脸识别算法如PCA在归一化后的图像中进行。在Harvard和YaleB人脸图像库中的识别试验表明,该算法能有效地提高在非均匀光照条件下的人脸识别率。     

一种基于AdaBoost的人脸检测算法

针对常规基于肤色检测的AdaBoost算法的不足, 提出了一种改进的AdaBoost人脸检测算法,算法包括人体肤色模型、人脸运动检测模型、改进的背景提取方法、针对人脸区域的光照增强方法。算法综合利用了人体肤色信息和人脸运动信息,能有效缩小搜索范围。实验结果表明,该方法与常规基于肤色检测的AdaBoost方法相比,在保证检测性能的基础上,有效提高了检测速度。     

Illumination invariant extraction for face recognition using neighboring wavelet coefficients

The features of a face can change drastically as the illumination changes. In contrast to pose position and expression, illumination changes present a much greater challenge to face recognition. In this paper, we propose a novel wavelet based approach that considers the correlation of neighboring wavelet coefficients to extract an illumination invariant. This invariant represents the key facial structure needed for face recognition. Our method has better edge preserving ability in low frequency illumination fields and better useful information saving ability in high frequency fields using wavelet based NeighShrink denoise techniques. This method proposes different process approaches for training images and testing images since these images always have different illuminations. More importantly, by having different processes, a simple processing algorithm with low time complexity can be applied to the testing image. This leads to an easy application to real face recognition systems. Experimental results on Yale face database B and CMU PIE Face Database show that excellent recognition rates can be achieved by the proposed method.     

Gabor相位特征的人脸光照不变量提取

为了消除光照变化对人脸识别的影响,提出一种基于Gabor相位特征的光照不变量提取算法。该算法首先对图像进行光照归一化,一定程度上减弱了不同光照条件的影响;然后利用一组不同方向的2维实Gabor小波对图像进行变换,在兼顾频谱与相位信息的情况下组合变换后的Gabor系数,提取其相位特征,得到光照不变量。在Yale B和CMU PIE人脸库上的实验结果表明,该算法能够有效消除光照变化对人脸识别的影响,提取的光照不变量具有一定的鲁棒性。     

基于几何模型的单幅人脸图像光照补偿方法

为减少光照对人脸识别的影响,本文提出了一种以补偿角度和（Sum of Compensated Angle）为不变量的光照补偿新方法. 首先,补偿角度和是临界补偿状态下两幅图像的光照角度之和. 对某单光源系统,该不变量仅由光照系统决定且为定值. 其次,根据人类头骨在法兰克福截面的形状特性,我们提出了包含人头骨结构的几何人脸光照模型. 据此模型,补偿角度由不变量和待补偿图像的光照角度计算得出,从而将光照补偿转化为简单加法操作. 最后,在Yale B人脸数据库上的补偿结果表明了算法的有效性. 较Sang-Ⅱ Choi的方法显著地提高了大角度下的补偿效果,且在水平和竖直方向上更加鲁棒.     

改进的自商图算法

针对人脸识别中的光照变化问题,提出一种改进的自商图算法。对光照图像进行伽玛变换,使用非下采样轮廓波变换对图像进行多尺度多方向分析,对各方向子带进行Wiener滤波,利用自商图模型提取人脸图像的光照不变特性。Yale B与CMU PIE人脸库上的实验结果表明,与传统算法相比,该算法的平均识别率更高。     

基于随机投影与加权稀疏表示残差的光照鲁棒人脸识别方法

针对人脸识别中的光照变化问题,利用随机投影对传统稀疏表示分类器进行改进,提出一种基于随机投影与加权稀疏表示残差的光照鲁棒人脸识别方法。通过对人脸图像进行光照规范化处理,尽量消除人脸图像上的恶劣光照,取得经光照校正的人脸样本后进行多次随机空间投影,进一步丰富样本的光照不变特征,以减小光照变化对人脸识别带来的影响。在此基础上,对利用单一残差分类的传统稀疏表示分类方法进行改进,样本经过多次随机投影和稀疏表示会产生多个样本特征和重构残差,利用样本特征的能量来确定各个重构残差的融合权值,最终得到一种稳定性和可靠性更强的加权残差。在 Yale B 和 CMU PIE 两个光照变化较大的人脸库上的实验结果表明,改进的方法具有较强的光照鲁棒性。与传统稀疏表示方法相比,本文提出的方法在Yale B人脸库上两组实验的平均识别率分别提高了25.76%和46.39%,在CMU PIE上的平均识别率提高了10%左右。     

基于小波变换和去噪模型的光照不变人脸识别

针对正面光照人脸识别的难点,提出了一种应用小波变换和去噪模型的光照不变人脸识别算法。利用对图像的高频小波系数进行处理并运用去噪模型,提取光照人脸图像中的光照不变量,同时增强图像边缘特征,这有利于提取的光照不变量保持更多的人脸识别信息。在Yale B和CMU PIE人脸库上的实验结果表明,所提算法可以显著提高光照人脸图像的识别率。     

A twice face recognition algorithm

The theory of compressive sensing applies the sparse representation to the extraction of useful information from signals and brings a breakthrough to the theory of signal sampling. Based on compressive sensing, sparse representation-based classification (SRC) is proposed. SRC uses the compressibility of the image data to represent the facial image sparsely and could solve the problems of both massive calculation and information loss in dealing with signals. SRC does not, however, deal with the effects of variable illumination, posture and incomplete face image, which could result in severe performance degradation. This paper studies the differences between SRC recognition and human recognition. We find that there is an obvious disadvantage in the SRC algorithm, and it will significantly affect the face recognition performance in actual environment, especially for the variable illumination, posture and incomplete face image. To overcome the disadvantage of SRC algorithm, we propose an SRC-based twice face recognition algorithm named T_SRC. T_SRC uses bidirectional PCA, linear discriminant analysis and GradientFace to execute multichannel analysis, which could extract more “holistic/configural” face features in actual environment than by using SRC algorithm directly. Based on the multichannel analysis, we identify the test image by SRC firstly. Then, by analyzing the residual, this algorithm could decide whether the twice recognition is needed. If the twice recognition is needed, T_SRC extracts the facial details (“featural” face features) by the improved Harris point and Gabor filter detector. We suppose that the facial details are more stable than the whole face in actual environment, and later experiments verify our assumption. At last, this algorithm identifies the class of the test image by SRC again. The results of the experiments prove that the T_SRC algorithm has better recognition rate than SRC.     

New MCT-based face recognition under varying lighting conditions

This paper presents a new face recognition algorithm that is insensitive to variations in lighting conditions. In the proposed algorithm, the MCT (Modified Census Transform) was embedded to extract the local facial features that are invariant under illumination changes. In this study, we also employed an appearance-based method to incorporate both local and global features. First, input facial images are transformed by the MCT and a bit string from the MCT is converted to a decimal number to generate an MCT domain image. This domain image is recognized using principle component analysis (PCA) or linear discriminate analysis (LDA). Experimental results reveal that the recognition rate of the proposed approach is better than that of conventional appearance-based algorithms by approximately 20% for the Yale B database, in the case of severe variations in illumination conditions. We also found that the proposed algorithm yields better performance for the Yale database for various face expressions, eye-wear, and lighting conditions.     

复杂光照环境下视频人脸序列的自动检测方法

基于视频序列人脸自动检测是人脸跟踪、识别等研究的基础。提出了一种结合图像增强技术、gabor特征变 换和adaboost算法的视频序列人脸检测方法,其主要思想是使用图像增强技术对图像进行光照补偿,减轻不同的光 照条件(如局部的阴影和高亮等)对检测结果的影响。该方法首先通过高频增强滤波强化图像的边缘和细节信息,用 基于直方图的技术来调节图像的亮度,然后应用gabor小波变换进行特征抽取,最后采用adaboost方法训练样本,完 成人脸的检测。实验表明,该方法能够在不同的光照条件下准确检测出人脸,显示出较强的鲁棒性。     

Elastic shape-texture matching for human face recognition

In this paper, a novel, elastic, shape-texture matching method, namely ESTM, for human face recognition is proposed. In our approach, both the shape and the texture information are used to compare two faces without establishing any precise pixel-wise correspondence. The edge map is used to represent the shape of an image, while the texture information is characterized by both the Gabor representations and the gradient direction of each pixel. Combining these features, a shape-texture Hausdorff distance is devised to compute the similarity of two face images. The elastic matching is robust to small, local distortions of the feature points such as those caused by facial expression variations. In addition, the use of the edge map, Gabor representations and the direction of the image gradient can all alleviate the effect of illumination to a certain extent.With different databases, experimental results show that our algorithm can always achieve a better performance than other face recognition algorithms under different conditions, except when an image is under poor and uneven illumination. Experiments based on the Yale database, AR database, ORL database and YaleB database show that our proposed method can achieve recognition rates of 88.7%, 97.7%, 78.3% and 89.5%, respectively.     

Illumination invariant face recognition using near-infrared images

Most current face recognition systems are designed for indoor, cooperative-user applications. However, even in thus-constrained applications, most existing systems, academic and commercial, are compromised in accuracy by changes in environmental illumination. In this paper, we present a novel solution for illumination invariant face recognition for indoor, cooperative-user applications. First, we present an active near infrared (NIR) imaging system that is able to produce face images of good condition regardless of visible lights in the environment. Second, we show that the resulting face images encode intrinsic information of the face, subject only to a monotonic transform in the gray tone; based on this, we use local binary pattern (LBP) features to compensate for the monotonic transform, thus deriving an illumination invariant face representation. Then, we present methods for face recognition using NIR images; statistical learning algorithms are used to extract most discriminative features from a large pool of invariant LBP features and construct a highly accurate face matching engine. Finally, we present a system that is able to achieve accurate and fast face recognition in practice, in which a method is provided to deal with specular reflections of active NIR lights on eyeglasses, a critical issue in active NIR image-based face recognition. Extensive, comparative results are provided to evaluate the imaging hardware, the face and eye detection algorithms, and the face recognition algorithms and systems, with respect to various factors, including illumination, eyeglasses, time lapse, and ethnic groups