一种基于同态滤波器与Radon变换的光照不变人脸识别方法

为了减轻光照变化对人脸识别精度的影响,提出了一种结合同态滤波器与Radon变换的人脸识别方法。首先用高斯同态滤波器对人脸图像进行处理,然后进行Radon变换,将变换得到的Radon特征用2DPCA/2DLDA进行降维。在Yale和PIE人脸数据库上的实验结果表明,提出的方法在光照变化较大时,其识别精度远高于2DPCA和2DLDA,是一种高精度的人脸识别算法。     

Illumination invariant face recognition

The appearance of a face will vary drastically when the illumination changes. Variations in lighting conditions make face recognition an even more challenging and difficult task. In this paper, we propose a novel approach to handle the illumination problem. Our method can restore a face image captured under arbitrary lighting conditions to one with frontal illumination by using a ratio-image between the face image and a reference face image, both of which are blurred by a Gaussian filter. An iterative algorithm is then used to update the reference image, which is reconstructed from the restored image by means of principal component analysis (PCA), in order to obtain a visually better restored image. Image processing techniques are also used to improve the quality of the restored image. To evaluate the performance of our algorithm, restored images with frontal illumination are used for face recognition by means of PCA. Experimental results demonstrate that face recognition using our method can achieve a higher recognition rate based on the Yale B database and the Yale database. Our algorithm has several advantages over other previous algorithms: (1) it does not need to estimate the face surface normals and the light source directions, (2) it does not need many images captured under different lighting conditions for each person, nor a set of bootstrap images that includes many images with different illuminations, and (3) it does not need to detect accurate positions of some facial feature points or to warp the image for alignment, etc.     

可变光照条件下的人脸图像识别

对于人脸图像识别中光照变化的影响,传统的解决方法是对待识别图像进行光照补偿,先使它成为标准光照条件下的图像,然后和模板图像匹配来进行识别。为了提高在光照条件大范围变化时,人脸图像的识别率,提出了一种新的可变光照条件下的人脸图像识别方法。该方法首先利用在9个基本光照方向下分别获得的9幅图像来构成人脸光照特征空间,再通过这个光照特征空间,将图像库中的人脸图像变换成与待识别图像具有相同光照条件的图像,并将其作为模板图像;然后利用特征脸方法进行识别。实验结果表明,这种方法不仅能够有效地解决人脸识别中由于光照变化影响所造成的识别率下降的问题,而且对于光照条件大范围变化的情况,也可以得到比较高的正确识别率。     

Toward a practical face recognition system: robust alignment and illumination by sparse representation

Many classic and contemporary face recognition algorithms work well on public data sets, but degrade sharply when they are used in a real recognition system. This is mostly due to the difficulty of simultaneously handling variations in illumination, image misalignment, and occlusion in the test image. We consider a scenario where the training images are well controlled and test images are only loosely controlled. We propose a conceptually simple face recognition system that achieves a high degree of robustness and stability to illumination variation, image misalignment, and partial occlusion. The system uses tools from sparse representation to align a test face image to a set of frontal training images. The region of attraction of our alignment algorithm is computed empirically for public face data sets such as Multi-PIE. We demonstrate how to capture a set of training images with enough illumination variation that they span test images taken under uncontrolled illumination. In order to evaluate how our algorithms work under practical testing conditions, we have implemented a complete face recognition system, including a projector-based training acquisition system. Our system can efficiently and effectively recognize faces under a variety of realistic conditions, using only frontal images under the proposed illuminations as training.     

Multiscale facial structure representation for face recognition under varying illumination

Facial structure of face image under lighting lies in multiscale space. In order to detect and eliminate illumination effect, a wavelet-based face recognition method is proposed in this paper. In this work, the effect of illuminations is effectively reduced by wavelet-based denoising techniques, and meanwhile the multiscale facial structure is generated. Among others, the proposed method has the following advantages: (1) it can be directly applied to single face image, without any prior information of 3D shape or light sources, nor many training samples; (2) due to the multiscale nature of wavelet transform, it has better edge-preserving ability in low frequency illumination fields; and (3) the parameter selection process is computationally feasible and fast. Experiments are carried out upon the Yale B and CMU PIE face databases, and the results demonstrate that the proposed method achieves satisfactory recognition rates under varying illumination conditions.     

Face recognition under arbitrary illumination using illuminated exemplars

Recently, the importance of face recognition has been increasingly emphasized since popular CCD cameras are distributed to various applications. However, facial images are dramatically changed by lighting variations, so that facial appearance changes caused serious performance degradation in face recognition. Many researchers have tried to overcome these illumination problems using diverse approaches, which have required a multiple registered images per person or the prior knowledge of lighting conditions. In this paper, we propose a new method for face recognition under arbitrary lighting conditions, given only a single registered image and training data under unknown illuminations. Our proposed method is based on the illuminated exemplars which are synthesized from photometric stereo images of training data. The linear combination of illuminated exemplars can represent the new face and the weighted coefficients of those illuminated exemplars are used as identity signature. We make experiments for verifying our approach and compare it with two traditional approaches. As a result, higher recognition rates are reported in these experiments using the illumination subset of Max-Planck Institute face database and Korean face database.     

Face recognition under varying illumination

To eliminate the effects of illumination variation, the conventional approaches firstly produce a compensation-based face image under standard illumination from the input image and then match the image with the face templates in a database. This method is not inapplicable to the input image with large illumination variation. Therefore, a novel method for varying illumination conditions is proposed. Firstly, the quotient image method is improved. Then, the nine basis images of each subject are generated by the improved quotient image method. Thirdly, one new image of each subject under the same lighting conditions with an input image is synthesized by the corresponding basis images. Finally, the synthetic images and the input image are projected to PCA plane to fulfill the recognition task. The experimental results show that the proposed approach can eliminate the effects of illumination variation and have a high recognition rate in the illumination conditions with remarkable changes.     

基于球面谐波基图像的任意光照下的人脸识别

提出了一种基于球面谐波基图像的光照补偿算法,用以在任意光照条件下进行人脸识别.算法分两步进行：光照估计和光照补偿.基于人脸形状大致相同和每个人脸的反射率基本相等的假设,首先估计了输入人脸图像光照的9个低频谐波系数.根据光照估计的结果,提出了两种光照补偿方法：纹理图像和差图像.纹理图像为输入图像与其光照辐照图之商,与输入图像的光照条件无关.差图像为输入图像与平均人脸在相同光照下的图像之差,通过减去平均人脸在相同光照下的图像,减弱了光照的影响.在CMU-PIE人脸库和Yale B人脸库上的实验表明,通过光照补偿,不同光照下人脸图像识别率有了很大提高.     

High-speed face recognition using self-adaptive radial basis function neural networks

In this work, we have proposed a self-adaptive radial basis function neural network (RBFNN)-based method for high-speed recognition of human faces. It has been seen that the variations between the images of a person, under varying pose, facial expressions, illumination, etc., are quite high. Therefore, in face recognition problem to achieve high recognition rate, it is necessary to consider the structural information lying within these images in the classification process. In the present study, it has been realized by modeling each of the training images as a hidden layer neuron in the proposed RBFNN. Now, to classify a facial image, a confidence measure has been imposed on the outputs of the hidden layer neurons to reduce the influences of the images belonging to other classes. This process makes the RBFNN as self-adaptive for choosing a subset of the hidden layer neurons, which are in close neighborhood of the input image, to be considered for classifying the input image. The process reduces the computation time at the output layer of the RBFNN by neglecting the ineffective radial basis functions and makes the proposed method to recognize face images in high speed and also in interframe period of video. The performance of the proposed method has been evaluated on the basis of sensitivity and specificity on two popular face recognition databases, the ORL and the UMIST face databases. On the ORL database, the best average sensitivity (recognition) and specificity rates are found to be 97.30 and 99.94%, respectively using five samples per person in the training set. Whereas, on the UMIST database, the above quantities are found to be 96.36 and 99.81%, respectively using eight samples per person in the training set. The experimental results indicate that the proposed method outperforms some of the face recognition approaches.     

Robust face recognition using generalized neural reflectance model

A generalized neural reflectance (GNR) model for enhancing face recognition under variations in illumination and posture is presented in this paper. Our work is based on training a number of synthesis images of each face taken at single lighting direction with frontal/posture view. This way of synthesizing images can be used to build training cases for each face under different known illumination conditions from which face recognition can be significantly improved. However, reconstructing face shape may not easily be achieved and the human face images usually form by highly complex structure which suffers from strong specular and unknown reflective conditions. In this paper, these limitations are addressed by Cho and Chow (IEEE Trans Neural Netw 12(5):1204–1214, 2002). Face surfaces are recovered by this GNR model and face images in different poses are synthesized to create a database for training. Our training algorithm assigns to recognize the face identity by similarity measure on face features extracting first by the principle component analysis (PCA) method and then further processing by the Fisher’s discrimination analysis (FDA) to acquire lower dimensional patterns. Experimental results conducted on the Yale Face Database B show that lower error rates of classification and recognition are achieved under different variations in lighting and pose and the performance significantly outperforms the recognition without using the proposed GNR model.     

结构化低秩字典学习的人脸识别

目的 现实中采集到的人脸图像通常受到光照、遮挡等环境因素的影响,使得同一类的人脸图像具有不同程度的差异性,不同类的人脸图像又具有不同程度的相似性,这极大地影响了人脸识别的准确性。为了解决上述问题对人脸识别造成的影响,在低秩矩阵恢复理论的基础上提出了具有识别力的结构化低秩字典学习的人脸识别算法。方法 该算法基于训练样本的标签信息将低秩正则化以及结构化稀疏同时引入到学习的具有识别力的字典上。在字典学习过程中,首先利用样本的重建误差约束样本与字典之间的关系;其次将Fisher准则应用到稀疏编码过程中,使其编码系数具有识别能力;由于训练样本中的噪声信息会影响字典的识别力,所以在低秩矩阵恢复理论的基础上将低秩正则化应用到字典学习过程中;接着,在字典学习过程中加入了结构化稀疏使其不丢失结构信息以保证对样本进行最优分类;最后再利用误差重构法对测试样本进行分类识别。结果 本文算法在AR以及ORL人脸数据库上分别进行了实验仿真。在AR人脸数据库中,为了分析样本不同维数对实验结果造成的影响,选取了第一时期拍摄的每人6幅图像,包括1幅围巾遮挡,2幅墨镜遮挡以及3幅脸部表情变化以及光照变化（未被遮挡）的图像作为训练样本,同时选取相同组合的样本图像作为测试样本,无论哪种方法,图像的维度越高识别率越高。对比SRC （sparse representation based on classification）算法与DKSVD （discriminative K-means singular value decomposition）算法的识别率可知,DKSVD算法通过字典学习减缓了训练样本中的不确定因素对识别结果的影响;对比DLRD_SR （discriminative low-rank dictionary learning for sparse representation）算法与FDDL （Fisher discriminative dictionary learning）算法的识别率可知,当图像有遮挡等噪声信息存在时,字典低秩化可以提高至少5.8%的识别率;对比本文算法与DLRD_SR算法可知,在字典学习的过程中加入Fisher准则后识别率显著提高,同时理想稀疏值能保证对样本进行最优的分类。当样本图像的维度达到500维时人脸图像在有围巾、墨镜遮挡的情况下识别率可达到85.2%;其中墨镜和围巾的遮挡程度分别可以看成是人脸图像的20%和40%,为了验证本文算法在不同脸部表情变化、光照改变以及遮挡情况下的有效性,根据训练样本的具体图像组合情况进行实验。无论哪种样本图像组合,本文算法在有遮挡存在的样本识别中具有显著优势。在训练样本只包含脸部表情变化、光照变化以及墨镜遮挡图像的情况下,本文算法的识别率高于其他算法至少2.7%,在训练样本只包含脸部表情变化、光照变化以及围巾遮挡图像的情况下,本文算法的识别率高于其他算法至少3.6%,在训练样本包含脸部表情变化、光照变化、围巾遮挡以及墨镜遮挡图像的情况下,其识别率高于其他算法至少1.9%。在ORL人脸数据库中,人脸图像在无遮挡的情况下识别率达到95.2%,稍低于FDDL算法的识别率;在随机块遮挡程度达到20%时,相比较于SRC算法、DKSVD算法、FDDL算法以及DLRD_SR算法,本文算法的识别率最高;当随机块遮挡程度达到50%时,以上算法的识别率均不高,但本文算法的其识别率仍然最高。结论 本文算法在人脸图像受到遮挡等因素的影响时具有一定的鲁棒性,实验结果表明该算法在人脸识别方面具有可行性。     

Face relighting using discriminative 2D spherical spaces for face recognition

As part of the face recognition task in a robust security system, we propose a novel approach for the illumination recovery of faces with cast shadows and specularities. Given a single 2D face image, we relight the face object by extracting the nine spherical harmonic bases and the face spherical illumination coefficients by using the face spherical spaces properties. First, an illumination training database is generated by computing the properties of the spherical spaces out of face albedo and normal values estimated from 2D training images. The training database is then discriminately divided into two directions in terms of the illumination quality and light direction of each image. Based on the generated multi-level illumination discriminative training space, we analyze the target face pixels and compare them with the appropriate training subspace using pre-generated tiles. When designing the framework, practical real-time processing speed and small image size were considered. In contrast to other approaches, our technique requires neither 3D face models nor restricted illumination conditions for the training process. Furthermore, the proposed approach uses one single face image to estimate the face albedo and face spherical spaces. In this work, we also provide the results of a series of experiments performed on publicly available databases to show the significant improvements in the face recognition rates.     

多姿态人脸照片的姿态估计

提出了一种基于面部图像的新的匹配系统。在这个系统中,输入的图像与各种人脸姿态的数据库图像进行比较,然后,匹配的图像给出了人脸姿态。图像数据库不仅包括各种人脸姿态,而且也包括不同的光照条件,如此,这个人脸姿态评价系统适用于不同的光照条件。对于收集各种不同面部图像,这里是通过计算机自动产生,而不是拍摄实际的照片。特征空间方法被用于寻找与输入面部图像匹配的图像。因为不同的光照图像被收集在面部图像数据库中,故提取的主特征向量主要依靠人脸姿态。由于通过选用主特征向量而减少了向量的维数,故这个匹配过程是很快的。这个姿态评价系统能够继续跟踪在不同的光照条件下不同人的人脸姿态。     

基于图像引导滤波的人脸光照预处理算法

针对人脸识别中人脸图像光照预处理的问题,提出一种基于图像引导滤波的人脸光照预处理算法。根据自定义光照标准函数对引导图像和输入图像进行分类,经指数或对数非线性变换调整后进行直方图均衡化处理。采用图像引导滤波对图像细节进行增强,使变换后的图像更清晰。利用空域高通滤波来抑制局部锐化现象。在YaleB人脸数据库上进行验证,结果表明,该算法在识别性能上明显优于经典的主成分分析法,识别率可以提高2%~8%。     

基于FABEMD的变化光照下人脸识别方法

在光照变化的环境下,人脸识别因受到光照强度和方向的非线性干扰而变得困难重重。在人脸局部区域,光照的变化比较缓慢,而皮肤对光照的反射率特征变化比较快,可以认为光照变化是低频信号,而人脸本质特征是高频信号。FABEMD是一种快速自适应的BEMD（Bidimensional Empirical Mode Decomposition,二维经验模式分解）方法,它能够将图像分解为不同尺度的高频图像和低频图像,高频图像代表了人脸皮肤细节纹理特征,而低频图像则代表了轮廓特征。但是并不能定量判别什么样的高频信号以及多少高频信号能够用来消除光照影响,所以提出了两种衡量高频细节信息量的方法,将这些信息量的相对值来推算融合不同尺度的高频信号权重系数。基于Yale B人脸数据库的实验数据证明了所提方法能够取得很好的识别效果。     

复杂光照条件下的人脸预处理算法

为了提高光照条件下的人脸识别正确率,提出一种复杂光照条件下的人脸预处理算法。对人脸图像进行局部增强处理,用双边滤波对图像亮度进行估计,采用Gamma校正补偿图像亮度估计产生的损失,将反射分量与亮度估计结果融合获得效果更优的人脸图像,并用K近邻算法建立分类器对人脸进行识别。在Yale、PIE和AR人脸库仿真结果表明,该算法提高了光照条件下的人脸识别正确率,其性能优于当前典型人脸识别算法。     

Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics

In this paper, we propose two novel methods for face recognition under arbitrary unknown lighting by using spherical harmonics illumination representation, which require only one training image per subject and no 3D shape information. Our methods are based on the result which demonstrated that the set of images of a convex Lambertian object obtained under a wide variety of lighting conditions can be approximated accurately by a low-dimensional linear subspace. We provide two methods to estimate the spherical harmonic basis images spanning this space from just one image. Our first method builds the statistical model based on a collection of 2D basis images. We demonstrate that, by using the learned statistics, we can estimate the spherical harmonic basis images from just one image taken under arbitrary illumination conditions if there is no pose variation. Compared to the first method, the second method builds the statistical models directly in 3D spaces by combining the spherical harmonic illumination representation and a 3D morphable model of human faces to recover basis images from images across both poses and illuminations. After estimating the basis images, we use the same recognition scheme for both methods: we recognize the face for which there exists a weighted combination of basis images that is the closest to the test face image. We provide a series of experiments that achieve high recognition rates, under a wide range of illumination conditions, including multiple sources of illumination. Our methods achieve comparable levels of accuracy with methods that have much more onerous training data requirements. Comparison of the two methods is also provided.     

基于虚拟样本的改进人脸识别算法研究及应用

针对实际采集的视频中背景复杂,人物多变,图像处理时间长,训练样本不足的问题,提出了构造虚拟样本,并结合Gabor滤波器及对PCA-LDA算法加以改进的人脸识别算法,以应用于教室点名系统。首先对教室采集到的视频进行裁剪,按帧截取并检测出含有人脸的部分图像并单独保存为测试图像,然后将其与已有人脸库里的训练图像进行对比,最后采用提出的镜像法构造虚拟样本,并结合了Gabor滤波器以及PCNN灰度图像增强处理算法的改进PCA-LDA算法进行人脸识别。仿真实验表明,提出的算法预测了样本可能存在的变化,也在一定程度上降低了计算复杂度,明显地提高了识别率,并在教室点名系统中得到了较好的验证。     

可变光照条件下的人脸识别

主要解决人脸识别中因光照变化导致误识或者拒识的问题。使用DOG（高斯差分变换）对原始人脸图像样本集（A）进行处理,将滤波后的人脸图像样本集（B）加入到原始样本集（A）中,采用了新的方法将样本集A和B进行融合,则既对极端光照条件下人脸图像进行了矫正,又不影响正常光照条件下的人脸识别。在分类阶段,引入了SRC（Sparse Representation Classification）分类器代替传统分类器,提升了在低错误接收率下的识别率,改善因光照剧烈变换而导致的无法识别或者误识的情况。在公开人脸库Yale-B、CMU-PIE以及ORL上的实验结果表明,该方法在不同光照条件下可以提高识别率,改善拒识和误识情况。     

Gabor相位特征的人脸光照不变量提取

为了消除光照变化对人脸识别的影响,提出一种基于Gabor相位特征的光照不变量提取算法。该算法首先对图像进行光照归一化,一定程度上减弱了不同光照条件的影响;然后利用一组不同方向的2维实Gabor小波对图像进行变换,在兼顾频谱与相位信息的情况下组合变换后的Gabor系数,提取其相位特征,得到光照不变量。在Yale B和CMU PIE人脸库上的实验结果表明,该算法能够有效消除光照变化对人脸识别的影响,提取的光照不变量具有一定的鲁棒性。