视频中适应光照可变情况下的人脸识别方法

提出一种结合使用自适应直方图均衡(AHE)、Gabor滤波器及局部三值模式(LTP)描述器进行视频中上下左右和正面光照条件下识别人脸的方法。首先,使用AHE对来自YaleB与CMU-PIE数据库的人脸图片进行降噪处理。然后用Gabor滤波器进行卷积,提取出相应的Gabor特征图,针对每一个Gabor特征图利用LTP描述器提取出局部邻域关系模式。最后由这些模式的区域直方图形成的序列来描述人脸。YaleB人脸库以及CMUPIE人脸库验证该方法的有效性。     

Gabor wavelet associative memory for face recognition

This letter describes a high-performance face recognition system by combining two recently proposed neural network models, namely Gabor wavelet network (GWN) and kernel associative memory (KAM), into a unified structure called Gabor wavelet associative memory (GWAM). GWAM has superior representation capability inherited from GWN and consequently demonstrates a much better recognition performance than KAM. Extensive experiments have been conducted to evaluate a GWAM-based recognition scheme using three popular face databases, i.e., FERET database, Olivetti-Oracle Research Lab (ORL) database and AR face database. The experimental results consistently show our scheme's superiority and demonstrate its very high-performance comparing favorably to some recent face recognition methods, achieving 99.3% and 100% accuracy, respectively, on the former two databases, exhibiting very robust performance on the last database against varying illumination conditions.     

Elastic shape-texture matching for human face recognition

In this paper, a novel, elastic, shape-texture matching method, namely ESTM, for human face recognition is proposed. In our approach, both the shape and the texture information are used to compare two faces without establishing any precise pixel-wise correspondence. The edge map is used to represent the shape of an image, while the texture information is characterized by both the Gabor representations and the gradient direction of each pixel. Combining these features, a shape-texture Hausdorff distance is devised to compute the similarity of two face images. The elastic matching is robust to small, local distortions of the feature points such as those caused by facial expression variations. In addition, the use of the edge map, Gabor representations and the direction of the image gradient can all alleviate the effect of illumination to a certain extent.With different databases, experimental results show that our algorithm can always achieve a better performance than other face recognition algorithms under different conditions, except when an image is under poor and uneven illumination. Experiments based on the Yale database, AR database, ORL database and YaleB database show that our proposed method can achieve recognition rates of 88.7%, 97.7%, 78.3% and 89.5%, respectively.     

A novel illumination-robust face recognition using statistical and non-statistical method

This paper proposes a novel illumination-robust face recognition technique that combines the statistical global illumination transformation and the non-statistical local face representation methods. When a new face image with arbitrary illumination is given, it is transformed into a number of face images exhibiting different illuminations using a statistical bilinear model-based indirect illumination transformation. Each illumination transformed image is then represented by a histogram sequence that concatenates the histograms of the non-statistical multi-resolution uniform local Gabor binary patterns (MULGBP) for all the local regions. This is facilitated by dividing the input image into several regular local regions, converting each local region using several Gabor filters, and converting each Gabor filtered region image into multi-resolution local binary patterns (MULBP). Finally, face recognition is performed by a simple histogram matching process. Experimental results demonstrate that the proposed face recognition method is highly robust to illumination variation as exhibited in the real environment.     

Analysis of variance of Gabor filter banks parameters for optimal face recognition

Gabor filter banks constitute a very robust tool to extract discriminant information from a visual scene. After the now “classical” bank with 5 frequencies and 8 orientations proposed by Lades et al. and Wiskott et al., many other parametrizations of a Gabor filter bank have appeared. In order to find the optimal parametrization for a face recognition experiment, we have performed a 6-way analysis of variance of Gabor parameters using FERET, FRAV2D, FRAV3D, FRGC and XM2VTS face databases, including frontal and turned poses, facial expressions, occlusions and changes of illumination. Considering independent criteria to find the optimal Gabor filter bank, the bank with the highest recognition rate was found to have 6 frequencies and narrower Gaussian widths in the space domain. These results were obtained with Mahalanobis distance for a k-NN classifier, with analytical and holistic Gabor feature vectors. Moreover about 20% of the banks studied here obtained in average a better performance than the classical bank. For most of the databases considered, the highest recognition rates have been achieved with analytical representations (frontal images, images with turns or occlusions), with a holistic preponderance for images with gestures or changes of illumination. The inferiority found for holistic Gabor representations versus their analytical counterparts can be explained for the intrinsic redundancy and the size of the feature vectors of this kind of representation.     

基于局部Gabor变化直方图序列的人脸描述与识别

提出了一种在Gabor变换幅值域内提取局部变化模式空间直方图序列(histogram sequence of local Gabor binary patterns,简称HSLGBP)的人脸描述及其识别方法.鉴于Gabor特征对光照、表情等变化比较鲁棒,并已在人脸识别领域得到成功应用,首先对归一化的人脸图像进行多方向、多分辨率Gabor小波滤波,并提取其对应不同方向、不同尺度的多个Gabor幅值域图谱(Gabor magnitude map,简称GMM),然后在每个GMM上采用局部二值模式(local binary pattern,简称LBP)算子抽取局部邻域关系模式,最后由这些模式的区域直方图形成的序列来描述人脸.Gabor变换、LBP、空间区域直方图的采用使得该方法对光照变化、表情变化、误配准等具有良好的鲁棒性.而且,这种人脸建模方法不需要基于训练集合进行统计学习,因而不存在推广性问题.同时,进一步探讨了如何在分类器设计阶段与统计方法进行结合的问题,提出了统计Fisher加权的HSLGBP匹配方法.在通过FERET人脸库光照、表情和时间变化测试集上与已发表的实验结果进行对比,充分验证了该方法的有效性.     

Methodological improvement on local Gabor face recognition based on feature selection and enhanced Borda count

Face recognition has a wide range of possible applications in surveillance, human computer interfaces and marketing and advertising goods for selected customers according to age and gender. Because of the high classification rate and reduced computational time, one of the best methods for face recognition is based on Gabor jet feature extraction and Borda count classification. In this paper, we propose methodological improvements to increase face recognition rate by selection of Gabor jets using entropy and genetic algorithms. This selection of jets additionally allows faster processing for real-time face recognition. We also propose improvements in the Borda count classification through a weighted Borda count and a threshold to eliminate low score jets from the voting process to increase the face recognition rate. Combinations of Gabor jet selection and Borda count improvements are also proposed. We compare our results with those published in the literature to date and find significant improvements. Our best results on the FERET database are 99.8%, 99.5%, 89.2% and 86.8% recognition rates on the subsets Fb, Fc, Dup1 and Dup2, respectively. Compared to the best results published in the literature, the total number of recognition errors decreased from 163 to 112 (31%). We also tested the proposed method under illumination changes, occlusions with sunglasses and scarves and for small pose variations. Results on two different face databases (AR and Extended Yale B) with significant illumination changes showed over 90% recognition rate. The combination EJS-BTH-BIP reached 98% and 99% recognition rate in images with sunglasses and scarves from the AR database, respectively. The proposed method reached 93.5% recognition on faces with small pose variation of 25° rotation and 98.5% with 15% rotation in the FERET database.     

Gabor相位特征的人脸光照不变量提取

为了消除光照变化对人脸识别的影响,提出一种基于Gabor相位特征的光照不变量提取算法。该算法首先对图像进行光照归一化,一定程度上减弱了不同光照条件的影响;然后利用一组不同方向的2维实Gabor小波对图像进行变换,在兼顾频谱与相位信息的情况下组合变换后的Gabor系数,提取其相位特征,得到光照不变量。在Yale B和CMU PIE人脸库上的实验结果表明,该算法能够有效消除光照变化对人脸识别的影响,提取的光照不变量具有一定的鲁棒性。     

An SVM-AdaBoost facial expression recognition system

This study is focused on improving the recognition rate and processing time of facial recognition systems. First, the skin is detected by pixel based methods to reduce the searching space for maximum rejection classifier (MRC) which detects the face. The detected face is normalized by a discrete cosine transform (DCT) and down-sampled by Bessel transform. Gabor feature extraction techniques were utilized to extract thousands of facial features that represent facial deformation patterns. An AdaBoost-based hypothesis is formulated to select a few hundreds of Gabor features which are potential candidates for expression recognition. The selected features were fed into a saturated vector machine (SVM) classifier to train it. An average recognition rate of 97.57 % and 92.33 % are registered in JAFFE and Yale databases respectively. The execution time of the proposed method is also significantly lower than others. Generally, the proposed method exhibits superior performance than other methods.     

一种结合Gabor小波与深度学习的人脸识别方法

针对人脸识别中识别效果易受光照、姿态等因素影响和浅层学习方法不能有效提取人脸图像抽象特征的问题,提出一种结合Gabor小波与深度学习的人脸识别方法。该方法首先利用Gabor小波变换获取不同尺度和方向的人脸Gabor特征,通过下采样和受限玻尔兹曼机（RBM）对Gabor特征进行有效降维;其次将降维后的特征作为深度信念网络（DBN）的输入,并使用对比散度算法训练DBN;最后利用标签数据对DBN进行有监督微调,网络顶层附加Softmax分类器对提取后的特征进行分类。所提方法在ORL、UMIST和Yale-B人脸库上的识别率分别达到了98.72%、96.51%和96.13%,实验结果表明所提方法不仅识别效果明显优于其他现有方法,而且对光照、姿态变化具有很好的鲁棒性。     

Gabor特征集结合判别式字典学习的稀疏表示图像识别

稀疏编码中字典的选择无论对图像重建还是模式分类都有重要影响,为此提出Gabor特征集结合判别式字典学习的稀疏表示图像识别算法.考虑到Gabor局部特征对光照、表情和姿态等变化的鲁棒性,首先提取图像对应不同方向、不同尺度的多个Gabor特征;然后将降维的增广Gabor特征矩阵作为初始特征字典,通过对该字典的学习得到字典原子对应类别标签的新结构化字典,新字典中特定类的子字典对相关的类具有好的表示能力,同时应用Fisher判别约束编码系数,使它们具有小的类内散度和大的类间散度;最后同时用具有判别性的重构误差和编码系数来进行模式分类.基于3个数据库的实验结果表明本文方法具有可行性和有效性.     

基于多级Gabor变换序列特征的人脸识别

鉴于Gabor特征对光照、表情等变化具有鲁棒性,在寻找局部细节特征和全局轮廓特征的描述方面,提出一种基于多级局部多通道Gabor变换序列特征的人脸描述与识别方法。对人脸图像进行多级分块和对局部子块进行多方向、多分辨率Gabor小波滤波,并提取其对应不同方向、不同尺度的多个Gabor幅值域图谱(LGMM),将各级子图像的图谱LGMM进行连接后形成多级Gabor幅值域图谱,使用径向基网络对特征进行识别。对人脸库ORL和YEL的识别实验进行对比,结果验证了该方法的有效性。     

基于低秩子空间投影和Gabor特征的稀疏表示人脸识别算法

目前的人脸识别算法常常忽视训练过程中噪声的影响,特别是在训练数据和待测数据都受到噪声污染的情况下,识别性能会明显下降。针对含有光照变化、伪装、遮挡及表情变化等较大噪声的人脸识别问题,提出了一种基于低秩子空间投影和Gabor特征的稀疏表示人脸识别算法。该算法首先通过低秩矩阵恢复算法得到训练样本的潜在低秩结构和稀疏误差结构;然后利用主成分分析法找到低秩结构的Gabor特征所在低秩子空间的变换矩阵;再通过变换矩阵将所有样本的Gabor特征向量投影到低秩子空间上,在该低秩子空间上使用稀疏表示分类算法进行最终的分类识别。在Extend Yale B和AR数据库上的实验表明,新算法具有较高的识别率和较强的抗干扰能力。     

基于协作表示残差融合的3维人脸识别

目的 针对2维人脸难以克服光照、表情、姿态等复杂问题,提出了一种基于协作表示残差融合的新算法.方法 协作表示分类算法是将所有类的训练图像一起协作构成字典,通过正则化最小二乘法代替1范数求解稀疏系数,减小了计算的复杂度,由此系数重构测试人脸,根据重构误差最小原则,对测试人脸正确分类.该方法首先在3维人脸深度图上提取Gabor特征和Geodesic特征,然后在协作表示算法的基础上融合两者的残差信息,作为最终差异性度量,最后根据融合残差最小原则,进行人脸识别.结果 在不同的训练样本、特征维数条件下,在CIS和Texas 2 个人脸数据库上,本文算法的识别率可分别达到94.545%和99.286%.与Gabor-CRC算法相比,本文算法的识别率平均高出了10%左右.结论 在实时成像系统采集的人脸库和Texas 3维人脸库上的实验结果表明,该方法对有无姿态、表情、遮挡等变化问题具有较好的鲁棒性和有效性.     

HSR: <Emphasis Type="Italic">L</Emphasis><Subscript>1/2</Subscript>-regularized sparse representation for fast face recognition using hierarchical feature selection

In this paper, we propose a novel method for fast face recognition called L _1/2-regularized sparse representation using hierarchical feature selection. By employing hierarchical feature selection, we can compress the scale and dimension of global dictionary, which directly contributes to the decrease of computational cost in sparse representation that our approach is strongly rooted in. It consists of Gabor wavelets and extreme learning machine auto-encoder (ELM-AE) hierarchically. For Gabor wavelets’ part, local features can be extracted at multiple scales and orientations to form Gabor-feature-based image, which in turn improves the recognition rate. Besides, in the presence of occluded face image, the scale of Gabor-feature-based global dictionary can be compressed accordingly because redundancies exist in Gabor-feature-based occlusion dictionary. For ELM-AE part, the dimension of Gabor-feature-based global dictionary can be compressed because high-dimensional face images can be rapidly represented by low-dimensional feature. By introducing L _1/2 regularization, our approach can produce sparser and more robust representation compared to L ₁-regularized sparse representation-based classification (SRC), which also contributes to the decrease of the computational cost in sparse representation. In comparison with related work such as SRC and Gabor-feature-based SRC, experimental results on a variety of face databases demonstrate the great advantage of our method for computational cost. Moreover, we also achieve approximate or even better recognition rate.     

Palm vein recognition using adaptive Gabor filter

Vein pattern recognition is one of the newest biometric techniques researched today. One of the reliable and robust personal identification authentication approaches using palm vein patterns is presented in this paper. In our work, we consider the palm vein as a piece of texture and apply texture-based feature extraction techniques to palm vein authentication. A Gabor filter provides the optimized resolution in both the spatial and frequency domains, thus it is a basis for extracting local features in the palm vein recognition. However, Gabor filter has many potential parameter combinations to use, and it is a common practice now to use multiple Gabor filters or to determine desired single combination by experience. The overall aim of this work is to discuss the optimization algorithm that determines the best parameter values of a single Gabor filter for palm vein recognition. In order to obtain effective pattern of palm vascular, we proposed an innovative and robust adaptive Gabor filter method to encode the palm vein features in bit string representation. The bit string representation, called VeinCode, offers speedy template matching and enables more effective template storage and retrieval. The similarity of two VeinCodes is measured by normalized Hamming distance. A total of 4140 palm vein images were collected form 207 persons to verify the validity of the proposed palm vein recognition approach. High accuracy has been obtained by the proposed method and the speed of this method is rapid enough for real-time palm vein recognition. Experimental results demonstrate that our proposed approach is feasible and effective in palm vein recognition.     

基于多通道Gabor滤波和D-S证据理论的虹膜识别

为了提高虹膜识别的准确性和稳定性，研究了Gabor滤波的虹膜特征提取方法，并在此基础上对虹膜特征进行了D-S(Dempster-Shafer)证据理论的改进．提出了多通道Gabor滤波和D-S证据理论的虹膜识别方法．该方法充分考虑到虹膜图像获取中被考察对象的姿态和环境光照等不确定性因素对识别结果的影响，通过选择不同频率和方向的Gabor滤波器组，有效提取虹膜特征，并结合D-S证据理论实现了虹膜特征决策．实验结果表明，所提方法增强了虹膜识别过程中抵御图像噪声、干扰和亮度变化等不利因素的能力，与标准的Gabor方法相比，识别率平均提高了4.05%．     

Improved Face Representation by Nonuniform Multilevel Selection of Gabor Convolution Features

Gabor wavelets are widely employed in face representation to decompose face images into their spatial-frequency domains. The Gabor wavelet transform, however, introduces very high dimensional data. To reduce this dimensionality, uniform sampling of Gabor features has traditionally been used. Since uniform sampling equally treats all the features, it can lead to a loss of important features while retaining trivial ones. In this paper, we propose a new face representation method that employs nonuniform multilevel selection of Gabor features. The proposed method is based on the local statistics of the Gabor features and is implemented using a coarse-to-fine hierarchical strategy. Gabor features that correspond to important face regions are automatically selected and sampled finer than other features. The nonuniformly extracted Gabor features are then classified using principal component analysis and/or linear discriminant analysis for the purpose of face recognition. To verify the effectiveness of the proposed method, experiments have been conducted on benchmark face image databases where the images vary in illumination, expression, pose, and scale. Compared with the methods that use the original gray-scale image with 4096-dimensional data and uniform sampling with 2560-dimensional data, the proposed method results in a significantly higher recognition rate, with a substantial lower dimension of around 700. The experimental results also show that the proposed method works well not only when multiple sample images are available for training but also when only one sample image is available for each person. The proposed face representation method has the advantages of low complexity, low dimensionality, and high discriminance.     

Iris quality assessment and bi-orthogonal wavelet based encoding for recognition

Iris recognition has been demonstrated to be an efficient technology for personal identification. In this work, methods to perform iris encoding using bi-orthogonal wavelets and directional bi-orthogonal filters are proposed and compared. All the iris images are enhanced using the wavelet domain in-band de-noising method. This method is shown to improve the iris segmentation results. A framework to assess the iris image quality based on occlusion, contrast, focus and angular deformation is introduced and used as part of a novel adaptive matching technique based on the assessed iris image quality. Adaptive matching presents improved performance when compared against the Hamming distance method. Four different databases are used to analyze the system performance. The first two databases include popular CASIA and high resolution University of Bath databases. Results obtained for these databases compare with results from the literature, in terms of speed as well as accuracy. The other two databases have challenging off-angle (WVU database) and uncontrolled (Clarkson database) iris images and are used to assess the limits of system performance. Best results are achieved for directional bi-orthogonal filter based encoding technique combined with the adaptive matching method with EER values of 0.07%, 0.15%, 0.81% and 1.29% for the four databases, which reflect highly competent performance and high correlation with the quality of the iris images.