基于曲波变换和余弦测度的人脸识别方法

人脸识别是一种常用的生物特征识别技术,广泛应用于门禁考勤、公安司法等领域。光照、人脸表情与姿态、遮挡等采集条件的变化对 现有人脸识别方法 影响较大,限制了其应用。提出了一种基于曲波变换和余弦测度的人脸识别方法,以提高人脸识别对采集条件的鲁棒性。首先,对待识别人脸图像进行曲波变换,依据曲波系数检测人脸区域的关键点;然后,提取各关键点在不同尺度和方向上的曲波特征,构建人脸特征描述子;最后,依据余弦测度、累加和运算和极值运算求取人脸的最优匹配结果。仿真实验表明,所提方法对光照、姿态、表情和遮挡等变化的鲁棒性强,且识别性能好。     

VISA: a multimodal database of face and iris traits

In this paper, a new realistic and challenging Face-Iris multimodal biometric database called VISA database is described. One significant problem associated with the development and evaluation of multimodal biometric systems using face and iris biometric traits is the lack of publicly available multimodal databases that are acquired in an unconstrained environment. Currently, there exist no multimodal databases containing a sufficient number of common subjects involved in both face and iris data acquisition process under different conditions. The VISA database fulfills these requirements and it will be a useful tool for the design and development of new algorithms for developing multimodal biometric systems. The VISA iris images are acquired using the IriShield camera. Face images are captured using mobile device. The corpus of a new VISA database consists of face images that vary in expression, pose and illumination, and presence of occlusion whereas iris images vary in illumination, eye movement, and occlusion. A total of more than 5000 images of 100 subjects are collated and used to form the new database. The key features of the VISA dataset are the wide and diverse population of subjects (age and gender). The VISA database is able to support face and/or iris unimodal or multimodal biometric recognition. Hence, the VISA database is a useful addition for the purpose of research and development of biometric systems based on face and iris biometrics. This paper also describes the baseline results of state-of-the-art methods on the VISA dataset and other popular similar datasets. The VISA database will be made available to the public through https://vtu.ac.in/en/visa-multimodal-face-and-iris-biometrics-database/

     

联合Gabor误差字典和低秩表示的人脸识别算法

针对人脸图片的遮挡、伪装、光照及表情变化等问题,根据Gabor特征对遮挡、伪装、光照及表情变化有着更强的鲁棒性的特点,提出了联合Gabor误差字典和低秩表示的人脸识别算法(GDLRR)。首先对训练样本和测试样本分别进行Gabor特征提取,并将这些特征组成待测试的特征字典;然后将一个单位阵进行Gabor特征提取并训练成一个更紧凑的Gabor误差字典;最后联合Gabor误差字典和训练特征字典对测试特征字典进行低秩表示后进行分类识别。各类实验表明,提出的改进算法对人脸识别的各类问题都有着更强的鲁棒性和更高的识别准确率。     

Face Attribute Convolutional Neural Network System for Data Security with Improved Crypto Biometrics

Due to the enormous usage of the internet for transmission of data over a network, security and authenticity become major risks. Major challenges encountered in biometric system are the misuse of enrolled biometric templates stored in database server. To describe these issues various algorithms are implemented to deliver better protection to biometric traits such as physical (Face, fingerprint, Ear etc.) and behavioural (Gesture, Voice, tying etc.) by means of matching and verification process. In this work, biometric security system with fuzzy extractor and convolutional neural networks using face attribute is proposed which provides different choices for supporting cryptographic processes to the confidential data. The proposed system not only offers security but also enhances the system execution by discrepancy conservation of binary templates. Here Face Attribute Convolutional Neural Network (FACNN) is used to generate binary codes from nodal points which act as a key to encrypt and decrypt the entire data for further processing. Implementing Artificial Intelligence (AI) into the proposed system, automatically upgrades and replaces the previously stored biometric template after certain time period to reduce the risk of ageing difference while processing. Binary codes generated from face templates are used not only for cryptographic approach is also used for biometric process of enrolment and verification. Three main face data sets are taken into the evaluation to attain system performance by improving the efficiency of matching performance to verify authenticity. This system enhances the system performance by 8% matching and verification and minimizes the False Acceptance Rate (FAR), False Rejection Rate (FRR) and Equal Error Rate (EER) by 6 times and increases the data privacy through the biometric cryptosystem by 98.2% while compared to other work.     

一种新的低秩分块稀疏表示的人脸识别算法

针对 人脸图像中表情变化、遮挡、光照的问题,本文提出了一种新颖的基于低秩分块稀疏表示的 人脸识别算法。该算法采用了一种新的结构不相关的低秩矩阵恢复方法,同时采用离散余弦 变换方法联合处理人脸图像中遮挡、掩饰和光照的问题,对处理过的图片采用一种独特的重 叠分块方法,利用冗余信息有效地提高了算法的识别率。在分类阶段,利用Alignment pool ing的方法,有效地提高了识别速度。该算法在标准人脸数据库上进行了多次实验,实验结 果表明：与现有人脸识别算法相比,算法的识别准确率和计算效率都得到了一致提高。     

Feature selection for support vector machine-based face-iris multimodal biometric system

Multimodal biometric can overcome the limitation possessed by single biometric trait and give better classification accuracy. This paper proposes face-iris multimodal biometric system based on fusion at matching score level using support vector machine (SVM). The performances of face and iris recognition can be enhanced using a proposed feature selection method to select an optimal subset of features. Besides, a simple computation speed-up method is proposed for SVM. The results show that the proposed feature selection method is able improve the classification accuracy in terms of total error rate. The support vector machine-based fusion method also gave very promising results.     

整合原始人脸图像和其虚拟样本的人脸分类算法

人脸识别作为最具吸引力的生物识别技术之一,由于会受到不同的照明条件、面部表情、姿态和环境的影响,仍然是一个具有挑战性的任务.众所周知,一幅人脸图像是对人脸的一次采样,它不应该被看作是脸部的绝对精确表示.然而在实际应用中很难获得足够多的人脸样本.随着稀疏表示方法在图像重建问题中的成功应用,研究人员提出了一种特殊的分类方法,即基于稀疏表示的分类方法.受此启发,提出了在稀疏表示框架下的整合原始人脸图像和虚拟样本的人脸分类算法.首先,通过合成虚拟训练样本来减少面部表示的不确定性.然后,在原始训练样本和虚拟样本组成的混合样本中通过计算来消除对分类影响较小的类别和单个样本,在系数分解的过程中采用最小误差正交匹配追踪(Error-Constrained Orthogonal Matching Pursuit,OMP)方法,进而选出贡献程度大的类别样本并进行分类.实验结果表明,提出的方法不仅能获得较高的人脸识别的精度,而且还具有更低的计算复杂性.     

Learning warps based similarity for pose-unconstrained face recognition

Face recognition techniques are widely used in many applications, such as automatic detection of crime scenes from surveillance cameras for public safety. In these real cases, the pose and illumination variances between two matching faces have a big influence on the identification performance. Handling pose changes is an especially challenging task. In this paper, we propose the learning warps based similarity method to deal with face recognition across the pose problem. Warps are learned between two patches from probe faces and gallery faces using the Lucas-Kanade algorithm. Based on these warps, a frontal face registered in the gallery is transformed into a series of non-frontal viewpoints, which enables non-frontal probe face matching with the frontal gallery face. Scale-invariant feature transform (SIFT) keypoints (interest points) are detected from the generated viewpoints and matched with the probe faces. Moreover, based on the learned warps, the probability likelihood is used to calculate the probability of two faces being the same subject. Finally, a hybrid similarity combining the number of matching keypoints and the probability likelihood is proposed to describe the similarity between a gallery face and a probe face. Experimental results show that our proposed method achieves better recognition accuracy than other algorithms it was compared to, especially when the pose difference is within 40 degrees.

     

煤矿入井人员唯一性检测技术研究

通过分析掌纹、指纹、虹膜、人脸、步态、声纹等生物特征识别技术的特点以及煤矿现场对入井人员生物特征的影响,指出虹膜识别、人脸识别、步态识别、声纹识别适用于煤矿入井人员唯一性检测;提出了一种基于人员定位和生物特征识别的煤矿入井人员唯一性检测技术方案,将生物特征识别技术嵌入人员定位系统,利用人员定位识别卡实现识别卡数量及人员身份的唯一性检测;指出煤矿入井人员唯一性检测技术的研究关键点是严重污染人脸的识别算法、对设备遮挡情况下人员步态图像的采集及对混入人员语音信号的煤矿现场噪声消除算法。     

Efficient 3D face recognition handling facial expression and hair occlusion

This paper presents an efficient 3D face recognition method to handle facial expression and hair occlusion. The proposed method uses facial curves to form a rejection classifier and produce a facial deformation mapping and then adaptively selects regions for matching. When a new 3D face with an arbitrary pose and expression is queried, the pose is normalized based on the automatically detected nose tip and the principal component analysis (PCA) follows. Then, the facial curve in the nose region is extracted and used to form the rejection classifier which quickly eliminates dissimilar faces in the gallery for efficient recognition. Next, six facial regions which cover the face are segmented and curves in these regions are used to map facial deformation. Regions used for matching are automatically selected based on the deformation mapping. In the end, results of all the matching engines are fused by weighted sum rule. The approach is applied on the FRGC v2.0 dataset and a verification rate of 96.0% for ROC III is achieved as a false acceptance rate (FAR) of 0.1%. In the identification scenario, a rank-one accuracy of 97.8% is achieved.     

Multi-view based face chin contour extraction

Chin contour is an important facial feature to build a 3D morphable model, the core step of which is to establish feature points correspondence between each face in the training set and the reference face. In this paper, robust face detection is implemented firstly using probabilistic method. A probability of detection is obtained for each image of different position and at several scales and poses. Then, the chin contours are extracted accurately using the active shape model (ASM), which depends on the parameters obtained from the face detection. From frontal (0°) to profile (90°) faces that are equally divided into 10 parts, we train 10 flexible models. Then, different flexible models are used to extract the face chin contour according to the corresponding face pose. Experimental results show that the proposed approach can extract the chin contours of different people across different poses with good accuracy.     

FFDNet:复杂环境中的细粒度面部表情识别

针对面部表情识别在复杂环境中遮挡和姿态变化问题,提出一种稳健的识别模型FFDNet（feature fusion and feature decomposition net）。该算法针对人脸区域尺度的差异,采用多尺度结构进行特征融合,通过细粒度模块分解和细化特征差异,同时使用编码器捕捉具有辨别力和微小差异的特征。此外还提出一种多样性特征损失函数,驱动模型挖掘更丰富的细粒度特征。实验结果显示,FFDNet在RAF-DB和FERPlus数据集上分别获得了88.50%和88.75%的精度,同时在遮挡和姿态变化数据集上的性能都优于一些先进模型。实验结果验证了该算法的有效性。     

Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose

Face recognition across pose is a problem of fundamental importance in computer vision. We propose to address this problem by using stereo matching to judge the similarity of two, 2D images of faces seen from different poses. Stereo matching allows for arbitrary, physically valid, continuous correspondences. We show that the stereo matching cost provides a very robust measure of similarity of faces that is insensitive to pose variations. To enable this, we show that, for conditions common in face recognition, the epipolar geometry of face images can be computed using either four or three feature points. We also provide a straightforward adaptation of a stereo matching algorithm to compute the similarity between faces. The proposed approach has been tested on the CMU PIE data set and demonstrates superior performance compared to existing methods in the presence of pose variation. It also shows robustness to lighting variation.     

基于压缩金字塔核稀疏表示的人脸识别

人脸识别中光照、伪装及姿态等变化一直是富有挑战性的问题,其中特征提取是很关键的一步。为提高人脸识别率,结合压缩感知和空间金字塔模型,本文提出了一种新的特征提取方法,首先用尺度不变特征变换算法提取图像特征,然后与随机生成的字典进行稀疏编码,再用金字塔模型分层提取不同尺度空间的特征,并用最大池融合特征,最后运用核稀疏表示分类。在Extended Yale B,AR 和CMU PIE人脸数据库上的实验结果表明,该方法对于人脸图像的光照、伪装及姿态等变化有较强的鲁棒性,而且该算法有较快的运行速度。     

基于多姿态知识模型和模板的快速人脸检测

提出了一种多姿态知识模型,并以之从人脸器官梯度图中获得候选脸的大小、位置、姿态类别和眼、嘴重心坐标,然后按姿态类别将候选脸与对应的模板进行匹配确认人脸.该人脸检测算法集人脸检测、姿态估计和眼、嘴定位于一体,具有检测速度快的特点,适于多姿态多人脸场合的人脸检测.该算法只利用了图像的灰度信息,因此对灰度图像和彩色图像的人脸检测均适用.     

正则化最近点优化图像集匹配的三维人脸识别

针对传统的三维人脸识别算法受光照、表情、姿态及遮掩等变化而影响识别性能的问题,提出了一种基于正则化最近点优化图像集匹配算法。将图库图像集和探针图像集建模成正则化仿射包,利用迭代器自动确定两个图像集间的正则化最近点;利用最近子空间分类器最小化正则化最近点;根据正则化最近点之间的欧氏距离及结构计算RNP集之间的距离,利用最近邻分类器完成人脸的识别。在Honda/UCSD、BU4DFE两大视频人脸数据库上的实验验证了该算法的有效性及可靠性,实验结果表明,相比其他几种较为先进的三维人脸识别算法,该算法取得了更好的识别效果,同时,大大减少了训练及测试总完成时间。     

A review on face recognition systems: recent approaches and challenges

Face recognition is an efficient technique and one of the most preferred biometric modalities for the identification and verification of individuals as compared to voice, fingerprint, iris, retina eye scan, gait, ear and hand geometry. This has over the years necessitated researchers in both the academia and industry to come up with several face recognition techniques making it one of the most studied research area in computer vision. A major reason why it remains a fast-growing research lies in its application in unconstrained environments, where most existing techniques do not perform optimally. Such conditions include pose, illumination, ageing, occlusion, expression, plastic surgery and low resolution. In this paper, a critical review on the different issues of face recognition systems are presented, and different approaches to solving these issues are analyzed by presenting existing techniques that have been proposed in the literature. Furthermore, the major and challenging face datasets that consist of the different facial constraints which depict real-life scenarios are also discussed stating the shortcomings associated with them. Also, recognition performance on the different datasets by researchers are also reported. The paper is concluded, and directions for future works are highlighted.

     

Robust authentication using the unconstrained infrared face images

Face recognition under the unconstrained conditions that exist in surveillance is the need of the present times. Thus for high end security the research on IR based face recognition assumes importance because of its insensitivity to illumination, disguise and surgery. This paper presents IR face based biometric authentication using the information-set based four types of interactive features and two classifiers. The information sets originate from a fuzzy set on representing the uncertainty associated with the information source instead of a membership function which gives only the degree of association to the fuzzy set. The four feature types include the effective exponential information source (EEI), the effective Gaussian information source (EGI), the effective multi quadratic information source (EMQDI) and inverse of this feature (EIMQDI). The interactive features are obtained by taking the s-norms on the features from the successive windows. Two classifiers called the Hanman Classifier and the weighted Hanman Classifier are formulated using t-norms. The features and classifiers are tested on the created databases incorporating the unconstrained conditions such as occlusion, less resolution and noise.     

多姿态人脸照片的姿态估计

提出了一种基于面部图像的新的匹配系统。在这个系统中,输入的图像与各种人脸姿态的数据库图像进行比较,然后,匹配的图像给出了人脸姿态。图像数据库不仅包括各种人脸姿态,而且也包括不同的光照条件,如此,这个人脸姿态评价系统适用于不同的光照条件。对于收集各种不同面部图像,这里是通过计算机自动产生,而不是拍摄实际的照片。特征空间方法被用于寻找与输入面部图像匹配的图像。因为不同的光照图像被收集在面部图像数据库中,故提取的主特征向量主要依靠人脸姿态。由于通过选用主特征向量而减少了向量的维数,故这个匹配过程是很快的。这个姿态评价系统能够继续跟踪在不同的光照条件下不同人的人脸姿态。