基于轮廓线局部描述符的三维人脸识别

提出了一种基于等测地轮廓线的局部描述符来识别三维人脸。首先对三维人脸数据进行预处理, 得到统一的人脸区域并进行姿态归一化; 然后根据测地距离提取到鼻尖点相同距离的点组成等测地轮廓线, 对轮廓线进行重采样, 并对轮廓线上每个采样点的邻域提取局部描述符; 最后在建立测试人脸和库集人脸的点对应关系后进行局部描述符的加权融合和比较, 给出最终识别结果。算法在FRGC(face recognition grand challenge)v2. 0数据库上进行测试, 实验结果表明该方法具有较好的识别性能。     

基于侧面轮廓线和刚性区域的3维人脸识别

针对3维人脸识别问题,提出一种由粗到细的两步识别方法。首先结合几何约束与曲率信息定位特征点,根据特征点确定人脸对称面,提取人脸侧面轮廓线。利用轮廓线匹配作为排除算法,在识别初期迅速排除库集中不相似人脸以提高识别效率,剩余库集人脸采用一种具有表情鲁棒性的、基于区域的匹配方法进行识别,该方法自动切割人脸中受表情影响较小的刚性区域,并采用改进的迭代最近点算法对刚性区域进行匹配,为达到更好的识别精度,将各刚性区域的匹配结果采用加法规则融合。在3D_RMA人脸数据库的实验结果表明,该方法具有较好的实时性和鲁棒性。     

一种面向三维人脸识别的同一截面有效轮廓线提取算法

针对三维人脸识别对表情及姿态变化的鲁棒性研究,提出一种基于人脸同一截面有效轮廓线的人脸识别方法。首先根据手工标定鼻尖点区域的法向量对人脸进行粗略矫正,再基于同一标准正中面人脸的迭代最近点(ICP)算法进行精确姿态矫正,标定精确鼻尖位置,提取过鼻尖的不同人脸同一截面横纵两条轮廓线。用阈值法提取过鼻尖点的有效轮廓线,采用ICP算法计算相似度,对两条轮廓线识别结果进行融合。实验结果表明,在CASIA 3D人脸库上对表情及姿态变化有较好的鲁棒性。     

基于局部特征的表情不变3维人脸识别算法

为了减少表情变化带来的影响,提出一种基于人脸几何特征和局部描述子的3维人脸识别算法.首先利用多尺度形状变化指数在3维人脸上检测出关键点.然后提出一种基于关键点的2步匹配算法,以提高识别算法的效率:第1步在关键点上提取3维法向量分布直方图描述子,将测试集人脸与库集人脸上的描述子进行匹配,除去匹配程度较低的一部分库集人脸,减少后续匹配的人脸数;第2步在关键点上提取协方差矩阵描述子,再将测试集人脸与剩余的库集人脸在给定的约束条件下进行协方差矩阵描述子匹配.最后用成功匹配的关键点个数衡量人脸的匹配程度,得到分类结果.在Bosphorus, FRGC v2.0和BU-3DFE数据库上进行实验的结果表明,文中算法取得了良好的识别效果,对3维人脸的表情变化有较好的鲁棒性,同时在识别速度上也优于已有的许多算法.     

基于ASM和K近邻算法的人脸脸型分类

针对人脸特征分类问题,提出一种基于主动形状模型(ASM)和K近邻算法的人脸脸型分类方法。将Hausdorff距离作为K近邻算法的距离函数,利用ASM算法提取待测图像的特征点,对点集进行归一化后计算人脸轮廓特征点与样本库中所有样本点集的Hausdorff距离,根据该距离值,通过K近邻算法实现待测图像的脸型分类。实验结果证明,该方法分类正确率高、速度快、易于实现。     

基于支持向量机的人脸检测训练集增强

根据支持向量机(support vector machine,简称SVM)理论,对基于边界的分类算法(geometric approach)而言,类别边界附近的样本通常比其他样本包含有更多的分类信息.基于这一基本思路,以人脸检测问题为例,探讨了对给定训练样本集进行边界增强的问题,并为此而提出了一种基于支持向量机和改进的非线性精简集算法IRS(improved reduced set)的训练集边界样本增强算法,用以扩大训练集并改善其样本分布.其中,所谓IRS算法是指在精简集(reduced set)算法的核函数中嵌入一种新的距离度量——图像欧式距离——来改善其迭代近似性能,IRS可以有效地生成新的、位于类别边界附近的虚拟样本以增强给定训练集.为了验证算法的有效性,采用增强的样本集训练基于AdaBoost的人脸检测器,并在MIT CMU正面人脸测试库上进行了测试.实验结果表明,通过这种方法能够有效地提高最终分类器的人脸检测性能.     

对表情鲁棒的面部轮廓线3维人脸识别

目的表情变化是3维人脸识别面临的主要问题。为克服表情影响,提出了一种基于面部轮廓线对表情鲁棒的3维人脸识别方法。方法首先,对人脸进行预处理,包括人脸区域切割、平滑处理和姿态归一化,将所有的人脸置于姿态坐标系下;然后,从3维人脸模型的半刚性区域提取人脸多条垂直方向的轮廓线来表征人脸面部曲面;最后,利用弹性曲线匹配算法计算不同3维人脸模型间对应的轮廓线在预形状空间(preshape space)中的测地距离,将其作为相似性度量,并且对所有轮廓线的相似度向量加权融合,得到总相似度用于分类。结果在FRGC v2.0数据库上进行识别实验,获得97.1%的Rank-1识别率。结论基于面部轮廓线的3维人脸识别方法,通过从人脸的半刚性区域提取多条面部轮廓线来表征人脸,在一定程度上削弱了表情的影响,同时还提高了人脸匹配速度。实验结果表明,该方法具有较强的识别性能,并且对表情变化具有较好的鲁棒性。     

基于轮廓线的三维人脸识别的改进算法

对已有的基于轮廓线的人脸识别方法进行了改进,在人脸的任意位置利用PCA自动确定人脸纵方向,采用网格配准方法提取对称面和对称轮廓线。通过计算对称轮廓线上的曲率,提取其他3条横向轮廓线。对提取的4条轮廓线进行重采样和归一化,截取轮廓线的有价值部分作为ICP算法的输入,进行人脸识别。试验证明,该算法将人脸识别率从原来的86.5%提高到了94%,降低了误识率。     

人脸边缘自适应搜索算法及仿真研究

人脸轮廓线提取是人脸识别中极为重要的内容，一种可靠、精确的人脸边缘提取算法对于身份鉴定技术等方面具有重要的应用价值。该文基于传统的边缘提取算法提出了一种自适应搜索轮廓线算法，首先基于人脸检测结果确定内外轮廓及搜索路径，然后对于每一条搜索路径提取出真正的轮廓点，最后利用人脸轮廓的平滑性通过曲线拟合完成轮廓线提取。该文以彩色人脸图像库数据为例，快速、准确地得到人脸轮廓线。仿真试验结果表明，该算法能在保持边缘检测精度的情况下，克服了噪声对轮廓特征提取的影响，并且对于姿势变化有一定的鲁棒性，具有一定的应用价值。     

基于均匀k均值和高维局部二值模式的人脸识别算法

针对传统局部二值模式(LBP)及其一些改进方法会将具有不同灰度特征的邻域赋予相同的特征值和特征维数倍增的问题,提出一种基于均匀k均值和高维局部二值模式的算法.该算法首先对原图进行切割得到子图;然后提取子图的高维局部二值模式特征,利用均匀k均值对高维特征进行降维处理;最后级联所有的子图特征进行分析.为了验证该算法的性能,在ORL人脸库和YALE人脸库以及FERET人脸库上进行对比实验,结果表明该算法在保证特征维数不递增的前提下,能够明显提高LBP算法的识别率.     

Learning warps based similarity for pose-unconstrained face recognition

Face recognition techniques are widely used in many applications, such as automatic detection of crime scenes from surveillance cameras for public safety. In these real cases, the pose and illumination variances between two matching faces have a big influence on the identification performance. Handling pose changes is an especially challenging task. In this paper, we propose the learning warps based similarity method to deal with face recognition across the pose problem. Warps are learned between two patches from probe faces and gallery faces using the Lucas-Kanade algorithm. Based on these warps, a frontal face registered in the gallery is transformed into a series of non-frontal viewpoints, which enables non-frontal probe face matching with the frontal gallery face. Scale-invariant feature transform (SIFT) keypoints (interest points) are detected from the generated viewpoints and matched with the probe faces. Moreover, based on the learned warps, the probability likelihood is used to calculate the probability of two faces being the same subject. Finally, a hybrid similarity combining the number of matching keypoints and the probability likelihood is proposed to describe the similarity between a gallery face and a probe face. Experimental results show that our proposed method achieves better recognition accuracy than other algorithms it was compared to, especially when the pose difference is within 40 degrees.

     

人脸样貌独立判别的协作表情识别算法

为了降低样貌、姿态、眼镜以及表情定义不统一等因素对人脸表情识别的影响,提出一种人脸样貌独立判别的协作表情识别算法。首先,采用自动的人脸检测算法定位、对齐视频每帧的人脸区域,并从人脸视频序列中选择峰值表情的人脸;然后,采用峰值人脸与某个表情类内的所有人脸产生表情类内差异人脸信息,并通过计算峰值表情人脸与表情类内差异人脸的差异信息获得协作的表情表示;最终,采用基于稀疏的分类器与表情表示决定每个人脸表情的标签。采用欧美与亚洲人脸的数据库进行仿真实验,结果表明本算法获得了较好的表情识别准确率,对不同样貌、佩戴眼镜的人脸样本也具有较好的识别效果。     

Efficient 3D face recognition handling facial expression and hair occlusion

This paper presents an efficient 3D face recognition method to handle facial expression and hair occlusion. The proposed method uses facial curves to form a rejection classifier and produce a facial deformation mapping and then adaptively selects regions for matching. When a new 3D face with an arbitrary pose and expression is queried, the pose is normalized based on the automatically detected nose tip and the principal component analysis (PCA) follows. Then, the facial curve in the nose region is extracted and used to form the rejection classifier which quickly eliminates dissimilar faces in the gallery for efficient recognition. Next, six facial regions which cover the face are segmented and curves in these regions are used to map facial deformation. Regions used for matching are automatically selected based on the deformation mapping. In the end, results of all the matching engines are fused by weighted sum rule. The approach is applied on the FRGC v2.0 dataset and a verification rate of 96.0% for ROC III is achieved as a false acceptance rate (FAR) of 0.1%. In the identification scenario, a rank-one accuracy of 97.8% is achieved.     

FaceSeg: Automatic Face Segmentation for Real-Time Video

Segmenting human faces automatically is very important for face recognition and verification, security system, and computer vision. In this paper, we present an accurate segmentation system for cutting human faces out from video sequences in real-time. First, a learning based face detector is developed to rapidly find human faces. To speed up the detection process, a face rejection cascade is constructed to remove most of negative samples while retaining all the face samples. Then, we develop a coarse-to-fine segmentation approach to extract the faces based on a min-cut optimization. Finally, a new matting algorithm is proposed to estimate the alpha-matte based on an adaptive trimap generation method. Experimental results demonstrate the effectiveness and robustness of our proposed method that can compete with the well-known interactive methods in real-time.     

Robust Video Face Recognition Under Pose Variation

With the abundance of video data, the interest in more effective methods for recognizing faces from surveillance videos has grown. However, most algorithms proposed in this field have an assumption that each image set lies in a single linear subspace, or a mixture of linear subspaces. As a result, 3-dimensional shape information, which leads to the nonlinear transformation of face images, is ignored. This paper proposes a robust video face recognition across pose variation in video (RVPose) based on sparse representation. The key idea is performing alignment and recognition based on sparse representation simultaneously. Moreover, by considering that multi-pose faces of the same subject possess the same texture and 3-dimensional shape, RVPose aligns a sequence of faces with pose variations simultaneously, which is reduced to a 3-dimensional shape-constrained video alignment problem. Finally, aligned video sequence is recognized based on sparse represent. Experiments conducted on public video datasets demonstrate the effectiveness of the proposed algorithm.     

基于因子分析与稀疏表示的多姿态人脸识别

在非可控环境下,人脸识别面临的最大难题之一是姿态变化与遮挡问题。基于稀疏表示的人脸识别方法将测试人脸表示成训练人脸的稀疏线性组合,根据其组合系数的稀疏性进行人脸识别。该方法对人脸的噪声和遮挡变化具有很好的鲁棒性,但对人脸的姿态变化表现力极差,这是因为当人脸具有姿态变化时,同一个人不同姿态情况下很难对应起来,这违背线性组合的前提条件。为了克服稀疏表示方法对人脸姿态变化表现力极差问题,对人脸进行因子分析,分离出人脸姿态因子,得到合成的正面人脸;利用稀疏表示进行人脸分类识别。实验结果表明,该方法对人脸的遮挡和姿态变化具有很好的鲁棒性。     

2D face fitting-assisted 3D face reconstruction for pose-robust face recognition

Recent face recognition algorithm can achieve high accuracy when the tested face samples are frontal. However, when the face pose changes largely, the performance of existing methods drop drastically. Efforts on pose-robust face recognition are highly desirable, especially when each face class has only one frontal training sample. In this study, we propose a 2D face fitting-assisted 3D face reconstruction algorithm that aims at recognizing faces of different poses when each face class has only one frontal training sample. For each frontal training sample, a 3D face is reconstructed by optimizing the parameters of 3D morphable model (3DMM). By rotating the reconstructed 3D face to different views, pose virtual face images are generated to enlarge the training set of face recognition. Different from the conventional 3D face reconstruction methods, the proposed algorithm utilizes automatic 2D face fitting to assist 3D face reconstruction. We automatically locate 88 sparse points of the frontal face by 2D face-fitting algorithm. Such 2D face-fitting algorithm is so-called Random Forest Embedded Active Shape Model, which embeds random forest learning into the framework of Active Shape Model. Results of 2D face fitting are added to the 3D face reconstruction objective function as shape constraints. The optimization objective energy function takes not only image intensity, but also 2D fitting results into account. Shape and texture parameters of 3DMM are thus estimated by fitting the 3DMM to the 2D frontal face sample, which is a non-linear optimization problem. We experiment the proposed method on the publicly available CMUPIE database, which includes faces viewed from 11 different poses, and the results show that the proposed method is effective and the face recognition results toward pose variants are promising.     

Cross-pose face recognition based on partial least squares

The pose problem is one of the bottlenecks for face recognition. In this paper we propose a novel cross-pose face recognition method based on partial least squares (PLS). By training on the coupled face images of the same identities and across two different poses, PLS maximizes the squares of the intra-individual correlations. Therefore, it leads to improvements in recognizing faces across pose differences. The experimental results demonstrate the effectiveness of the proposed method.     

基于仿射包和伪Zernike矩的视频人脸检索

近年来基于视频的人脸检索已成为人脸识别和检索领域最为活跃的研究方向之一。提出了一种基于仿射包结合伪Zemike矩特征的视频人脸检索算法（FRIVAP）。在视频中检测跟踪到人脸生成图像集,接着提取图像集中人脸的伪Zemike矩特征,建立特征的仿射包,通过相似度计算得到结果。经对Honda／UCSD视频数据库和自行构建的视频数据库的大量实验表明,该算法可以充分利用视频中人脸的时间和空间信息,并且对噪声、人脸姿势变化等条件下的人脸检索有较强的鲁棒性。