对表情鲁棒的面部轮廓线3维人脸识别

目的表情变化是3维人脸识别面临的主要问题。为克服表情影响,提出了一种基于面部轮廓线对表情鲁棒的3维人脸识别方法。方法首先,对人脸进行预处理,包括人脸区域切割、平滑处理和姿态归一化,将所有的人脸置于姿态坐标系下;然后,从3维人脸模型的半刚性区域提取人脸多条垂直方向的轮廓线来表征人脸面部曲面;最后,利用弹性曲线匹配算法计算不同3维人脸模型间对应的轮廓线在预形状空间(preshape space)中的测地距离,将其作为相似性度量,并且对所有轮廓线的相似度向量加权融合,得到总相似度用于分类。结果在FRGC v2.0数据库上进行识别实验,获得97.1%的Rank-1识别率。结论基于面部轮廓线的3维人脸识别方法,通过从人脸的半刚性区域提取多条面部轮廓线来表征人脸,在一定程度上削弱了表情的影响,同时还提高了人脸匹配速度。实验结果表明,该方法具有较强的识别性能,并且对表情变化具有较好的鲁棒性。     

拉普拉斯滤波结合CS-LBP的单样本人脸识别

针对传统的人脸识别算法在单训练样本的情况下识别率不佳的情况,提出一种结合拉普拉斯滤波与中心对称局部二值模式的人脸识别算法（LFCLBP）。对原始人脸图像进行拉普拉斯滤波处理;然后对图像提取梯度幅值和梯度相位信息,对梯度幅值用CS-LBP算子编码,再将梯度相位量化到16个区间进行编码,将二者融合成人脸图像的LFCLBP特征;分块统计直方图特征,将所有分块的直方图串联起来作为人脸图像的特征向量,并用最近邻分类器识别。在YALE人脸库和AR人脸库上进行测试,测试结果表明该算法有效,在光照变化、表情变化和部分遮挡等环境下对单样本人脸图像具有较好的识别效果。     

人机交互中的人脸信息曲波分析

视觉交互是自然人机交互的重要组成部分,而人脸特征提取则是视觉交互成功的关键。针对小波变换难以充分描述人脸曲线特征的缺点,为了更好地提取人脸特征,将更符合人类视觉特性的曲波变换用于人脸信息处理,提出了结合曲波变换与Adaboost方法的人脸检测优化方法和基于曲波变换与SVM进行表情分析的新方法,并开展了人脸检测、人脸识别与表情分析的对比实验。实验结果显示,曲波变换在人脸特征提取中具有明显优势,从而为自然人机交互的下一步工作打下了坚实基础。     

低照度条件下超分辨率人脸图像采集系统设计与实现

在计算机技术高速发展的时代,多平台计算机视觉库随之产生。OpenCV作为一种开源代码的计算机视觉库,以可兼容多平台、接口广泛的特点被广泛运用各个领域。在低照度条件下,会出现光照环境差异过大或光线不足等情况,导致传统图像采集系统不能采集高质量的人脸图像,局限性较差。提出基于OpenCV在C 环境配置下运用三维人脸识别技术算法,设计一套低照度条件下超分辨率人脸图像采集系统。实验证明,该设计方案具有实时(对焦速度快)、快速(单张采集0.05秒)、准确(面部识别率99.3%)等特点,能够充分满足低照度条件下超分辨率人脸图像采集的需求。     

一种基于LBP特征与流形知识的人脸识别方法

人脸识别是计算机视觉领域的研究热点,应用背景广泛。近年来,流形被认为是视觉感知的基础,流形学习算法被用来发现图像的内在特征。如何利用流形学习后的低维内蕴变量成为相关研究的核心问题。但是利用传统的流形学习算法降维得到的人脸低维特征在可分性上存在一定的不足。此外,流形学习算法对光照和姿态变化敏感。针对这两个问题,提出了一种基于局部二值模式（LBP）和流形知识的人脸识别方法。该方法首先利用LBP算子对人脸图像进行局部特征描述,然后使用流形学习算法获得高维特征数据的低维内蕴变量,并用泰勒展开式近似该流形,获取流形知识,最后利用流形知识估计流形距离来实现人脸识别。实验证明,该方法增强了人脸识别对光照变化的鲁棒性,从而提高了识别性能。     

面向表情识别的AVR和增强LBP特征选择方法

由于对局部纹理特征具有很强的描述能力,LBP（Local Binary Patterns）已经被广泛应用于模式识别、计算机视觉等相关领域,但传统的LBP在表情识别中的正确率并不高,提出了一种结合小波分解的改进LBP特征提取方法,首先使用Adaboost人脸检测算法和2D模型提取人脸图像并归一化,并使用小波分解的方法增强LBP特征,然后通过AVR（Augmented Variance Ratio）特征选取方法降维,最后使用SVM进行分类。JAFFE库上的实验证明了该方法的有效性。     

非采样Contourlet变换与局部二值模式相结合的人脸识别

针对人脸识别中姿态、光照和表情变化带来的识别率有限的问题,提出了一种基于非采样Contourlet变换(NSCT)与局部二值模式（LBP）的人脸特征提取方法。首先对人脸图像进行非采样Contourlet变换,得到多尺度、多方向的子带系数矩阵,然后利用LBP算子从每个子带系数矩阵上抽取局部邻域关系,得到各子带的LBP特征图谱,最后将这些图谱分块统计并级联后作为人脸的识别特征。利用多通道最近邻分类器的分类结果表明,所提方法能有效提高识别率,所提取的特征对光照、表情和姿态等变化具有更好的鲁棒性。     

Independent component analysis in a local facial residue space for face recognition

In this paper, we propose an Independent Component Analysis (ICA) based face recognition algorithm, which is robust to illumination and pose variation. Generally, it is well known that the first few eigenfaces represent illumination variation rather than identity. Most Principal Component Analysis (PCA) based methods have overcome illumination variation by discarding the projection to a few leading eigenfaces. The space spanned after removing a few leading eigenfaces is called the “residual face space”. We found that ICA in the residual face space provides more efficient encoding in terms of redundancy reduction and robustness to pose variation as well as illumination variation, owing to its ability to represent non-Gaussian statistics. Moreover, a face image is separated into several facial components, local spaces, and each local space is represented by the ICA bases (independent components) of its corresponding residual space. The statistical models of face images in local spaces are relatively simple and facilitate classification by a linear encoding. Various experimental results show that the accuracy of face recognition is significantly improved by the proposed method under large illumination and pose variations.     

基于局部定性表达的光照不变人脸识别方法

提出一种局部定性特征表达方法称为局部序映射(LOM)作为光照不变表达用于人脸识别。该特征表达像素在其邻域中所处的序阶位置,反应了图像像素在局部区域内的相对关系,因而对光照引起的图像大面积灰度变化有很好的不敏感性。同时提出一种针对序定性特征的逻辑距离度量,用于特征空间中最近邻分类器的相似性度量准则。 在Extended YaleB 光照变化人脸测试库中的实验表明了本文局部序映射表达的光照鲁棒性及逻辑距离度量的有效性。     

融合LBP和局部稀疏表示的人脸表情识别

为更好获取人脸局部表情特征,提出了一种融合局部二值模式（Local Binary Pattern,LBP）和局部稀疏表示的人脸表情特征与识别方法。为深入分析表情对人脸子区域的影响,根据五官特征对人脸进行非均匀分区,并提取局部LBP特征;为精细刻画人脸局部纹理,整合人脸局部特征,设计了人脸局部稀疏重构表示方法,并根据表情对各局部子区域的影响因子,加权融合局部重构残差进行人脸表情识别。在JAFFE2表情人脸库上的对比实验,验证了该方法的可行性和鲁棒性。     

Face recognition based on local binary pattern and improved Pairwise-constrained Multiple Metric Learning

During the image acquisition process of face recognition, the obtained face images are affected inevitably by varied illumination and position in different environment. Local Binary Pattern (LBP) operator is used to decrease illumination effectiveness. Improved Pairwise-constrained Multiple Metric Learning method (IPMML) is proposed as a classification metric in our prior work, which solves the misalignment problem in a better way compared with PMML. To solve the high computation complexity of IPMML, Linear Discriminant Analysis (LDA) is performed before IPMML. Thus, a face recognition method based on LBP and IPMML is proposed, which can overcome the illumination and misalignment problems. LBP is selected to extract texture features of face images firstly. Second, LDA is applied to reduce the dimension. Then the fisher features are divided into sub-blocks according to the dimension of features and every block is a column vector. Fourth, a classification metric -- IPMML is used to obtain the optimum Mahalanobis matrix. Fifth, the Mahalanobis matrix is used to compute the final discriminative distance. Finally, the Nearest Neighborhood Classifier (NNC) is applied to classify face images. The experimental results show that the proposed method can achieve high recognition rates and is robust to illumination and facial expression variation, especially for misaligned face images.

     

一种利用人脸对称性的光照归一化方法

光照归一化在光照鲁棒的人脸识别中被广泛使用.许多现有光照归一化方法将人脸图像视为自然图像,而忽略了人脸这一类特定物体的先验属性,因此很难从一幅具有侧光的人脸图像中恢复阴影区域中的人脸信息.提出了利用人脸对称性先验的光照归一化方法,在能量最小化框架下,对人脸图像的阴影区域进行光照归一化时参考其对称非阴影区域中的人脸结构信息,同时提出了无阴影信度图将二元最优化问题简化为一元最优化问题,以降低光照归一化方法的计算代价.在合成阴影和真实阴影人脸图像上的实验表明,利用人脸对称性的光照归一化方法能有效恢复图像阴影区域中的人脸特征,并对人脸误配准和非对称几何归一化具有一定的鲁棒性.     

融合单演特征和CS-LBP的单样本人脸识别

针对单样本情况下传统人脸识别方法识别效果不佳的问题,提出一种融合单演幅值、相位和方向的单演中心对称幅值相位方向模式（MCSLBP）的人脸识别方法。首先采用中心对称局部二值模式（CS-LBP）对同一尺度下的单演幅值进行编码,并将单演相位量化到4个区间进行编码,同时对单演水平方向和垂直方向进行二值编码,然后将三者融合成MCSLBP特征;最后对不同单演尺度空间中的MCSLBP模式图进行分块,提取每一小块的直方图特征并串联后用最近邻分类器进行分类识别。在CAS-PEAL和AR人脸库上的实验结果表明,MCSLBP方法对具有光照、表情和遮挡变化的单样本人脸识别具有较好的识别效果。     

Online learning from local features for video-based face recognition

This paper presents an online learning approach to video-based face recognition that does not make any assumptions about the pose, expressions or prior localization of facial landmarks. Learning is performed online while the subject is imaged and gives near realtime feedback on the learning status. Face images are automatically clustered based on the similarity of their local features. The learning process continues until the clusters have a required minimum number of faces and the distance of the farthest face from its cluster mean is below a threshold. A voting algorithm is employed to pick the representative features of each cluster. Local features are extracted from arbitrary keypoints on faces as opposed to pre-defined landmarks and the algorithm is inherently robust to large scale pose variations and occlusions. During recognition, video frames of a probe are sequentially matched to the clusters of all individuals in the gallery and its identity is decided on the basis of best temporally cohesive cluster matches. Online experiments (using live video) were performed on a database of 50 enrolled subjects and another 22 unseen impostors. The proposed algorithm achieved a recognition rate of 97.8% and a verification rate of 100% at a false accept rate of 0.0014. For comparison, experiments were also performed using the Honda/UCSD database and 99.5% recognition rate was achieved.     

融合DCT和LBP特征的表情识别

为了获得更好的面部表情特征,提出了一种融合离散余弦变换（Discrete Cosine Transform,DCT）特征和局部二值模式（Local Binary Pattern,LBP）特征的表情特征提取方法。该方法将人脸图像经过DCT后所获得的低频系数作为表情的整体特征;通过对人脸图像进行分块,计算每个子块的LBP直方图,将这些LBP直方图连接起来形成LBP特征,对该LBP特征使用拉普拉斯特征映射（Laplacian Eigenmaps,LE）降维后得到表情的局部特征。将得到的整体特征和局部特征进行加权融合,使用最近邻分类器进行分类。在JAFFE和Cohn-Kanade表情库上的实验结果表明,该方法比单独使用LBP或者DCT特征,具有更好的效果。     

基于Shearlet变换和均匀局部二值模式特征的协作表示人脸识别算法

为了获得人脸图像中更丰富的纹理特征以提高人脸识别率,提出了一种基于Shearlet变换和均匀局部二值模式(ULBP)算子提取特征(Shearlet_ULBP特征)的协作表示方法--Shearlet_ULBP CRC用于人脸识别。首先,人脸图像通过Shearlet变换分解,得到多尺度多方向的幅值域图谱,再经过简单的平均融合,获得融合后的幅值域图谱;然后,通过ULBP算子结合分块的方法获得该Shearlet变换后融合图像的直方图特征;最后,结合协作表示的方法来分类所提取到的特征。该方法可以提取到图像更丰富的边缘以及纹理信息,在ORL、Extended Yale B和AR人脸数据库上进行测试,在图像无遮挡的情况下识别率都达到了99%以上,在有遮挡情况下也都达到了91%以上的识别率。实验结果表明,所提方法不仅对于光照、姿态和表情变化具备较强的鲁棒性,同时能在一定程度上处理人脸图像中存在遮挡的情形。     

基于光照分类的可变光照下人脸识别方法

针对人脸识别中的光照变化问题,借鉴“分而治之”的思想,提出通过光照分类来提高不同光照情况下人脸的识别率。根据人脸图像灰度随光照变化的分布特点,将图像划分为三类：无偏光类、左偏光类和右偏光类,分别在不同的光照子集中对人脸图像进行处理与识别,并在YALEB人脸库上完成实验验证。结果表明,该方法不需要进行光照归一化处理,有效减弱了光照不均匀对人脸识别的影响,在提高识别率的同时降低了运算量,识别率可从未分类前的86.7%提高到99.6%,对于可变光照下的人脸识别有一定的应用前景。     

Virtual illumination grid for correction of uncontrolled illumination in facial images

Face recognition under uncontrolled illumination conditions is still considered an unsolved problem. In order to correct for these illumination conditions, we propose a virtual illumination grid (VIG) approach to model the unknown illumination conditions. Furthermore, we use coupled subspace models of both the facial surface and albedo to estimate the face shape. In order to obtain a representation of the face under frontal illumination, we relight the estimated face shape. We show that the frontal illuminated facial images achieve better performance in face recognition. We have performed the challenging Experiment 4 of the FRGCv2 database, which compares uncontrolled probe images to controlled gallery images. Our illumination correction method results in considerably better recognition rates for a number of well-known face recognition methods. By fusing our global illumination correction method with a local illumination correction method, further improvements are achieved.