复杂背景下人眼定位及人脸检测

人眼定位和人脸检测是人脸识别的重要环节，复杂背景下，人眼定位及人脸检测容易受到光照以及其它物体的影响。在没有检测到人脸的情况下，对原始图像用sobel算子得到灰度边缘图像，进而得到边缘灰度加强图像，估算分割双眼的阈值范围。对边缘灰度加强图像二值化后，结合人脸的几何特征以及双眼的二维相关系数自动确定双眼候选点，利用人脸模板检验双眼及人脸的真实性。大量实验结果表明，该算法在复杂背景下进行人眼定位及人脸检测是有效的。     

基于肤色信息和主分量分析的人脸实时检测系统

提出了一种基于肤色模型、人脸面部结构和模板匹配的人脸检测算法。该方法首先建立肤色模型来对原始图像进行肤色区域分割,再根据人脸的面部结构特征对分割区域进行过滤,最后用基于主元素分析的模板匹配算法对候选区域进行判断。实验结果表明该算法能够适应复杂背景以及多人脸的检测,而且检测速度快,能够达到实时检测的目的。     

人脸检测研究综述

人脸检测问题最初作为自动人脸识别系统的定位环节被提出，近年来由于其在安全访问控制，视觉监测、基于内容和检索和新一代人机界面等领域的应用价值，开始作为一个独立的课题受到研究者的普遍重视。该文从人脸检测问题的分类、人脸模式的分析、特征提取与特征综合、性能评价等角度，系统地整理分析了人脸检测问题的研究文献，将人脸检测方法主要划分为基于知识的人脸验证方法和基于统计的学习方法，指出统计学习方法优于启发式验证方法。     

基于多关联模板匹配的人脸检测

提出一种基于多关联模板匹配的人脸检测算法.模板由一系列关联的双眼模板和人脸模板组成,它们都是通过仿射变换根据伸缩比和姿态(即旋转角度)从单一平均脸模板产生出来的.首先,使用双眼模板搜索候选人脸,再用人脸模板匹配进一步筛选候选人脸,最后,通过启发式规则验证是否是人脸.对于各种类型的图像进行大量实验的结果表明,该算法对于正面包括多角度人脸的检测很有效.     

基于集成卷积神经网络的人脸年龄分类算法研究

人脸年龄估计由于在人机交互和安全控制等领域有潜在应用,因此得到了广泛关注。文中主要进行人脸年龄分组的研究,针对人脸年龄分类问题提出了一种基于集成卷积神经网络的年龄分类算法。首先,训练两个以人脸图像为输入的卷积神经网络,当用卷积神经网络直接提取人脸图像的特征时,主要对 深度的全局特征 进行提取。为了补充人脸图像的局部特征,尤其是纹理信息,将提取的LBP(Local Binary Pattern)特征作为另一个网络的输入。最后,为了结合人脸的全局特征和局部特征,将这3个网络进行集成。该算法在广泛使用的年龄分类数据集Group上取得了不错的效果。     

尺度无关的级联卷积神经网络人脸检测算法

卷积神经网络在进行图片处理时需要输入固定尺寸大小的图片，该限制会导致原图在放缩过程中损失大部分信息。另外，目前人脸检测算法多用单一结构网络进行特征提取，这就使得算法的泛化能力较弱。针对以上两个问题，提出了一种将级联卷积神经网络与空间金字塔池化相结合的人脸检测算法。该方法将三级卷积神经网络模型连接起来，其中三级神经网络模型之间各不相同，结构从简单到复杂，在不同层次的神经网络上提取不同的人脸特征并筛选图片，完成对图片中人脸区域的检测。同时，在每级网络层次中加入空间金字塔池化层，这种池化策略无须固定尺寸大小的输入，增加了模型输入的尺寸选择。在标准人脸数据集中，该方法相对于传统方法实现了模型的多尺度输入，提升了检测的性能，并降低了检测人脸的时间。     

Real-time iris detection

A real-time algorithm to automatically detect human faces and irises from color images has been developed. A Haar cascade-based algorithm has been applied for simple and fast face detection. The face image is then converted into a gray-scale image. Three types of image processing techniques have been tested to study their effect on the performance of the iris detection algorithm. Then iris candidates are extracted from the valley of the face region. The iris candidates are paired up and the cost of each possible pairing is computed by a combination of mathematical models. The pairing with the lowest cost is considered to be a pair of irises. The algorithm has been tested by quality images from a Logitech camera and noisy images from a Voxx CCD camera. The proposed algorithm has achieved a success rate of 83.60% for iris detection in an open office environment.     

Multi-resolution feature fusion for face recognition

For face recognition, image features are first extracted and then matched to those features in a gallery set. The amount of information and the effectiveness of the features used will determine the recognition performance. In this paper, we propose a novel face recognition approach using information about face images at higher and lower resolutions so as to enhance the information content of the features that are extracted and combined at different resolutions. As the features from different resolutions should closely correlate with each other, we employ the cascaded generalized canonical correlation analysis (GCCA) to fuse the information to form a single feature vector for face recognition. To improve the performance and efficiency, we also employ “Gabor-feature hallucination”, which predicts the high-resolution (HR) Gabor features from the Gabor features of a face image directly by local linear regression. We also extend the algorithm to low-resolution (LR) face recognition, in which the medium-resolution (MR) and HR Gabor features of a LR input image are estimated directly. The LR Gabor features and the predicted MR and HR Gabor features are then fused using GCCA for LR face recognition. Our algorithm can avoid having to perform the interpolation/super-resolution of face images and having to extract HR Gabor features. Experimental results show that the proposed methods have a superior recognition rate and are more efficient than traditional methods.     

基于图像扩散速度模型和纹理信息的人脸活体检测

为了解决人脸身份认证中的欺诈问题,提出了一种基于图像扩散速度模型和纹理信息的人脸活体检测算法。真实人脸和虚假人脸图像的空间结构不同,为了提取这种差异特征,该方法使用各向异性扩散增强图像的边缘信息。然后,将原始图像与扩散后图像的差值作为图像的扩散速度,并构建扩散速度模型。接着使用局部二值算法提取图像扩散速度特征并训练分类器。真实人脸图像和虚假人脸图像之间存在很多差异特征,为了进一步提高人脸活体检测算法的泛化能力,该方法同时提取人脸图像的模糊程度特征和色彩纹理特征,通过特征矩阵级联的方法将两种特征进行融合,并训练另一个分类器。最后根据分类器输出概率加权融合的结果做出判决。实验结果表明,该算法能够快速有效地检测出虚假的人脸图像。     

Face detection in color images

Human face detection plays an important role in applications such as video surveillance, human computer interface, face recognition, and face image database management. We propose a face detection algorithm for color images in the presence of varying lighting conditions as well as complex backgrounds. Based on a novel lighting compensation technique and a nonlinear color transformation, our method detects skin regions over the entire image and then generates face candidates based on the spatial arrangement of these skin patches. The algorithm constructs eye, mouth, and boundary maps for verifying each face candidate. Experimental results demonstrate successful face detection over a wide range of facial variations in color, position, scale, orientation, 3D pose, and expression in images from several photo collections (both indoors and outdoors)     

基于自举算法和支持向量机的人脸检测系统

针对复杂背景下的灰度图像人脸检测存在计算量大且负检率高等问题,提出了一种有较好可用性的层级递进的人脸检测系统。系统第一部分采用扩展的Haar型特征并结合自举算法,使其分类性能要优于原始的Haar型特征。在系统的第二部分,采用从粗到细的视觉处理逻辑对图像采样,并提出了正面直立人脸的像素值的置信度的概念,且以支持向量机作为学习算法,使系统具有良好的检测性能。该系统在实际应用图像的测试中取得良好效果,具有可用性。     

结合MSCRs与MSERs的自然场景文本检测

目的 目前,基于MSERs(maximally stable extremal regions)的文本检测方法是自然场景图像文本检测的主流方法。但是自然场景图像中部分文本的背景复杂多变,MSERs算法无法将其准确提取出来,降低了该类方法的鲁棒性。本文针对自然场景图像文本背景复杂多变的特点,将MSCRs(maximally stable color regions)算法用于自然场景文本检测,提出一种结合MSCRs与MSERs的自然场景文本检测方法。方法 首先采用MSCRs算法与MSERs算法提取候选字符区域;然后利用候选字符区域的纹理特征训练随机森林字符分类器,对候选字符区域进行分类,从而得到字符区域;最后,依据字符区域的彩色一致性和几何邻接关系对字符进行合并,得到最终文本检测结果。结果 本文方法在ICDAR 2013上的召回率、准确率和F值分别为71.9%、84.1%和77.5%,相对于其他方法的召回率和F值均有所提高。结论 本文方法对自然场景图像文本检测具有较强的鲁棒性,实验结果验证了本文方法的有效性。     

基于Adaboost的红外视频图像疲劳检测算法

针对以往疲劳检测算法普遍存在的受光照条件影响大、检测测速度慢以及可靠性差等问题,本文提出了一种基于Adaboost的疲劳表情快速检测算法。本文算法在不同环境光照的情况下,利用红外光源照明采集获得大量人脸红外图像样本。经过人脸检测定位以后,将人脸区域中眼睛、嘴巴这两个表情信息最集中的关键部位分割出来,用PCA方法分别提取两个子图块的形变特征,分别输入Adaboost训练得到两个分类器。检测时,待检测图像眼、嘴的特征分别通过相应分类器进行判别,将两个分类器的输出进行或运算得到最终的检测结果。该方法正确率高,速度快,具有很好的泛化能力和较强的鲁棒性,能够满足实时应用要求。     

基于DM6437的Adaboost人脸检测算法的设计与实现

研究并实现了基于DM6437的Adaboost人脸检测算法。在对相关的人脸检测算法研究的基础上,选择了适应能力强、错误率小的Adaboost算法,通过对输入样本进行Harr特征提取,从中选出最优的Haar特征,然后将训练得到的Haar特征转换成弱分类器,再将弱分类器优化组合成强分类器,最后形成级联强分类器用于人脸检测。通过OpenCV在计算机上仿真实现该算法,完成了Adaboost人脸检测算法的DSP程序设计,在DM6437硬件平台上实现了人脸实时检测功能。结果表明,运用该算法能够有效地进行人脸检测,可用于工程实践。     

Expressive line drawings of human faces from range images

We propose a novel technique to extract features from a range image and use them to produce a 3D pen-and-ink style portrait similar to a traditional artistic drawing. Unlike most previous template-based,component-based or example-based face sketching methods,which work from a frontal photograph as input,our system uses a range image as input. Our method runs in real-time for models of moderate complexity,allowing the pose and drawing style to be modified interactively. Portrait drawing in our system makes use of occluding contours and suggestive contours as the most important shape cues. However,current 3D feature line detection methods require a smooth mesh and cannot be reliably applied directly to noisy range images. We thus present an improved silhouette line detection algorithm. Feature edges related to the significant parts of a face are extracted from the range image,connected,and smoothed,allowing us to construct chains of line paths which can then be rendered as desired. We also incorporate various portrait-drawing principles to provide several simple yet effective non-photorealistic portrait renderers such as a pen-and-ink shader,a hatch shader and a sketch shader. These are able to generate various life-like impressions in different styles from a user-chosen viewpoint. To obtain satisfactory results,we refine rendered output by smoothing changes in line thickness and opacity. We are careful to provide appropriate visual cues to enhance the viewer’s comprehension of the human face. Our experimental results demonstrate the robustness and effectiveness of our approach,and further suggest that our approach can be extended to other 3D geometric objects.     

An effective method for detecting facial features and face in human-robot interaction

In this paper, an effective method of facial features detection is proposed for human-robot interaction (HRI). Considering the mobility of mobile robot, it is inevitable that any vision system for a mobile robot is bound to be faced with various imaging conditions such as pose variations, illumination changes, and cluttered backgrounds. To detecting face correctly under such difficult conditions, we focus on the local intensity pattern of the facial features. The characteristics of relatively dark and directionally different pattern can provide robust clues for detecting facial features. Based on this observation, we suggest a new directional template for detecting the major facial features, namely the two eyes and the mouth. By applying this template to a facial image, we can make a new convolved image, which we refer to as the edge-like blob map. One distinctive characteristic of this map image is that it provides the local and directional convolution values for each image pixel, which makes it easier to construct the candidate blobs of the major facial features without the information of facial boundary. Then, these candidates are filtered using the conditions associated with the spatial relationship of the two eyes and the mouth, and the face detection process is completed by applying appearance-based facial templates to the refined facial features. The overall detection results obtained with various color images and gray-level face database images demonstrate the usefulness of the proposed method in HRI applications.     

基于轻量级网络的人脸检测及嵌入式实现

尽管基于卷积神经网络(CNN)的人脸检测器在精度上已经有了很大提升,但所需的计算量和模型复杂度越来越高,如何在计算能力有限的嵌入式设备上应用人脸检测模型是一个很大的挑战.针对320×240分辨率输入图像的人脸检测在嵌入式系统上的应用问题,提出了一种基于轻量级网络的低分辨率人脸检测算法.该算法使用注意力机制、结合了Dis...     

New MCT-based face recognition under varying lighting conditions

This paper presents a new face recognition algorithm that is insensitive to variations in lighting conditions. In the proposed algorithm, the MCT (Modified Census Transform) was embedded to extract the local facial features that are invariant under illumination changes. In this study, we also employed an appearance-based method to incorporate both local and global features. First, input facial images are transformed by the MCT and a bit string from the MCT is converted to a decimal number to generate an MCT domain image. This domain image is recognized using principle component analysis (PCA) or linear discriminate analysis (LDA). Experimental results reveal that the recognition rate of the proposed approach is better than that of conventional appearance-based algorithms by approximately 20% for the Yale B database, in the case of severe variations in illumination conditions. We also found that the proposed algorithm yields better performance for the Yale database for various face expressions, eye-wear, and lighting conditions.     

基于视觉特征的非侵入式用户界面输入项识别

识别应用界面中的输入项是界面测试数据自动生成的基础。现有界面输入项信息获取依赖被测对象所在系统提供的信息,无法用于非侵入式测试场合。本文从应用界面的视觉图像出发,提出一种基于视觉特征的非侵入式用户界面输入项识别方法。该方法从外部摄像头等途径获得的应用界面图片出发,利用直线检测和轮廓检测算法得到候选输入项列表,基于视觉特征,利用支持向量机（SVM）模型来对候选输入项进行判别,能够在不依赖被测目标底层系统的情况下获取输入项信息。实验结果表明,本文方法能够基本准确地识别界面图片中的输入项,具有一定的有效性。     

应用深度光学应变特征图的人脸活体检测

目的 随着人脸识别系统应用的日益广泛,提高身份认证的安全性,提升人脸活体检测的有效性已经成为迫切需要解决的问题。针对活体检测中真实用户的照片存在的人脸欺骗问题,提出一种新的解决照片攻击的人脸活体检测算法。方法 利用局部二值模式LBP（local binary pattern）、TV-L1（total variation regularization and the robust L1 norm）光流法、光学应变和深度网络实现的人脸活体检测方法。对原始数据进行预处理得到LBP特征图;对LBP特征图提取光流信息,提高对噪声适应的鲁棒性;计算光流的导数得到图像的光学应变图,以表征相邻两帧之间的微纹理性质的微小移动量;通过卷积神经网络模型（CNN）将每个应变图编码成特征向量,最终将特征向量传递给长短期记忆LSTM（long short term memory）模型进行分类,实现真假人脸的判别。结果 实验在两个公开的人脸活体检测数据库上进行,并将本文算法与具有代表性的活体检测算法进行对比。在南京航空航天大学（NUAA）人脸活体检测数据库中,算法精度达到99.79%;在Replay-attack数据库中,算法精度达到98.2%,对比实验的结果证明本文算法对照片攻击的识别更加准确。结论 本文提出的针对照片攻击的人脸活体检测算法,融合光学应变图像和深度学习模型的优点,使得人脸活体检测更加准确。