Mask guided diverse face image synthesis

Recent studies have shown remarkable success in face image generation task. However, existing approaches have limited diversity, quality and controllability in generating results. To address these issues, we propose a novel end-to-end learning framework to generate diverse, realistic and controllable face images guided by face masks. The face mask provides a good geometric constraint for a face by specifying the size and location of different components of the face, such as eyes, nose and mouse. The framework consists of four components: style encoder, style decoder, generator and discriminator. The style encoder generates a style code which represents the style of the result face; the generator translate the input face mask into a real face based on the style code; the style decoder learns to reconstruct the style code from the generated face image; and the discriminator classifies an input face image as real or fake. With the style code, the proposed model can generate different face images matching the input face mask, and by manipulating the face mask, we can finely control the generated face image. We empirically demonstrate the effectiveness of our approach on mask guided face image synthesis task.     

一种个性化人脸三维建模方法

描述了一种特定人的人脸三维建模方法,该方法用该人的正面及侧面人脸两张照片,通过选择关键特征点,在基本人脸模型基础上,经过变形,得到特定人脸三维网格模型。再经纹理匹配,获得特定人的三维人脸模型。该方法已在微型计算机上进行了模拟,并成功地获得酷似真人的人脸三维模型。     

Greedy face routing with face identification support in wireless networks

Geographic face routing protocols planarize the connectivity graph of a wireless network in a distributed manner and forward packets on the resulted planar topology with high reliability and low overhead. A preferable face routing protocol should provide both guaranteed packet delivery and efficient routing paths, which requires a flexible face switch algorithm adaptive to the network complexity. In this paper, we present a new face routing algorithm named GFRIS that offers both features by performing active probe to measure the face size and generate a unique face identification sequence – face ID. In GFRIS, face switch occurs only if the outgoing edge intersects the local minimum-destination line at a progressive location and the crossing edge is shared between two different faces. To avoid the severe performance penalty when an inefficient face traversal direction is selected on large faces, GFRIS uses the face size to trigger the bounded face traversal procedure as proposed earlier in GOAFR+. As multiple local minimum locations on a face will trigger bounded search repetitively, GFRIS employs a fast forward mode to bypass bidirectional search on the face, which leads to significantly improved path stretch performance. This paper provides a detailed performance comparison between GFRIS and the existing face routing algorithms including GFG, GPSR, GOAFR+ and GFG2. Simulation results show that, by using face ID to assist face switch and adaptively applying the normal and bounded face traversal rules according to the face size, GFRIS can achieve better routing efficiency with low control overhead compared to other protocols evaluated across a wide node density range.     

人物脸部图片的修改与实现*

包括人脸表情修改在内的人体生物特征的操作技术,涉及的脸部图像处理是图像处理学科的技术难点.研究了影响人脸识别技术实用化的一些因素,提出了开发人脸识别与修改技术的方法,开发出一个人脸图像处理系统,主要用于图片中人脸部位的变换与修改,为今后开发性能优良的人脸识别与修改系统奠定基础.     

Image-based face illumination transferring using logarithmic total variation models

In this paper, we present a novel image-based technique that transfers illumination from a source face image to a target face image based on the Logarithmic Total Variation (LTV) model. Our method does not require any prior information regarding the lighting conditions or the 3D geometries of the underlying faces. We first use a Radial Basis Functions (RBFs)-based deformation technique to align key facial features of the reference 2D face with those of the target face. Then, we employ the LTV model to factorize each of the two aligned face images to an illumination-dependent component and an illumination-invariant component. Finally, illumination transferring is achieved by replacing the illumination-dependent component of the target face by that of the reference face. We tested our technique on numerous grayscale and color face images from various face datasets including the Yale face Database, as well as the application of illumination-preserved face coloring.     

基于特征脸的人脸识别系统的研究

人脸识别技术是通过分析人脸图像,并从人脸图像中提取有效的识别信息,用来辨认身份的一门技术.文章阐述了基于特征脸的人脸识别的基本算法,并对该方法进行改进,最后对其进行了仿真.该方法主要通过求出人脸图象与数据库中的特征脸空间距离来进行人脸的识别和分类,做到了快速准确地识别人脸.     

一个人脸识别系统的设计与实现

设计了一个在区分人脸朝向的基础上，再进行人脸辨别的识别系统。把BP网络用于人脸朝向的识别，并且用一组单输出的子网络代替原来的BP网络，提高了人脸朝向的识别率。在人脸朝向的分类基础上，用主元分析法进行人脸识别。实验结果表明此系统提高了人脸的识别率。     

基于特征脸的人脸识别系统的研究

人脸识别技术是通过分析人脸图像,并从人脸图像中提取有效的识别信息,用来辨认身份的一门技术。文章阐述了基于特征脸的人脸识别的基本算法,并对该方法进行改进,最后对其进行了仿真。该方法主要通过求出人脸图象与数据库中的特征脸空间距离来进行人脸的识别和分类,做到了快速准确地识别人脸。     

500-fps face tracking system

In this paper, we propose a high-speed vision system that can be applied to real-time face tracking at 500 fps using GPU acceleration of a boosting-based face tracking algorithm. By assuming a small image displacement between frames, which is a property of high-frame rate vision, we develop an improved boosting-based face tracking algorithm for fast face tracking by enhancing the Viola–Jones face detector. In the improved algorithm, face detection can be efficiently accelerated by reducing the number of window searches for Haar-like features, and the tracked face pattern can be localized pixel-wise even when the window is sparsely scanned for a larger face pattern by introducing skin color extraction in the boosting-based face detector. The improved boosting-based face tracking algorithm is implemented on a GPU-based high-speed vision platform, and face tracking can be executed in real time at 500 fps for an 8-bit color image of 512 × 512 pixels. In order to verify the effectiveness of the developed face tracking system, we install it on a two-axis mechanical active vision system and perform several experiments for tracking face patterns.     

3D通用人脸模型的自适应算法及应用

利用3D人脸建模的方法进行人脸识别有效地克服了2D人脸识别系统中识别率易受光照、姿态、表情影响的缺陷。文章采用一种依据人脸图像对3D通用人脸模型进行自适应调整的有效算法,构造出特定的人脸模型并运用于人脸识别中。通过比较从人脸图像中估算出的特征点与通用人脸模型在图像平面上的投影点之间的关系,对3D通用人脸模型进行全局和局部调整,以适应人脸中眼、口、鼻的个性化特征。最后以一个实例说明了此算法的应用。     

Real-time face tracking and recognition using the mobile robots

The terrain is complex and dynamic in a disaster. This paper aimed at constructing a multipose-specific feature model for online face recognition and tracking in a search and rescue operation. This paper proposes an integrated multipose face tracking and recognition system mounted on an unmanned aerial vehicle (UAV). The face model is constructed online by multi-scale block local binary pattern (MB-LBP) for face recognition. The generic and specific face models are further integrated for face tracking. Mechanisms for the online update of face models to retrieve loss of face tracking are also implemented. The results show that the proposed system achieves stable and robust tracking despite uncertainties (e.g. non-rigid human face, face expression changes, different face poses, complex background, varying illumination, partial visual occlusion, and pose changes). The target loss during tracking can be retrieved correctly. In face recognition, the multipose-specific face model can achieve an accuracy (above 70%). The results demonstrate the feasibility of the proof-of-concept using UAV or ground mobile robot (GMR) for real-time face recognition and tracking.     

多视角级联回归模型人脸特征点定位

针对人脸姿态偏转较大导致人脸特征点定位精度低的问题，提出了多视角人脸特征点定位算法，采用随机森林局部学习与全局线性回归相结合的级联姿态回归（Cascaded Pose Regression，CPR）人脸特征点定位模型，在不同的人脸姿态视角下建立不同的模型，以多模型代替单一模型来提高人脸特征点定位的精度。首先采用CPR模型对不同视角下的人脸建立不同的模型；然后采用多视角生成模型（Multi-View Generative Model，MVGM）来评估输入人脸图片的姿态；最后根据评估的姿态选择相对应的模型，进而实现特征点的精确定位。仿真实验结果表明，相比于现有的几种人脸特征点定位算法，所提算法实现了更精确的定位效果。     

基于深度学习的轻量级和多姿态人脸识别方法

目前基于深度学习的人脸识别方法存在识别模型参数量大、特征提取速度慢的问题,而且现有人脸数据集姿态单一,在实际人脸识别任务中无法取得好的识别效果。针对这一问题建立了一种多姿态人脸数据集,并提出了一种轻量级的多姿态人脸识别方法。首先,使用多任务级联卷积神经网络（MTCNN）算法进行人脸检测,并且使用MTCNN最后包含的高层特征做人脸跟踪;然后,根据检测到的人脸关键点位置来判断人脸姿态,通过损失函数为ArcFace的神经网络提取当前人脸特征,并将当前人脸特征与相应姿态的人脸数据库中的人脸特征比对得到人脸识别结果。实验结果表明,提出方法在多姿态人脸数据集上准确率为96.25%,相较于单一姿态的人脸数据集,准确率提升了2.67%,所提方法能够有效提高识别准确率。     

一种基于可疑人脸区域发现的人脸检测方法

本文提出了一种基于可疑人脸区域发现的人脸检测算法，利用通常情况下眼睛区域比周围区域暗的事实发现可疑人脸区域，然后使用到特征空间的距离(DFFS)方法验证人脸。实验表明本算法具有较高的检测精确度。文中重点介绍了该人脸检测算法，给出了实验结果。     

Evaluating the Quality of Face Alignment without Ground Truth

The study of face alignment has been an area of intense research in computer vision, with its achievements widely used in computer graphics applications. The performance of various face alignment methods is often image‐dependent or somewhat random because of their own strategy. This study aims to develop a method that can select an input image with good face alignment results from many results produced by a single method or multiple ones. The task is challenging because different face alignment results need to be evaluated without any ground truth. This study addresses this problem by designing a feasible feature extraction scheme to measure the quality of face alignment results. The feature is then used in various machine learning algorithms to rank different face alignment results. Our experiments show that our method is promising for ranking face alignment results and is able to pick good face alignment results, which can enhance the overall performance of a face alignment method with a random strategy. We demonstrate the usefulness of our ranking‐enhanced face alignment algorithm in two practical applications: face cartoon stylization and digital face makeup.     

基于KLT和BFGS的人脸姿态估计

在对给定的人脸图像序列准确提取正面人脸特征点后,利用改进的KLT方法跟踪非正面人脸图像的特征点。根据人脸形状特性,使用人脸的多个特征点作为人脸模型。在近似估计人脸姿态后,以改进的BFGS算法精确估计3D人脸空间姿态。实验结果证明,该方法可以获得唯一的3D人脸空间姿态,相比同类方法有更好的姿态估计精确度。     

A mosaicing scheme for pose-invariant face recognition.

Mosaicing entails the consolidation of information represented by multiple images through the application of a registration and blending procedure. We describe a face mosaicing scheme that generates a composite face image during enrollment based on the evidence provided by frontal and semiprofile face images of an individual. Face mosaicing obviates the need to store multiple face templates representing multiple poses of a user's face image. In the proposed scheme, the side profile images are aligned with the frontal image using a hierarchical registration algorithm that exploits neighborhood properties to determine the transformation relating the two images. Multiresolution splining is then used to blend the side profiles with the frontal image, thereby generating a composite face image of the user. A texture-based face recognition technique that is a slightly modified version of the C2 algorithm proposed by Serre et al. is used to compare a probe face image with the gallery face mosaic. Experiments conducted on three different databases indicate that face mosaicing, as described in this paper, offers significant benefits by accounting for the pose variations that are commonly observed in face images.     

基于编解码网络的人脸对齐和重建算法

针对现有的三维人脸重建模型复杂度较高和对多种人脸姿态重建效果不佳的问题, 本文提出了一种可以在不同人脸姿态条件下, 有效地实现人脸对齐并从单张二维人脸图片重建出三维人脸的卷积神经网络. 首先设计了由密集卷积网络模块和转置卷积模块构成的编解码网络, 并在损失函数中引入图像结构相似度评价, 构造新的损失函数, 通过训练神经网络得出模型, 模型实现了人脸对齐和三维人脸重建任务. 在AFLW2000-3D数据集上验证性能,实验表明该网络有效提升了人脸对齐和人脸重建的效果.     

未知光源参数的人脸光照恢复方法

数字人像技术在实际应用中有广泛的应用前景．在未知光源位置的非均匀光照射下的人脸光照归一化问题是人脸识别技术的一大难题．对在未知光源位置的非均匀光照射下的正面人脸图像提出了一种基于参考人脸模型的方法．它使用参考人脸模型估计人脸的光照阴影区域,把人脸的纹理表示为训练图像模型的线性组合,根据人脸光照明亮区域的纹理信息,使用最小二乘法估计出最优的线性组合系数,从而重建原图像人脸纹理实现人脸光照恢复．实验表明这种方法对于阴影处的人脸信息恢复不仅是有效的而且是快速的．     

头部多角度人脸快速跟踪算法DSP实现

针对传统驾驶员疲劳检测人脸跟踪算法复杂,DSP实现时实时性不强,不能有效地实现多角度人脸跟踪的问题,提出了一种快速人脸跟踪算法.该算法通过对YCbCr肤色模型进行图像预处理、肤色检测,提取人脸区域,通过对亮度信号Y进行统计运算,判断人脸边界,再进行相似度判断,从而实现人脸区域的跟踪.实验结果表明,该方法简单、鲁棒性强,能够快速地实现彩色图像人脸多角度跟踪.