自拍相机运动手势交互界面的设计与实现

随着智能移动终端的发展及摄像镜头的小型化,自拍变得越来越流行。如何设计新型自拍交互方法使得用户在自拍过程中能够自由、实时地控制相机是自拍相机交互界面的关键问题。提出利用基于视觉的运动手势交互界面的新方法,使自拍过程中用户只要挥一挥手臂就可以实现与自拍相机的交互功能。使用手势交互的方法,用户可以把相机放在任意的平台上,自由地摆出各种自拍姿态,增加了自拍的丰富性,提高了用户体验。主要提出挥手及画圈两种交互手势,通过组合应用可以实现丰富高效的自拍交互控制功能,如快门控制、白平衡,曝光度等。手势的识别利用相机摄像的实时图像进行处理,采用稀疏光流算法来识别运动手势。用户评估实验表明,所提出运动手势自拍交互界面具有较好的交互效率以及良好的用户满意度,两种手势的识别效率约为85%。     

基于形态学商图像的光照归一化算法

复杂光照条件下的人脸识别是一个困难但需迫切解决的问题,为此提出了一种有效的光照归一化算法.该方法根据面部光照特点,基于数学形态学和商图像技术对各种光照条件下的人脸图像进行归一化处理,并且将它发展到动态地估计光照强度,进一步增强消除光照和保留特征的效果.与传统的技术相比,该方法无须训练数据集以及假定光源位置,并且每人只需一幅注册图像.在耶鲁人脸图像库B上的测试表明,该算法以较小的计算代价取得了优良的识别性能.     

基于透视投影下空间光照一致性分析的图像拼接篡改检测

将一个人的头像剪切并拼接到另一张照片中,是一种常见的图像篡改手段.如果将该合成照片用于敲诈勒索,会对社会带来严重危害.因此,用来检测图像篡改的图像取证技术具有重大意义.由于不同照片成像环境不同,拼接时很难做到不同人脸的光照绝对一致,因此可以通过光照是否一致检测篡改.以往光照估计方法基于平行投影的假设,利用照片投影光照进行光照一致性分析.实际上,相机针孔模型是透视投影,从而导致上述检测方法出现误差.针对这一问题,本文提出一种透视投影下物体空间光照估计算法,将各人脸姿态统一到相机坐标系下,估计各人脸相对于相机坐标系的空间光照,然后分析空间光照一致性.另外,根据人脸空间光照一致性约束可以优化出相机参数,并得到该参数下的等效焦距、人脸空间位置及重新透视投影的图像等空间信息.本文将空间光照的一致性和上述空间信息的合理性作为依据,对人脸图像进行拼接篡改检测.实验结果表明,相比于传统方法基于平行投影光照进行光照一致性分析,采用本文提出的方法得到的空间光照进行光照一致性分析具有更高的准确度,结合相关信息进行照片空间合理性分析的篡改检测方法具有更强的说服力.     

Face recognition under varying illumination based on a 2D face shape model

This paper proposes a novel illumination compensation algorithm, which can compensate for the uneven illuminations on human faces and reconstruct face images in normal lighting conditions. A simple yet effective local contrast enhancement method, namely block-based histogram equalization (BHE), is first proposed. The resulting image processed using BHE is then compared with the original face image processed using histogram equalization (HE) to estimate the category of its light source. In our scheme, we divide the light source for a human face into 65 categories. Based on the category identified, a corresponding lighting compensation model is used to reconstruct an image that will visually be under normal illumination. In order to eliminate the influence of uneven illumination while retaining the shape information about a human face, a 2D face shape model is used. Experimental results show that, with the use of principal component analysis for face recognition, the recognition rate can be improved by 53.3% to 62.6% when our proposed algorithm for lighting compensation is used.     

利用场景光照识别优化的双目活体检测方法

人脸识别是生物特征识别技术中应用最广的技术之一。其中,能判断人脸图像是否是真实人脸的活体检测模块,是系统安全运行的重要保障。目前从安全度和经济性两方面综合考虑,最常用的活体检测方法是双目活体检测。但由于不同场景下光线亮度和角度变化很大,拍摄的人脸图片质量参差不齐,严重影响了活体检测的质量。针对这一问题,提出了通过对场景光照识别进行优化从而提升检测准确度的双目活体识别算法。算法通过串级PID算法对摄像头的感光度和补光灯进行控制,并利用人脸识别算法定位优化测光区域,从而对不同的光线强度和角度采取不同的策略。经过实验验证:本方法将活体检测在复杂场景下的准确率提升约30%,保证了算法在室内外不同光照场景下的有效性。     

Face recognition under varying illumination

To eliminate the effects of illumination variation, the conventional approaches firstly produce a compensation-based face image under standard illumination from the input image and then match the image with the face templates in a database. This method is not inapplicable to the input image with large illumination variation. Therefore, a novel method for varying illumination conditions is proposed. Firstly, the quotient image method is improved. Then, the nine basis images of each subject are generated by the improved quotient image method. Thirdly, one new image of each subject under the same lighting conditions with an input image is synthesized by the corresponding basis images. Finally, the synthetic images and the input image are projected to PCA plane to fulfill the recognition task. The experimental results show that the proposed approach can eliminate the effects of illumination variation and have a high recognition rate in the illumination conditions with remarkable changes.     

Attacks on state-of-the-art face recognition using attentional adversarial attack generative network

With the broad use of face recognition, its weakness gradually emerges that it is able to be attacked. Therefore, it is very important to study how face recognition networks are subject to attacks. Generating adversarial examples is an effective attack method, which misleads the face recognition system through obfuscation attack (rejecting a genuine subject) or impersonation attack (matching to an impostor). In this paper, we introduce a novel GAN, Attentional Adversarial Attack Generative Network (A³GN), to generate adversarial examples that mislead the network to identify someone as the target person not misclassify inconspicuously. For capturing the geometric and context information of the target person, this work adds a conditional variational autoencoder and attention modules to learn the instance-level correspondences between faces. Unlike traditional two-player GAN, this work introduces a face recognition network as the third player to participate in the competition between generator and discriminator which allows the attacker to impersonate the target person better. The generated faces which are hard to arouse the notice of onlookers can evade recognition by state-of-the-art networks and most of them are recognized as the target person.

     

基于多特征融合的复杂光照人脸识别

提取人脸图像光照不变量是提高不完备训练样本人脸识别光照鲁棒性的一个有效途径。以往算法分别从不同角度提取人脸图像的高频特征作为光照不变量不能提取完整的人脸本征,具有一定的局限性。从特征级和决策级融合的角度提出了一种基于多特征融合的复杂光照人脸识别方法。所提算法能发挥不同光照不变量的自身优势,明显提高复杂光照人脸识别的光照鲁棒性。Yale B+和非控光照人脸库的实验结果表明所提算法的有效性。     

Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions

In this paper, we present a new method to modify the appearance of a face image by manipulating the illumination condition, when the face geometry and albedo information is unknown. This problem is particularly difficult when there is only a single image of the subject available. Recent research demonstrates that the set of images of a convex Lambertian object obtained under a wide variety of lighting conditions can be approximated accurately by a low-dimensional linear subspace using a spherical harmonic representation. Moreover, morphable models are statistical ensembles of facial properties such as shape and texture. In this paper, we integrate spherical harmonics into the morphable model framework by proposing a 3D spherical harmonic basis morphable model (SHBMM). The proposed method can represent a face under arbitrary unknown lighting and pose simply by three low-dimensional vectors, i.e., shape parameters, spherical harmonic basis parameters, and illumination coefficients, which are called the SHBMM parameters. However, when the image was taken under an extreme lighting condition, the approximation error can be large, thus making it difficult to recover albedo information. In order to address this problem, we propose a subregion-based framework that uses a Markov random field to model the statistical distribution and spatial coherence of face texture, which makes our approach not only robust to extreme lighting conditions, but also insensitive to partial occlusions. The performance of our framework is demonstrated through various experimental results, including the improved rates for face recognition under extreme lighting conditions.     

人脸识别中光照梯度补偿算法的改进

光照变化是影响人脸识别的重要因素。光照梯度补偿是解决这一问题的方法之一。该方法通过最小二乘法计算出一个光照平面,然后将原图像减去光照平面,用所得的差图像来识别人脸。由于人脸的两半并非共面,它们与入射光线形成的角度是不同的,因此光照平面应该是不同的。如果分别计算两个光照平面又将导致差图像不连续。本文提出了一种算法,将两个半脸的光照平面系数合成一个系数向量,一同求解这些系数,然后调整其中的常系数项,使两边连续。从而实现,两边的光照平面不同,又保持了连续性。实验结果表明效果良好。     

Fast, reliable head tracking under varying illumination: anapproach based on registration of texture-mapped 3D models

A technique for 3D head tracking under varying illumination is proposed. The head is modeled as a texture mapped cylinder. Tracking is formulated as an image registration problem in the cylinder's texture map image. The resulting dynamic texture map provides a stabilized view of the face that can be used as input to many existing 2D techniques for face recognition, facial expressions analysis, lip reading, and eye tracking. To solve the registration problem with lighting variation and head motion, the residual registration error is modeled as a linear combination of texture warping templates and orthogonal illumination templates. Fast stable online tracking is achieved via regularized weighted least-squares error minimization. The regularization tends to limit potential ambiguities that arise in the warping and illumination templates. It enables stable tracking over extended sequences. Tracking does not require a precise initial model fit; the system is initialized automatically using a simple 2D face detector. It is assumed that the target is facing the camera in the first frame. The formulation uses texture mapping hardware. The nonoptimized implementation runs at about 15 frames per second on a SGI O2 graphic workstation. Extensive experiments evaluating the effectiveness of the formulation are reported. The sensitivity of the technique to illumination, regularization parameters, errors in the initial positioning, and internal camera parameters are analyzed. Examples and applications of tracking are reported     

基于几何模型的单幅人脸图像光照补偿方法

为减少光照对人脸识别的影响,本文提出了一种以补偿角度和（Sum of Compensated Angle）为不变量的光照补偿新方法. 首先,补偿角度和是临界补偿状态下两幅图像的光照角度之和. 对某单光源系统,该不变量仅由光照系统决定且为定值. 其次,根据人类头骨在法兰克福截面的形状特性,我们提出了包含人头骨结构的几何人脸光照模型. 据此模型,补偿角度由不变量和待补偿图像的光照角度计算得出,从而将光照补偿转化为简单加法操作. 最后,在Yale B人脸数据库上的补偿结果表明了算法的有效性. 较Sang-Ⅱ Choi的方法显著地提高了大角度下的补偿效果,且在水平和竖直方向上更加鲁棒.     

一种适用于人脸检测的自适应光照补偿方法

为了解决复杂光照条件下的人脸检测问题,提出一种人脸光照补偿新方法。该方法先使用高通滤波增强边缘信息,同时利用对数变换和指数变换调节全局亮度,最后利用非线性变化削弱局部高光和阴影的影响,改善图像光照不均衡的情况,最终实现光照补偿。在YaleB人脸库、Orl人脸库以及自建人脸库上分别对光照不均匀人脸图像和均匀光照下的人脸图像进行了实验,证明该方法能有效地进行光照补偿,提高人脸检测率。     

Curvature Based Image Registration

A fully automated, non-rigid image registration algorithm is presented. The deformation field is found by minimizing a suitable measure subject to a curvature based constraint. It is a well-known fact that non-rigid image registration techniques may converge poorly if the initial position is not sufficiently near to the solution. A common approach to address this problem is to perform a time consuming rigid pre-registration step. In this paper we show that the new curvature registration not only produces accurate and smooth solutions but also allows for an automatic rigid alignment. Thus, in contrast to other popular registration schemes, the new method no longer requires a pre-registration step. Furthermore, we present an implementation of the new scheme based on the numerical solution of the underlying Euler-Lagrange equations. The real discrete cosine transform is the backbone of our implementation and leads to a stable and fast O(N log N) algorithm, where N denotes the number of voxels. Finally, we report on some numerical test runs.     

From few to many: illumination cone models for face recognitionunder variable lighting and pose

We present a generative appearance-based method for recognizing human faces under variation in lighting and viewpoint. Our method exploits the fact that the set of images of an object in fixed pose, but under all possible illumination conditions, is a convex cone in the space of images. Using a small number of training images of each face taken with different lighting directions, the shape and albedo of the face can be reconstructed. In turn, this reconstruction serves as a generative model that can be used to render (or synthesize) images of the face under novel poses and illumination conditions. The pose space is then sampled and, for each pose, the corresponding illumination cone is approximated by a low-dimensional linear subspace whose basis vectors are estimated using the generative model. Our recognition algorithm assigns to a test image the identity of the closest approximated illumination cone. Test results show that the method performs almost without error, except on the most extreme lighting directions     

Local histogram specification for face recognition under varying lighting conditions

High frequency illumination and low frequency face features bring difficulties for most of the state-of-the-art face image preprocessors. In this paper, we propose two methods based on Local Histogram Specification (LHS) to preprocess face images under varying lighting conditions. The proposed methods are able to significantly remove both the low and high frequency parts of illumination on face images, as well as enhance face features lying in the low frequency part. Specifically, we first apply a high-pass filter on a face image to filter the low frequency illumination. Then, local histograms and local histogram statistics are learned from normal lighting images. In our first method, LHS is applied on the entire image. By contrast, in the second method, the regions contain high frequency illumination and weak face features on a face image are identified by local histogram statistics, before LHS is applied on these regions to eliminate high frequency illumination and enhance weak face features. Experimental results on the CMU PIE, Extended Yale B and CAS-PEAL-R1 databases demonstrate the effectiveness and efficiency of our methods.     

What Is the Set of Images of an Object Under All Possible Illumination Conditions?

The appearance of an object depends on both the viewpoint from which it is observed and the light sources by which it is illuminated. If the appearance of two objects is never identical for any pose or lighting conditions, then–in theory–the objects can always be distinguished or recognized. The question arises: What is the set of images of an object under all lighting conditions and pose? In this paper, we consider only the set of images of an object under variable illumination, including multiple, extended light sources and shadows. We prove that the set of n-pixel images of a convex object with a Lambertian reflectance function, illuminated by an arbitrary number of point light sources at infinity, forms a convex polyhedral cone in IRⁿ and that the dimension of this illumination cone equals the number of distinct surface normals. Furthermore, the illumination cone can be constructed from as few as three images. In addition, the set of n-pixel images of an object of any shape and with a more general reflectance function, seen under all possible illumination conditions, still forms a convex cone in IRⁿ. Extensions of these results to color images are presented. These results immediately suggest certain approaches to object recognition. Throughout, we present results demonstrating the illumination cone representation.

     

Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics

In this paper, we propose two novel methods for face recognition under arbitrary unknown lighting by using spherical harmonics illumination representation, which require only one training image per subject and no 3D shape information. Our methods are based on the result which demonstrated that the set of images of a convex Lambertian object obtained under a wide variety of lighting conditions can be approximated accurately by a low-dimensional linear subspace. We provide two methods to estimate the spherical harmonic basis images spanning this space from just one image. Our first method builds the statistical model based on a collection of 2D basis images. We demonstrate that, by using the learned statistics, we can estimate the spherical harmonic basis images from just one image taken under arbitrary illumination conditions if there is no pose variation. Compared to the first method, the second method builds the statistical models directly in 3D spaces by combining the spherical harmonic illumination representation and a 3D morphable model of human faces to recover basis images from images across both poses and illuminations. After estimating the basis images, we use the same recognition scheme for both methods: we recognize the face for which there exists a weighted combination of basis images that is the closest to the test face image. We provide a series of experiments that achieve high recognition rates, under a wide range of illumination conditions, including multiple sources of illumination. Our methods achieve comparable levels of accuracy with methods that have much more onerous training data requirements. Comparison of the two methods is also provided.     

AMSR与SVM相结合的人脸识别方法

为解决在复杂光照条件下的人脸识别问题,提出一种自适应多尺度Retinex(AMSR)和支持向量机(SVM)相结合的人脸识别算法;首先,针对多尺度Retinex(MSR)只能处理光照均匀图像的缺点,提出了AMSR算法,该算法在MSR基础上增加了全局非线性对比度增强方法,使图像的灰度能够根据人脸图像的明暗度进行全局自适应调整,实现了各种光照条件下的人脸图像预处理;然后利用SVM多分类算法对人脸图像进行分类;在人脸库的实验结果证明了AMSR+SVM人脸识别算法的有效性。