基于多数据融合的快速人脸检测与特征定位算法

针对彩色图像提出了基于肤色和特征验证的人脸检测算法,由肤色分割、排除假区域、特征验证3部分组成。在肤色分割部分,提出自适应阈值法,再通过几何特征排除一些假区域,运用边缘检测、模板匹配和投影法精确定位眼睛和嘴巴,从而验证确认人脸,最后通过投影法定位出鼻子。实验证明该算法检测速度快、准确率高,具有较好的鲁棒性。     

An automatic algorithm for semantic object generation and temporal tracking

Automatic semantic video object extraction is an important step for providing content-based video coding, indexing and retrieval. However, it is very difficult to design a generic semantic video object extraction technique, which can provide variant semantic video objects by using the same function. Since the presence and absence of persons in an image sequence provide important clues about video content, automatic face detection and human being generation are very attractive for content-based video database applications. For this reason, we propose a novel face detection and semantic human object generation algorithm. The homogeneous image regions with accurate boundaries are first obtained by integrating the results of color edge detection and region growing procedures. The human faces are detected from these homogeneous image regions by using skin color segmentation and facial filters. These detected faces are then used as object seed for semantic human object generation. The correspondences of the detected faces and semantic human objects along time axis are further exploited by a contour-based temporal tracking procedure.     

人脸检测跟踪与特征点定位系统

实现的人脸检测跟踪与特征点定位系统,基于VC++6.0开发平台,使用opencv作为开发工具,有效缩短了系统的开发时间。首先,本系统采用adaboost算法进行人脸检测,通过合理的特征模板的选择实现了人脸的实时检测;其次,人脸跟踪模块选用camshift算法,利用人脸检测模块生成的人脸坐标传递给跟踪模块,实现人脸的自动实时跟踪,同时建立多个camshift跟踪器对多人脸进行跟踪,并有效地解决了人脸遮挡的问题;最后,通过ASM(active shapemodel)算法实现了实时人脸特征点定位。实验结果表明该系统实现的人脸实时检测跟踪及特征点定位,效果明显,可以作为表情分析和情感计算、视频人脸识别开发的基础。     

一种改进的窄带算法在彩色序列图像人脸跟踪中的应用

该文提出了一种基于几何主动轮廓模型的人脸跟踪方法.通过直方图反向投影,使人脸区域表现为一个一致性区域与背景相区别.研究了一种改进的窄带算法实现曲线演化:以等间隔分布的节点表示运动曲线,只在这些节点上计算Level set函数的变化值,窄带区内其余点的Level set值的更新通过插值和查表的方法实现;根据节点的局部图像信息决定节点的运动方向和时间步长值.实验表明该算法能在满足一定精度的前提下,快速地对运动人脸进行跟踪.     

一种基于多级梯度能量特征的DCT 压缩域人脸检测算法

压缩域人脸检测在图像/视频信息处理中具有重要意义.本文提出了一种基于多级梯度能量特征的DCT (Discrete Cosine Transform)压缩域人脸检测算法.依据DCT压缩图像色差信号的直流系数进行肤色分割,减小检测范围.在分割为肤色的区域提取多级梯度能量特征,即利用不同大小的检测窗口提取归一化的特征向量,表示不同大小的人脸.特征向量输入到级联分类器中分类,确定是否表示人脸.级联分类器由若干简单分类器和一个神经网络分类器构成.简单分类器利用一些先验知识排除大部分明显不是人脸的特征向量,通过简单分类器的特征由神经网络最终确定是否表示人脸.多级梯度能量特征与DCT域图像缩放相结合实现了对不同大小人脸的快速检测.对多级梯度能量特征的定义,减少了检测算法中压缩域图像缩放的次数,从而大幅度减少了计算复杂度,提高了检测速度.实验结果表明提出的多级梯度能量特征可有效描述DCT域人脸模式,同时也证明了该算法的快速有效性.     

Nonlinear color space and spatiotemporal MRF for hierarchical segmentation of face features in video

This paper deals with the low-level joint processing of color and motion for robust face analysis within a feature-based approach. To gain robustness and contrast under unsupervised viewing conditions, a nonlinear color transform relevant for hue segmentation is derived from a logarithmic model. A hierarchical segmentation scheme is based on Markov random field modeling, that combines hue and motion detection within a spatiotemporal neighborhood. Relevant face regions are segmented without parameter tuning. The accuracy of the label fields enables not only face detection and tracking but also geometrical measurements on facial feature edges, such as lips or eyes. Results are shown both on typical test sequences and on various sequences acquired from micro- or mobile cameras. The efficiency of the method makes it suitable for real-time applications aiming at audiovisual communication in unsupervised environments.     

复杂背景下的人脸分割

针对复杂背景下人脸位置的不确定性和人脸轮廓边缘点的不连续性,本文提出一种新的人脸分割算法,能够在复杂背景下将人脸快速分割出来。本文算法包括三部分:首先设计了特征与模板相结合的人脸定位算法,在复杂背景中以双眼和嘴的坐标为基准确定人脸位置;其次,设计了自适应搜索算法,提取真正的人脸轮廓点,去除“假”轮廓点;最后利用人脸轮廓的平滑性通过曲线拟合来补充不确定轮廓点,完成人脸分割。本文算法综合利用了人脸的肤色、表面结构、轮廓边缘以及轮廓的平滑性等特征完成人脸分割,实验结果证明了算法的有效性。     

基于特征点定位与肤色分割的胡子检测算法

针对具有一定程度偏转和模糊的人脸图像难以实现胡子检测的问题,提出基于人脸特征点定位与肤色分割的胡子检测算法.该算法的设计思路是首先使用主动形状模型(ASM)算法定位人脸特征点进而获取下巴区域,然后利用提出的自动选择聚类中心(ASCC)的肤色分割算法分离出下巴的非肤色区域,最后在下巴非肤色区域中使用胡子颜色判别法检测得到胡子.在LFW人脸库上的实验表明,该算法能够准确地检测出入脸的胡子,特别地,对有一定程度偏转和模糊的人脸图像,算法依然能获取良好的检测效果.     

An efficient face segmentation algorithm based on binary partition tree

This paper presents an efficient face segmentation algorithm based on binary partition tree. Skin-like regions are first obtained by integrating the results of pixel classification and watershed segmentation. Facial features are extracted by the techniques of valley detection and entropic thresholding, and are used to refine the skin-like regions. In order to segment the facial regions from the skin-like regions, a novel region merging algorithm is proposed by considering the impact of the common border ratio between adjacent regions, and the binary partition tree is used to represent the whole region merging process. Then the facial likeness of each node in the binary partition tree is evaluated using a set of fuzzy membership functions devised for a number of facial primitives of geometrical, elliptical and facial features. Finally, an efficient algorithm of node selecting in the binary partition tree is proposed for the final face segmentation, which can exactly segment the faces without any underlying assumption. The performance of the proposed face segmentation algorithm is demonstrated by experimental results carried out on a variety of images in different scenarios.     

基于肤色模型的人脸检测算法研究

利用一种基于肤色的2D Gaussian模型和一定的先验知识实现了人脸快速检测。首先对一幅图像进行去噪、光线补偿等预处理,然后根据颜色空间特性建立适宜的肤色模型,检测出大致的肤色轮廓,对面部特征根据先验知识实现定位,从而剔除非脸部区域,最后对该算法进行实验验证。实验表明,该算法可以实现人脸的快速检测,降低了误报率,具有一定的优越性。     

Saliency model-based face segmentation and tracking in head-and-shoulder video sequences

In this paper, a novel face segmentation algorithm is proposed based on facial saliency map (FSM) for head-and-shoulder type video application. This method consists of three stages. The first stage is to generate the saliency map of input video image by our proposed facial attention model. In the second stage, a geometric model and an eye-map built from chrominance components are employed to localize the face region according to the saliency map. The third stage involves the adaptive boundary correction and the final face contour extraction. Based on the segmented result, an effective boundary saliency map (BSM) is then constructed, and applied for the tracking based segmentation of the successive frames. Experimental evaluation on test sequences shows that the proposed method is capable of segmenting the face area quite effectively.     

Real-Time Automated Video and Audio Capture with Multiple Cameras and Microphones

This work presents the acoustic and visual-based tracking system functioning at the Harvard Intelligent Multi-Media Environments Laboratory (HIMMEL). The environment is populated with a number of microphones and steerable video cameras. Acoustic source localization, video-based face tracking and pose estimation, and multi-channel speech enhancement methods are applied in combination to detect and track individuals in a practical environment while also providing an improved audio signal to accompany the video stream. The video portion of the system tracks talkers by utilizing source motion, contour geometry, color data, and simple facial features. Decisions involving which camera to use are based on an estimate of the head's gazing angle. This head pose estimation is achieved using a very general head model which employs hairline features and a learned network classification procedure. Finally, a beamforming and postfiltering microphone array technique is used to create an enhanced speech waveform to accompany the recorded video signal. The system presented in this paper is robust to both visual clutter (e.g. ovals in the scene of interest which are not faces) and audible noise (e.g. reverberations and background noise).     

融合局部语义与全局信息的人脸表情识别

人脸表情识别在人机交互等人工智能领域发挥着 重要作用,当前研究忽略了人脸的语 义信息。本 文提出了一种融合局部语义与全局信息的人脸表情识别网络,由两个分支组成:局部语义区 域提取分支 和局部-全局特征融合分支。首先利用人脸解析数据集训练语义分割网络得到人脸语义解析 ,通过迁移训 练的方法得到人脸表情数据集的语义解析。在语义解析中获取对表情识别有意义的区域及其 语义特征, 并将局部语义特征与全局特征融合,构造语义局部特征。最后,融合语义局部特征与全局特 征构成人脸 表情的全局语义复合特征,并通过分类器分为7种基础表情之一。本文同时提出了解冻部分 层训练策略, 该训练策略使语义特征更适用于表情识别,减 少语义信息冗余性。在两个公开数据集JAFFE 和KDEF上 的平均识别准确率分别达到了93.81%和88.78% ,表现优于目前的深度学习方法和传统方法。实验结果证 明了本文提出的融合局部语义和全局信息的网络能够很好地描述表情信息。     

基于下颌轮廓线的人脸分类方法

在人脸正面图像中,下颌轮廓线是一种相对稳定的形状特征,但是如何提取和有效利用这个特征是一个难题。提出一种在识别中有效利用下颌轮廓特征进行人脸分类的方法。根据先验知识将人脸分为圆脸、尖脸和方脸,据此建立下颌形状模板：尖下巴、圆下巴和平下巴。对事先得到的下颌轮廓上的点进行模板匹配,根据匹配结果进行轮廓线分类。该算法采用了基于先验分布和局部判别的方法,先得到可能的轮廓点,然后进行滤波去除伪下颌点,得到真正位于下颌轮廓上的点,再通过模板匹配进行分类。试验表明,该方法分类效果良好,可以有效提高大库人脸识别的速度和识别率。     

Application of SVM and its Improved Model in Image Segmentation

In the research and application of images, people are often only interested in the foreground or specific area of the image, so it is necessary to extract the specific area from the image, and image segmentation technology is the key to solving this problem. Aiming at the complex background and the color image with unclear target contour as the target image to be segmented, this paper first uses the texture and color of the image as the feature vector, and proposes an image segmentation algorithm based on SVM. The experimental results show that the segmentation accuracy is 91.23%. Secondly, in order to improve the accuracy of segmentation, the SVM algorithm is improved. The improved SVM algorithm is based on the grid search method to optimize the parameters C and g in the SVM. At the same time, the HIS color channel is added to the feature vector to obtain more Excellent SVM image segmentation model. Finally, the color image segmentation is verified and compared with the standard SVM algorithm. The experimental results show that the accuracy rate of the improved SVM algorithm reaches 97.263%, which improves the segmentation efficiency. It is verified that the improved model proposed in this paper can effectively segment complex color images.

     

Robust face detection and analysis

This paper presents a method which utilizes color, local symmetry and geometry information of human face based on various models. The algorithm first detects most likely face regions or ROIs (Region-Of-Interest) from the image using face color model and face outline model, produces a face color similarity map. Then it performs local symmetry detection within these ROIs to obtain a local symmetry similarity map. The two maps and local similarity map are fused to obtain potential facial feature points. Finally similarity matching is performed to identify faces between the fusion map and face geometry model under affine transformation. The output results are the detected faces with confidence values. The experimental results demonstrate its validity and robustness to identify faces under certain variations.     

Expression transfer for facial sketch animation

This paper presents a hierarchical animation method for transferring facial expressions extracted from a performance video to different facial sketches. Without any expression example obtained from target faces, our approach can transfer expressions by motion retargetting to facial sketches. However, in practical applications, the image noise in each frame will reduce the feature extraction accuracy from source faces. And the shape difference between source and target faces will influence the animation quality for representing expressions. To solve these difficulties, we propose a robust neighbor-expression transfer (NET) model, which aims at modeling the spatial relations among sparse facial features. By learning expression behaviors from neighbor face examples, the NET model can reconstruct facial expressions from noisy signals. Based on the NET model, we present a hierarchical method to animate facial sketches. The motion vectors on the source face are adjusted from coarse to fine on the target face. Accordingly, the animation results are generated to replicate source expressions. Experimental results demonstrate that the proposed method can effectively and robustly transfer expressions by noisy animation signals.     

基于色彩和纹理特征融合的模糊人脸识别方法

基于纹理特征的方法被广泛应用于人脸识别。然而纹理特征依赖于图像的高频细节信息,当图像出现模糊时,单纯利用纹理特征的识别方法的识别精度会急剧下降。为了克服纹理特征的在模糊人脸识别中的不足,提出了一种基于色彩特征和纹理特征融合的识别方法。首先参照人类的对立色感知机制提取人脸的色彩特征;然后,将该色彩特征和纹理特征分别用于识别分类;最后,将二者的识别相似度进行融合,得到最终的识别结果。该色彩特征描述了图像的低频信息,其对图像模糊不敏感,并且与描述图像高频信息的纹理特征具有良好的互补性。在FERET 和AR 人脸库上的实验表明,融合色彩特征和纹理特征有效地提高了模糊人脸的识别精度。     

Efficient multiple faces tracking based on Relevance Vector Machine and Boosting learning

A multiple faces tracking system was presented based on Relevance Vector Machine (RVM) and Boosting learning. In this system, a face detector based on Boosting learning is used to detect faces at the first frame, and the face motion model and color model are created. The face motion model consists of a set of RVMs that learn the relationship between the motion of the face and its appearance, and the face color model is the 2D histogram of the face region in CrCb color space. In the tracking process different tracking methods (RVM tracking, local search, giving up tracking) are used according to different states of faces, and the states are changed according to the tracking results. When the full image search condition is satisfied, a full image search is started in order to find new coming faces and former occluded faces. In the full image search and local search, the similarity matrix is introduced to help matching faces efficiently. Experimental results demonstrate that this system can (a) automatically find new coming faces; (b) recover from occlusion, for example, if the faces are occluded by others and reappear or leave the scene and return; (c) run with a high computation efficiency, run at about 20 frames/s.     

基于Adaboost算法的人脸检测技术的研究与实现

人脸检测是人脸识别技术的基础,首先提出人脸检测系统的构成,分析Adaboost算法对图像进行人脸检测的基本原理。根据Adaboost算法形成了简单的矩形特征作为人脸特征,即Haar-like特征,然后由多个Haar-like特征相当于一个弱分类器,由多个弱分类器级联成为一个强的分类器,并将级联分类器用于动态人脸检测中,从截取的每一帧图像中进行检测。经过实验验证,采用这种方法和步骤进行人脸检测达到了比较好的精度和速度,N-I~T来的人脸识别提供了前提条件。