一种基于视觉词袋模型的人脸识别方法

针对人脸图像因受表情、光照、角度等因素影响,导致人脸识别率较低的状况,提出了一种基于视觉词袋模型的人脸识别方法。该方法首先对图像进行分块并提取局部特征,其次利用训练样本的所有局部特征训练全局的混合高斯模型,然后以此为初始化训练单张图像的混合高斯模型,生成该图像全局特征向量,最后用PLDA进行人脸识别。通过在LFW数据库上进行实验,结果显示本方法的识别率高于传统的特征提取方法,证明了本方法具有更强的识别性能。     

一种无标记点人脸表情捕捉与重现算法

提出了一种无标记点的人脸表情捕捉方法.首先根据ASM（Active Shape Model）人脸特征点生成了覆盖人脸85%面部特征的人脸均匀网格模型;其次,基于此人脸模型提出了一种表情捕捉方法,使用光流跟踪特征点的位移变化并辅以粒子滤波稳定其跟踪结果,以特征点的位移变化驱动网格整体变化,作为网格跟踪的初始值,使用网格的形变算法作为网格的驱动方式.最后,以捕捉到的表情变化数据驱动不同的人脸模型,根据模型的维数不同使用不同的驱动方法来实现表情动画重现,实验结果表明,提出的算法能很好地捕捉人脸表情,将捕捉到的表情映射到二维卡通人脸和三维虚拟人脸模型都能取得较好的动画效果.     

基于稀疏表示的人脸姿态估计研究

针对人脸光照、遮挡、身份、表情等因素变化的人脸姿态估计难题,结合稀疏表示分类(SRC)方法的优秀识别性能,对SRC理论进行了深入分析,并将其应用于人脸姿态分类.为了解决姿态估计中人脸光照、噪声和遮挡变化问题,将人脸姿态离散化为不同的子空间,每个子空间对应一个类别,据此,提出基于字典学习与稀疏约束的人脸姿态识别方法.通过在公开的XJTU和PIE人脸库上实验表明:所研究的方法对人脸光照、噪声和遮挡变化具有鲁棒性.     

基于LED与肌肉模型的特定人脸建模与动画

特定三维人脸的建模与动画是计算机图形学中一个非常令人感兴趣的领域.本文提出了一种新的从两幅正交照片建立特定人脸的模型以及动画方法,首先以主动轮廓跟踪技术snake自动获取人脸特征点的准确位置,然后以文中的局部弹性变形(local elastic deformation)方法进行通用人脸模型到特定人脸的定制,并辅以采用图像镶嵌技术生成的大分辨率纹理图像施行纹理绘制,该方法以特征点的位移和非特征点与特征点的相对位置为基础计算局部人脸面部的变形,同时还能够实现人脸剧烈的面部变化和动作,与肌肉模型相结合,可很好地实时完成人脸的动画,具有快速高效的特点.最后,给出了所得到的实验结果.     

基于稀疏形变模型的三维卡通人脸生成

 随着数字娱乐产业的发展,由照片生成卡通人脸的技术将取得广泛应用.此前的方法主要集中在平面卡通化的领域,风格较为单一.对于三维人脸,尽管形变模型方法可以由照片合成各种属性的三维人脸,但它计算量较大,不适用于实时应用场合.本文提出了一种基于稀疏形变模型的三维卡通人脸生成方法,提高了计算速度,且只需要单幅正面人脸照片.首先由稀疏形变模型拟合照片人脸获得特定的稀疏人脸模型;然后将一个一般人脸模型变形到特定人脸并合成纹理;最后对三维人脸进行卡通化.实验结果证明本文方法能够快速自动地合成生动的三维卡通人脸.     

模型基编码中脸部模型的自动调整

通用模型的调整是模型基人脸图像编码的重要步骤,本文提出了一种利用改进的变形模板提取脸部完整特征、由径向基函数内插调整模型非特征点的正面脸部模型自动调整算法.首先用矩形模板匹配确定各特征区域,模板尺寸由先验知识设计;在各特征区域内确定变形模板的初始位置和变化范围,采用遗传算法等匹配方式,获取变形模板的最优参数值;最后估计输入人脸姿态,进行模型的全局变换和用径向基函数内插调整模型非特征点,得到输入人脸的特定模型.实验结果表明,对于输入为简单背景的肩头像,该算法简便快速,可获得较好的调整效果.     

较少标定点条件下的主动形状模型研究

主动形状模型(ASM)的核心部分包括两个子模型,全局形状模型和局部纹理模型,两者均由标定人脸的许多关键点经过统计方法构建而成.本文研究了在只有少量关键标定点情况下,如何有效的进行主动形状建模的问题.通过充分利用面部轮廓标定点的信息,提出了一种将面部轮廓质心动态变化和传统主动形状模型相结合的策略,解决了在少量标定点条件下主动形状建模所遇到的问题.实验表明,改进方法在定位人脸图像关键点时耗时更短,而且具有更广范围的搜索能力和性能良好的搜索精度.     

多模型ASM及其在人脸面部特征点定位中的应用

为了提高ASM在非均匀光照条件下的人脸面部特征点定位的精确度,提出了一种融合Log-Gabor小波特征的多模型ASM方法.该方法的主要特点有:在精确定位目标图像虹膜位置的基础上对全局形状模型进行较准确的初始化;特征点局部纹理特征采用灰度和Log-Gabor小波特征共同描述,减少光照和噪音对算法的影响;建立包括全局ASM和基于人脸面部显著特征区域的局部ASM的多模型ASM,交替使用这两种ASM模型在边缘约束策略基础上对特征点的定位结果进行约束.实验表明,多模型ASM算法对人脸面部特征点定位的准确率比传统ASM算法有明显提高.     

小样本条件下基于全局和局部特征融合的人脸识别

针对线性判别分析的小样本空间问题,提出了一种基于类向量的融合全局和局部特征的人脸识别算法.首先,提取人脸的全局特征;然后将人脸分割成6个关键部分,并用一种新的基于Gabor小波的方法提取特征;其次,将全局和局部特征融合,得出样本的特征向量;再次,得出每类样本的类向量并据此得出一种新的投影准则;最后,将类向量和试验样本分别进行投影,根据其欧氏距离的大小得出试验人脸的最终类.试验表明本文算法不仅能有效解决小样本空间问题,而且计算速度快,识别率高,应用前景良好.     

局部位置特征与全局轮廓特征相结合的图像分类方法

在空间金字塔词袋模型的基础上,针对其空间信息利用不足的问题,本文先计算图像中每一个字典向量的相对位置分布来提取出局部位置特征.然后,用非下采样轮廓波变换和线性判别分析来生成图像的全局轮廓特征.最后,通过局部位置特征与全局轮廓特征相结合的方式提高空间信息利用率,从而提高场景和物体图像分类正确率.为了检验方法的可行性,本文分别在数据库Caltech 101、MSRC和15 Scene上进行实验.实验结果证明,本文提出的方法进一步利用了空间信息,从而提高了分类正确率.     

Fusion of face and iris biometrics using local and global feature extraction methods

Fusion of multiple biometrics combines the strengths of unimodal biometrics to achieve improved recognition accuracy. In this study, face and iris biometrics are used to obtain a robust recognition system by using several feature extractors, score normalization and fusion techniques. Global and local feature extractors are used to extract face and iris features separately, and then, the fusion of these modalities is performed on different subsets of face and iris image databases of ORL, FERET, CASIA and UBIRIS. The proposed method uses Local Binary Patterns local feature extractor and subspace Linear Discriminant Analysis global feature extractor on face and iris images, respectively. Face and iris scores are normalized using tanh normalization, and then, Weighted Sum Rule is applied for the fusion of these two modalities. Improved recognition accuracies are achieved compared to the individual systems and multimodal systems using other local or global feature extractors for both modalities.     

Principal visual word discovery for automatic license plate detection

License plates detection is widely considered a solved problem, with many systems already in operation. However, the existing algorithms or systems work well only under some controlled conditions. There are still many challenges for license plate detection in an open environment, such as various observation angles, background clutter, scale changes, multiple plates, uneven illumination, and so on. In this paper, we propose a novel scheme to automatically locate license plates by principal visual word (PVW), discovery and local feature matching. Observing that characters in different license plates are duplicates of each other, we bring in the idea of using the bag-of-words (BoW) model popularly applied in partial-duplicate image search. Unlike the classic BoW model, for each plate character, we automatically discover the PVW characterized with geometric context. Given a new image, the license plates are extracted by matching local features with PVW. Besides license plate detection, our approach can also be extended to the detection of logos and trademarks. Due to the invariance virtue of scale-invariant feature transform feature, our method can adaptively deal with various changes in the license plates, such as rotation, scaling, illumination, etc. Promising results of the proposed approach are demonstrated with an experimental study in license plate detection.     

融合整体和局部信息的三维人脸识别

针对三维人脸识别中单一特征信息不足,采用一种基于整体信息和局部信息相融合的识别算法,以提高识别率。首先将预处理的三维点云用多层次B样条曲面拟合,获取精确的人脸曲面拟合函数,将控制点映射为深度图像,并根据人脸曲面函数和生理特征提取过鼻尖的中分轮廓线和水平轮廓线;其次对深度图像采用二维主元分析(2D-PCA)算法提取整体信息,对轮廓线采用改进的ICP算法匹配,作为局部信息;最后用加权求和法在决策级进行信息融合。采用CASIA3D人脸库完成识别测试,实验结果表明,本文算法明显优于单一特征信息下识别算法,且对姿态有较好的鲁棒性,同时不增加算法复杂度。     

Efficient facial landmark localization using spatial–contextual AdaBoost algorithm

Facial landmark detectors can be categorized into global and local detectors. Global facial landmark detectors rely on global statistical relations between landmarks, but do not sufficiently utilize local appearance information, whereas local detectors mainly focus on local appearance attributes of landmarks. Although the AdaBoost algorithm has been successfully employed in object localization, it cannot take advantage of geometric facial feature distribution very well. We propose an AdaBoost algorithm called SC-AdaBoost, which efficiently combines the global knowledge of landmark distribution, the regional shape model, and the local landmark attributes based on a coarse-to-fine strategy. The global prior distribution of landmarks is estimated using a face image set with landmark annotations. First, the face region is detected as a rectangular bounding box using a Haar-like feature-based boosting method, and the global distribution of landmarks is used to determine the facial component regions. Facial landmark localization is roughly performed by regional shape modeling. Posteriors of individual weak classifiers are determined by Gabor wavelet analysis at landmark candidate positions constrained by the regional shape model. SC-AdaBoost is established by empirical risk minimization, which decides the weights for the weak classifiers, and is used for the precise localization. The strength of the proposed approach is shown by extensive experiments using standard face datasets.     

Local consistent hierarchical Hough Match for image re-ranking

Geometric image re-ranking is a widely adopted phrase to refine the large-scale image retrieval systems built based upon popular paradigms such as Bag-of-Words (BoW) model. Its main idea can be treated as a sort of geometric verification targeting at reordering the initial returning list by previous similarity ranking metrics, e.g. Cosine distance over the BoW vectors between query image and reference ones. In the literature, to guarantee the re-ranking accuracy, most existing schemes requires the initial retrieval to be conducted by using a large vocabulary (codebook), corresponding to a high-dimensional BoW vector. However, in many emerging applications such as mobile visual search and massive-scale retrieval, the retrieval has to be conducted by using a compact BoW vector to accomplish the memory or time requirement. In these scenarios, the traditional re-ranking paradigms are questionable and new algorithms are urgently demanded. In this paper, we propose an accurate yet efficient image re-ranking algorithm specific for small vocabulary in aforementioned scenarios. Our idea is inspired by Hough Voting in the transformation space, where votes come from local feature matches. Most notably, this geometry re-ranking can easily been aggregated to the cutting-edge image based retrieval systems yielding superior performance with a small vocabulary and being able to store in mobile end facilitating mobile visual search systems. We further prove that its time complexity is linear in terms of the re-ranking instance, which is a significant advantage over the existing scheme. In terms of mean Average Precision, we show that its performance is comparable or in some cases better than the state-of-the-art re-ranking schemes.     

基于局部模式的加权估计纹理分析在人脸识别中的应用

传统的纹理分析方法仅以每个脸部区域的相对贡献来标记全局相似度,针对这种以局部表示全局而导致不能很好地进行特征提取的问题,提出了基于局部模式的加权估计纹理分析(Weighting Estimation for Texture Analysis, WETA)方法。首先使用局部二值模式（Local Binary Pattern, LBP）或者局部相位量化（Local Phase Quantization, LPQ）对图像进行纹理编码,并将其划分成各个大小相等且不重叠的局部小块;然后从相似空间中提取出最具识别力的坐标轴,利用编码与数据库的不同组合估算出权值;最后,通过权值优化给出了最佳解决方案,并采用相似性度量距离转换完成人脸的识别。在FERET和ORL两大通用人脸数据库上的实验验证了所提方法的有效性,实验结果表明,与最先进的纹理方法相比,所提方法取得了更好的识别性能。