面向情感特征的风景图像分类研究及其实现

视觉活动是认知外部世界的主要途径,视觉感知源于物体的外形、色彩及纹理。而颜色特征的不同对人类情感变化起着至关重要的作用。鉴于不同风景图像会产生不同的颜色特征和情感特点,如何建立图像颜色特征与用户评价之间的关系并加以鉴别具有重要的研究意义。该文在学习前人提出的各种颜色提取分类算法的基础上,结合图像的颜色直方图对风景图像的颜色特征进行提取,并利用支持向量机的方法对图像进行分类。实验表明,该方法取得了较好的准确率。     

An optimal feature enriched region of interest (ROI) extraction for periocular biometric system

With the onset of COVID-19 pandemic, wearing of face mask became essential and the face occlusion created by the masks deteriorated the performance of the face biometric systems. In this situation, the use of periocular region (region around the eye) as a biometric trait for authentication is gaining attention since it is the most visible region when masks are used. One important issue in periocular biometrics is the identification of an optimal size periocular ROI which contains enough features for authentication. The state of the art ROI extraction algorithms use fixed size rectangular ROI calculated based on some reference points like center of the iris or centre of the eye without considering the shape of the periocular region of an individual. This paper proposes a novel approach to extract optimum size periocular ROIs of two different shapes (polygon and rectangular) by using five reference points (inner and outer canthus points, two end points and the midpoint of eyebrow) in order to accommodate the complete shape of the periocular region of an individual. The performance analysis on UBIPr database using CNN models validated the fact that both the proposed ROIs contain enough information to identify a person wearing face mask.

     

A multi-biometric iris recognition system based on a deep learning approach

Multimodal biometric systems have been widely applied in many real-world applications due to its ability to deal with a number of significant limitations of unimodal biometric systems, including sensitivity to noise, population coverage, intra-class variability, non-universality, and vulnerability to spoofing. In this paper, an efficient and real-time multimodal biometric system is proposed based on building deep learning representations for images of both the right and left irises of a person, and fusing the results obtained using a ranking-level fusion method. The trained deep learning system proposed is called IrisConvNet whose architecture is based on a combination of Convolutional Neural Network (CNN) and Softmax classifier to extract discriminative features from the input image without any domain knowledge where the input image represents the localized iris region and then classify it into one of N classes. In this work, a discriminative CNN training scheme based on a combination of back-propagation algorithm and mini-batch AdaGrad optimization method is proposed for weights updating and learning rate adaptation, respectively. In addition, other training strategies (e.g., dropout method, data augmentation) are also proposed in order to evaluate different CNN architectures. The performance of the proposed system is tested on three public datasets collected under different conditions: SDUMLA-HMT, CASIA-Iris-V3 Interval and IITD iris databases. The results obtained from the proposed system outperform other state-of-the-art of approaches (e.g., Wavelet transform, Scattering transform, Local Binary Pattern and PCA) by achieving a Rank-1 identification rate of 100% on all the employed databases and a recognition time less than one second per person.     

基于多尺度LBP的人脸识别

提出一种基于多尺度LBP(Local Binary Pattern)的人脸识别算法。建立人脸图像高斯差分尺度空间,计算尺度空间图像的LBP特征,将LBP特征图像划分为互不重叠的特征区域,然后分别进行直方图统计,最后将所有区域的LBP直方图序列连接起来得到多尺度LBP特征,采用最近邻分类器对人脸图像分类识别。实验分析表明,多尺度LBP特征具有较强的人脸图像描述能力,能够提取到更加丰富的全局信息,鲁棒性强,在识别率和识别速度上均比SIFT算法高。     

基于多种LBP特征集成学习的车标识别

针对车标图像的分类难问题，提出基于多种LBP特征集成学习的车标识别算法。利用车牌与车标的相对位置关系粗定位车标区域；根据车标背景纹理特征使用不同的算子进行边缘检测，进而实现背景消融，采用投影方法精确确定车标位置；将车标图像分块，应用CSLBP算子提取每个像素点邻域特征，将车标所有像素点邻域特征合成精细的纹理特征，运用LBP直方图算法提取车标区域的空间结构特征，再采用SVM和BP分别训练这两种特征，得到投票决策矩阵，利用加权求和的规则融合决策矩阵，构成最优集成分类器，输出车标类别。实验结果表明，该算法的识别率明显优于单一的特征和分类器。     

一种基于肤色与LBP特征融合的人脸跟踪算法

针对目前人脸跟踪方法易受光照变化和背景相近色的干扰,跟踪效果有时不佳或失效的问题,提出引入LBP(Local binary pattern)局部纹理特征,采用LBP直方图和颜色直方图相融合作为人脸特征描述的粒子滤波人脸跟踪方法.该方法在全局颜色和局部LBP纹理两个层次和特征线索上对人脸进行描述.实验结果表明,该方法较单一特征跟踪方法更具鲁棒性.此外,由于人脸目标的运动通常为非匀速运动,为了提高粒子传播的有效性和指导性,本文对人脸跟踪状态方程进行了改进.实验证明,改进后的人脸跟踪算法在各种复杂背景、旋转遮挡和人脸目标非匀速运动的情况下均能取得较好的跟踪效果.     

Automated Teller Machine Authentication Using Biometric

This paper presents a novel method of a secured card-less Automated Teller Machine (ATM) authentication based on the three bio-metrics measures. It would help in the identification and authorization of individuals and would provide robust security enhancement. Moreover, it would assist in providing identification in ways that cannot be impersonated. To the best of our knowledge, this method of Biometric_ fusion way is the first ATM security algorithm that utilizes a fusion of three biometric features of an individual such as Fingerprint, Face, and Retina simultaneously for recognition and authentication. These biometric images have been collected as input data for each module in this system, like a fingerprint, a face, and a retina module. A database is created by converting these images to YIQ color space, which is helpful in normalizing the brightness levels of the image hence mainly (Y component’s) luminance. Then, it attempt to enhance Cellular Automata Segmentation has been carried out to segment the particular regions of interest from these database images. After obtaining segmentation results, the featured extraction method is carried out from these critical segments of biometric photos. The Enhanced Discrete Wavelet Transform technique (DWT Mexican Hat Wavelet) was used to extract the features. Fusion of extracted features of all three biometrics features have been used to bring in the multimodal classification approach to get fusion vectors. Once fusion vectors ware formulated, the feature level fusion technique is incorporated based on the extracted feature vectors. These features have been applied to the machine learning algorithm to identify and authorization of multimodal biometrics for ATM security. In the proposed approach, we attempt at useing an enhanced Deep Convolutional Neural Network (DCNN). A hybrid optimization algorithm has been selected based on the effectiveness of the features. The proposed approach results were compared with existing algorithms based on the classification accuracy to prove the effectiveness of our algorithm. Moreover, comparative results of the proposed method stand as a proof of more promising outcomes by combining the three biometric features.     

基于Uniform LBP和DMMA的单样本人脸识别

在单样本人脸识别系统中,为了获得更好的人脸面部特征,提出了一种融合Uniform LBP特征和多流形判别分析（Discriminative Multi-Manifold Analysis,DMMA）的特征提取方法。对每幅人脸图像进行分块构成一个子集。使用统一局部二值模式（Uniform LBP）算子提取每个子集中图像的直方图,每个子集中的直方图形成一个统计流形,应用DMMA算法获得人脸图像的低维特征。采用基于重建的流形-流形间的距离识别未知的人脸图像。在AR数据库和ORL数据库上实验结果表明,该算法的识别性能优于一般的DMMA算法。     

基于多种LBP特征集成学习的人脸识别*

单一的特征与分类器只能对限定条件下的人脸进行较好的识别,当在非限定条件下(如光照、背景等发生变化时)将出现人脸识别率较低问题,针对该问题,提出了一种基于多种局部二进制特征集成学习的人脸识别算法。首先,使用监督梯度下降法 (SDM)对人脸特征点定位,应用中心对称局部二进制(CSLBP)算子提取每个特征点邻域特征,将所有人脸特征点邻域特征合成为精细的纹理特征;同时运用分区LBP直方图算法提取人脸区域的微观空间结构特征;然后,使用K最近邻算法(KNN)和支持向量机(SVM)分别训练这两种特征,得到类别排序列表和投票决策矩阵;最后,利用加权求和的规则融合决策矩阵,构成最优集成分类器,从而得到输出类别。通过在非限制性人脸库LFW上实验结果表明,所提算法采用集成的方法明显优于单一的特征和分类器。     

融合迁移学习的Inception-v3模型在古壁画朝代识别中的应用

针对古代壁画图像数量少、质量差、特征提取困难和存在壁画文本与绘画风格相似等问题,提出了一种融合迁移学习的Inception-v3模型来对古代壁画的朝代进行识别与分类。首先,将Inception-v3模型在ImageNet数据集上进行预训练以得到迁移模型;然后,将迁移模型在小型壁画数据集上进行参数微调后对壁画图像提取高层特征;其次,增加两个全连接层来增强特征表达能力,并用颜色直方图与局部二值模式（LBP）纹理直方图提取壁画的艺术特征;最后,将高层特征与艺术特征相融合,用Softmax分类器进行壁画的朝代分类。实验结果表明,所提出的模型训练过程稳定,在构造的小型壁画数据集上,其最终准确率为88.70%,召回率为88.62%,F1值为88.58%,以上各评价指标均优于AlexNet、VGGNet等经典网络模型;与LeNet-5、AlexNet-S6等改进的卷积神经网络模型相比,该模型对各朝代类别准确率平均提升了至少7个百分点。可见,该模型泛化能力强,不易出现过拟合现象,能有效识别壁画所属朝代。     

基于HOG特征与子区域模糊融合的人耳识别研究

作为一种新兴的生物特征识别技术,人耳识别具有其自身独特优势.利用局部特征信息,研究一类新型的基于梯度方向直方图的人耳身份识别方法,提出一种基于梯度方向直方图与子区域模糊融合相结合的人耳识别方案.将人耳图像划分为不同子区域,分别提取各子区域梯度方向直方图特征,引入模糊隶属度匹配融合策略,获取最终的分类结果.与多种方法的对比实验表明,基于梯度方向直方图的特征提取方法具有高识别性能,针对USTB人耳图像库3的测试实验,可达到99.75％的识别率.     

基于局部Gabor变化直方图序列的人脸描述与识别

提出了一种在Gabor变换幅值域内提取局部变化模式空间直方图序列(histogram sequence of local Gabor binary patterns,简称HSLGBP)的人脸描述及其识别方法.鉴于Gabor特征对光照、表情等变化比较鲁棒,并已在人脸识别领域得到成功应用,首先对归一化的人脸图像进行多方向、多分辨率Gabor小波滤波,并提取其对应不同方向、不同尺度的多个Gabor幅值域图谱(Gabor magnitude map,简称GMM),然后在每个GMM上采用局部二值模式(local binary pattern,简称LBP)算子抽取局部邻域关系模式,最后由这些模式的区域直方图形成的序列来描述人脸.Gabor变换、LBP、空间区域直方图的采用使得该方法对光照变化、表情变化、误配准等具有良好的鲁棒性.而且,这种人脸建模方法不需要基于训练集合进行统计学习,因而不存在推广性问题.同时,进一步探讨了如何在分类器设计阶段与统计方法进行结合的问题,提出了统计Fisher加权的HSLGBP匹配方法.在通过FERET人脸库光照、表情和时间变化测试集上与已发表的实验结果进行对比,充分验证了该方法的有效性.     

基于融合特征的行人再识别方法*

行人再识别过程中,由于姿势和光照等因素的变化使不同相机中所得行人的外形具有明显变化,较难提取不变性特征,导致识别率偏低.鉴于此种情况,文中提出基于融合特征的行人再识别方法,提取的特征包括HSV颜色特征、颜色直方图特征及梯度方向直方图特征,行人再识别过程分为训练阶段和识别阶段.在训练阶段,首先对训练图像集中每幅图像进行特征提取,然后利用典型相关分析获得2部相机拍摄同一行人的图像特征之间的相关性,生成相关性矩阵.在识别阶段,首先对参考图像集和测试图像集中每幅图像进行特征提取,然后将各自特征向量利用相关性矩阵进行变换,最后进行相似度度量,得到识别结果.在3个图像库上的实验表明,文中方法可以提高行人再识别的识别率.     

基于面部表情识别的学习疲劳识别和干预方法

针对网络学习者经常出现的身体或心理上的疲劳或疲惫情绪状态即"学习疲劳"状态,提出了一种基于面部表情识别的学习疲劳识别和干预方法.考虑到网络学习的特点,定义了专注、疲劳和中性3种与学习相关的表情,利用一种基于肤色分割和模版匹配相结合的人脸检测算法检测出网络学习者的人脸区域,然后根据建立的人脸表情面部模型对学习者的面部特征进行提取,主要包括眼睛特征和嘴巴特征,最后采用基于规则的表情分类方法,识别出学习者是否处于学习疲劳状态,并采取相应的情感干预措施.实验结果表明,该方法能够快速识别网络学习者是否处于学习疲劳状态,实现实时学习疲劳干预.     

Ocular recognition databases and competitions: a survey

The use of the iris and periocular region as biometric traits has been extensively investigated, mainly due to the singularity of the iris features and the use of the periocular region when the image resolution is not sufficient to extract iris information. In addition to providing information about an individual’s identity, features extracted from these traits can also be explored to obtain other information such as the individual’s gender, the influence of drug use, the use of contact lenses, spoofing, among others. This work presents a survey of the databases created for ocular recognition, detailing their protocols and how their images were acquired. We also describe and discuss the most popular ocular recognition competitions (contests), highlighting the submitted algorithms that achieved the best results using only iris trait and also fusing iris and periocular region information. Finally, we describe some relevant works applying deep learning techniques to ocular recognition and point out new challenges and future directions. Considering that there are a large number of ocular databases, and each one is usually designed for a specific problem, we believe this survey can provide a broad overview of the challenges in ocular biometrics.

     

Human Gait Recognition Based on Kernel PCA Using Projections

This paper presents a novel approach for human identification at a distance using gait recognition. Recognition of a person from their gait is a biometric of increasing interest. The proposed work introduces a nonlinear machine learning method, kernel Principal Component Analysis （PCA）, to extract gait features from silhouettes for individual recognition. Binarized silhouette of a motion object is first represented by four 1-D signals which are the basic image features called the distance vectors. Fourier transform is performed to achieve translation invariant for the gait patterns accumulated from silhouette sequences which are extracted from different circumstances. Kernel PCA is then used to extract higher order relations among the gait patterns for future recognition. A fusion strategy is finally executed to produce a final decision. The experiments are carried out on the CMU and the USF gait databases and presented based on the different training gait cycles.     

基于分块CBP特征和稀疏表示的三维人脸表情识别

在三维人脸表情识别中,基于局部二值模式（LBP）算子算法与传统的特征提取算法相比具有特征提取准确、精细、光照不变性等优点,但也有直方图维数高、判别能力差、冗余信息大的缺点.本文提出一种通过对整幅图像进行多尺度分块提取CBP特征的CBP算法,能够更有效的提取分类特征.再结合使用稀疏表达分类器实现对特征进行分类和识别.经实验结果表明,与传统LBP算法和SVM分类识别算法对比,文中算法用于人脸表情的识别的识别率得到大幅度提高.