Multiresolution gray-scale and rotation invariant textureclassification with local binary patterns

Presents a theoretically very simple, yet efficient, multiresolution approach to gray-scale and rotation invariant texture classification based on local binary patterns and nonparametric discrimination of sample and prototype distributions. The method is based on recognizing that certain local binary patterns, termed "uniform," are fundamental properties of local image texture and their occurrence histogram is proven to be a very powerful texture feature. We derive a generalized gray-scale and rotation invariant operator presentation that allows for detecting the "uniform" patterns for any quantization of the angular space and for any spatial resolution and presents a method for combining multiple operators for multiresolution analysis. The proposed approach is very robust in terms of gray-scale variations since the operator is, by definition, invariant against any monotonic transformation of the gray scale. Another advantage is computational simplicity as the operator can be realized with a few operations in a small neighborhood and a lookup table. Experimental results demonstrate that good discrimination can be achieved with the occurrence statistics of simple rotation invariant local binary patterns     

基于局部差分模式的不变性纹理分类

提出了局部差分变换和局部差分模式。局部差分变换具有灰度线性不变性,可消除光照变化对纹理分析的影响。基于局部差分变换的局部差分模式具有光照、旋转不变性和良好的多尺度分析能力。局部差分模式直方图可作为光照、平移、旋转不变性特征用于不变性纹理分类。实验表明,该方法的不变性纹理分类效果优于目前国际公认的基于LBP的方法。     

Multi-view human activity recognition based on silhouette and uniform rotation invariant local binary patterns

This paper addresses the problem of silhouette-based human activity recognition. Most of the previous work on silhouette based human activity recognition focus on recognition from a single view and ignores the issue of view invariance. In this paper, a system framework has been presented to recognize a view invariant human activity recognition approach that uses both contour-based pose features from silhouettes and uniform rotation local binary patterns for view invariant activity representation. The framework is composed of three consecutive modules: (1) detecting and locating people by background subtraction, (2) combined scale invariant contour-based pose features from silhouettes and uniform rotation invariant local binary patterns (LBP) are extracted, and (3) finally classifying activities of people by Multiclass Support vector machine (SVM) classifier. The rotation invariant nature of uniform LBP provides view invariant recognition of multi-view human activities. We have tested our approach successfully in the indoor and outdoor environment results on four multi-view datasets namely: our own view point dataset, VideoWeb Multi-view dataset [28], i3DPost multi-view dataset [29], and WVU multi-view human action recognition dataset [30]. The experimental results show that the proposed method of multi-view human activity recognition is robust, flexible and efficient.     

Multi-structure local binary patterns for texture classification

Recently, the local binary patterns (LBP) have been widely used in the texture classification. The LBP methods obtain the binary pattern by comparing the gray scales of pixels on a small circular region with the gray scale of their central pixel. The conventional LBP methods only describe microstructures of texture images, such as edges, corners, spots and so on, although many of them show good performances on the texture classification. This situation still could not be changed, even though the multi-resolution analysis technique is adopted by LBP methods. Moreover, the circular sampling region limits the ability of the conventional LBP methods in describing anisotropic features. In this paper, we change the shape of sampling region and get an extended LBP operator. And a multi-structure local binary pattern (Ms-LBP) operator is achieved by executing the extended LBP operator on different layers of an image pyramid. Thus, the proposed method is simple yet efficient to describe four types of structures: isotropic microstructure, isotropic macrostructure, anisotropic microstructure and anisotropic macrostructure. We demonstrate the performance of our method on two public texture databases: the Outex and the CUReT. The experimental results show the advantages of the proposed method.     

尺度与颜色不变性图像特征描述

尺度不变特征变换是目前公认的鲁棒性最强的图像特征描述方法之一,在尺度不变性和几何不变性方面具有较好的特性,但该方法主要适用于灰度图像,对图像颜色的区分能力不强,因此,一些对象可能会因为颜色的不同而被错误的区分.另外,尺度不变特征变换对关键点局部范围内描述子主方向的依赖性非常强,直接决定了匹配的正确率,但是研究表明,主方向分配产生的误差仅有三分之二左右能控制在[-20。,+20。]范围内,因此部分特征会有三分之一的概率因为主方向分配的误差较大而不能正确匹配.针对以上两个问题,本文提出了一种具有颜色和尺度不变性的局部特征描述方法,颜色不变性通过将RGB图像转换到高斯颜色模型下实现,特征描述过程中不再分配主方向,而用局部相对方向,尺度不变性通过构建高斯金子塔实现.实验选取阿姆斯特丹数据集图像进行了测试,结果表明本文方法比传统尺度不变特征变换方法,在特征点的数目、分布均匀性以及匹配精度方面均有所提高.     

一种在医学图像中挖掘非对称区域的方法

提出一种利用图像刚性配准算法和数字形态学调整近似对称区域、有效挖掘出图像非对称区域,并自动判断头部炎症类疾病的算法.首先扩展适用于二值图像的自反射刚性配准算法到灰度医学图像上,然后对配准后的图像使用条件腐蚀算子调整那些近似对称区域的边界,在不同的精度下进行迭代以获得最终的非对称区域.在人类头部CT的胆脂瘤检测实验中,该方法显示出良好的挖掘效果,检测成功率达到95%.     

面向局部光照突变的时间和空间中心对称局部二值模式算子

针对现有背景建模方法对局部光照突变非常敏感的问题,提出了一种新的时间和空间中心对称局部二值模式(TSCS-LBP)算子,并基于该算子的直方图设计了一种背景建模方法。TSCS-LBP算子在中心对称局部二值模式(CS-LBP)算子的基础上加入时域信息和中心像素信息,并引入有光照因子的自适应阈值,从而在保持较低计算复杂度的基础上,具有能够快速适应光照突变的能力。在此基础之上设计的背景建模方法,能够在常用实验场景中较为准确地检测出前景,有较高的抗噪性和检测精度;同时在有局部光照突变的特殊场景中也有很好的适应能力,与已有方法相比有较高的优越性。实验结果表明了本文方法的有效性和鲁棒性。     

改进特征与GPU加速的行人检测

目的 目前行人检测存在特征维度高、检测耗时的问题,行人图像易受到光照、背景、遮挡等影响,给实际行人检测造成了一定困难。为了提高检测准确性,减少检测耗时,针对以上问题,提出一种改进特征与GPU （graphic processing unit）加速的行人检测算法。方法 首先,采用多尺度无缩放思想,通过canny算子对所有样本进行预处理,减少背景干扰与统一归格化的形变影响。然后,针对实际视频中的遮挡问题,把图像分成头部、左臂、上身、右臂、左腿、右腿6个区域。接着选取比LBP （local binary patterns）特征鲁棒性更好的SILTP （scale invariant local ternary pattern）特征作为纹理特征,在GPU空间中并行提取;同时,分别提取6个区域的HOG （histogram of oriented gradient）特征值,结合行人轮廓在6个区域上的梯度方向分布特性,对其进行加权。最后,将提取的全部特征输出到CPU （central processing unit）,利用支持向量机（SVM）分类器实现行人检测。结果 在INRIA、NICTA数据集上进行实验,INRIA数据集上检测率达到99.80%,NICTA数据集上检测率达到99.91%,并且INRIA数据集上检测时间加速比达到12.19,NICTA数据集上达到13.49,相对传统HOG、LBP算法,检测率、时间比实现提高。结论 提出的改进HOG-SILTP特征与GPU加速的行人检测算法,能够有效表达行人信息,改善传统特征提取方式带来的耗时与形变影响,对环境变化、遮挡具有较强的鲁棒性。该算法在检测率、检测时间方面均有提高,能够实现有效、快速的行人检测,具有实际意义。     

Extension of higher order local autocorrelation features

This study investigates effective image features that are widely applicable in image analysis. We specifically address higher order local autocorrelation (HLAC) features, which are used in various applications. The original HLAC features are restricted up to the second order and are represented by 25 mask patterns. We increase their orders up to eight and extract the extended HLAC features using 223 mask patterns. Furthermore, we create large mask patterns and construct multi-resolution features to support large displacement regions. In texture classification and face recognition, the proposed method outperformed Gaussian Markov random fields, Gabor features, and local binary pattern operator.     

基于扩展的SURF描述符的彩色图像配准技术*

目前大多数图像配准算法都需要先将彩色图像转换为灰度图像再进行图像配准,色彩信息的丢失可能引起图像的误匹配。本文在SURF算法的基础上,提出了构建颜色描述向量扩展SURF描述符,形成ESURF描述符,再进行图像配准的方法。该算法能够充分利用彩色图像的色彩信息,相比大多数算法基于灰度图像的配准方法有更高的鲁棒性,同时继承了SURF算法良好的性能。描述符性能测试和图像配准测试证明：ESURF算法比灰度图像SURF算法在图像尺度变化、旋转、模糊、视角变化、特别是光照变化方面有更高的鲁棒性。     

一种面向局部光照突变的TSCS-LBP算子

针对现有背景建模方法对局部光照突变非常敏感的问题,提出了一种新的时间和空间中心对称局部二值模式（TSCS-LBP）算子,并基于该算子的直方图设计了一种背景建模方法。所提出的TSCS-LBP算子,在CS-LPB算子的基础上加入时域信息和中心像素信息,并引入有光照因子的自适应阈值,从而在保持较低计算复杂度的基础上,具有能够快速适应光照突变的能力。在此基础之上设计的背景建模方法,能够在常用实验场景中较为准确的检测出前景,有较高的抗噪性和检测精度;同时在有局部光照突变的特殊场景中也有很好的适应能力,与已有方法相比有较高的优越性。实验结果证明了所提出方法的有效性和鲁棒性。     

LOG算子边缘检测方法的改进方案

本文对LOG算子边缘检测方法的性能进行了分析和评价。针对LOG算子的缺陷，提出了选择性平滑方式清除图像中的椒盐噪声；提出了依据图像灰度的一阶导数极大值和二阶导数零穿相结合的边缘检测方法，抑制了图像中的大部分其它噪声，并保持了边缘定位精度；还通过用图像灰度共生矩阵的惯性矩特征值自适应调整高斯空间系数和边缘检测阈值，实现了图像边缘的自动提取。实践证明该方法具备有效性和实用性。     

一类新的纹理谱描述子

在纹理元的基础上提出了一类新的纹理谱描述子,新的纹理谱描述子在3个方面作了改进：将像素的灰度差量化为4个值;量化区间根据纹理对比度自动确定,并保证量化值具有灰度线性不变性;利用相关性弱的8邻域像素构建纹理谱描述子,从而降低了纹理谱维数。定义了基于新的纹理谱描述子的光照、旋转不变性纹理特征。利用该特征对Outex纹理进行光照、旋转不变性分类,分类准确率高于基于局部二值模式的光照、旋转不变性纹理特征。     

一种基于改进LBP算子的人脸识别算法研究

提出了一种基于改进LBP算子的人脸识别算法。局部二元模式（LBP）是一种灰度范围内的纹理描述方式,它从一种纹理局部近邻定义中衍生出来。然而,LBP算子本身还不够完善,在人脸识别的应用中还存在许多问题亟待解决。文章在此基础上,对其特征的组合方式等方面作了一些改进,并将改进后的LBP算子用于人脸识别。通过改进前后在YALE人脸库的实验比较,该方法在识别率上取得了较好的结果。