Multi-structure local binary patterns for texture classification

Recently, the local binary patterns (LBP) have been widely used in the texture classification. The LBP methods obtain the binary pattern by comparing the gray scales of pixels on a small circular region with the gray scale of their central pixel. The conventional LBP methods only describe microstructures of texture images, such as edges, corners, spots and so on, although many of them show good performances on the texture classification. This situation still could not be changed, even though the multi-resolution analysis technique is adopted by LBP methods. Moreover, the circular sampling region limits the ability of the conventional LBP methods in describing anisotropic features. In this paper, we change the shape of sampling region and get an extended LBP operator. And a multi-structure local binary pattern (Ms-LBP) operator is achieved by executing the extended LBP operator on different layers of an image pyramid. Thus, the proposed method is simple yet efficient to describe four types of structures: isotropic microstructure, isotropic macrostructure, anisotropic microstructure and anisotropic macrostructure. We demonstrate the performance of our method on two public texture databases: the Outex and the CUReT. The experimental results show the advantages of the proposed method.     

基于LBP值对空间统计特征的纹理描述符

针对基于内容图像检索应用背景下局部二值模式(LBP)描述符缺乏空间描述能力及所需特征矢量维数较长的不足, 提出一种基于LBP值对空间统计特征构建的改进纹理描述符(ILBP)。ILBP描述符首先利用LBP微模式编码方法将原始图像转换为LBP伪灰度图像, 然后再提取出多个关于LBP值对空间分布关系统计值构成描述图像特征的特征矢量。在基于内容的图像检索原型测试平台上完成大量实验。实验结果表明, 与LBP及其各类变种描述符相比, ILBP描述符在进一步增强LBP描述符描述能力的同时大幅度压缩特征矢量维数, 具有更好的查询正确率和查询效率。     

Texture image retrieval based on fusion of local and global features

Neither a single local feature nor a single global feature can completely characterize image information, and fusion of two or more complementary features can effectively improve retrieval performance in image retrieval. In this paper, a texture image retrieval method is proposed by fusing global and local features in the spatial domain and the transform domain. In the spatial domain, the local binary pattern (LBP) value of the image is calculated, and the histogram is established as the feature. In the transform domain, the dual-tree complex wavelet transform (DTCWT) is selected to decompose the image into sub-bands, in which the low-frequency approximate sub-band coefficients are modeled by Gaussian Mixture Model (GMM), magnitude sub-band coefficients are modeled by Gamma distribution model, and relative phase sub-band coefficients are modeled by von Mises distribution model; the LBP value of the magnitude sub-band coefficients and the improved local tetra pattern(ILTrP) value of the relative phase sub-band coefficients are calculated. According to the influence of different types of features on retrieval performance, the optimized weight coefficient is set for each type of feature, and accordingly a new similarity measurement formula is proposed. The experimental results on three different image databases of Brodatz database (DB1), MIT VisTex database (DB2) and STex (DB3) show that the average retrieval rate (ARR) of our method for databases DB1, DB2, and DB3 reaches 84.32%, 90.43% and 64.73%, respectively; and compared with the state-of-the-art methods, the ARR in DB1 increases by 1.04%, in DB2 by 0.35%, and in DB3 by 1.68%.

     

增强成对旋转不变的共生扩展局部二值模式

目的 针对成对旋转不变的共生局部二值模式（PRICoLBP）算法对图像光照、旋转变化鲁棒性较差,且存在特征维度过大的问题,提出了一种可融合多种局部纹理结构信息的有效特征——增强成对旋转不变的共生扩展局部二值模式。方法 首先,对图像各像素点的邻域像素点灰度值进行二值量化得到二值编码序列,并不断旋转二值序列得到以不同邻域点作为编码起始点对应的LBP值;然后,分别利用极大、极小LBP值对应的邻域起始编码点和中心像素点确定两个方向矢量,并沿这两个方向矢量在两个不同尺度图像上选取上下文共生点;其次,利用扩展局部二值模式（ELBP）算法的旋转不变均匀描述子来提取上下文共生点对的中心像素灰度级、邻域像素灰度级及径向灰度差异特征间的相关性信息;最后,用上下文共生点对的特征直方图训练卡方核支持向量机,检测纹理图像类别。结果 通过对Brodatz、Outex （TC10、TC12）、Outex （TC14）、CUReT、KTH-TIPS和UIUC纹理库的分类实验,改进算法的识别率比原始的PRICoLBP算法识别率分别提高了0.32%、0.57%、5.62%、3.34%、2.1%、4.75%。结论 利用像素点LBP特征极值对应的起始编码序列来选取上下共生点对,并用ELBP算法提取共生点对局部纹理信息,故本文方法能更好描述共生点对间的高阶曲率信息及更多局部纹理信息。在具光照、旋转变化的Outex、CUReT、KTH-TIPS纹理库图像分类实验中,所提方法比原始PRICoLBP算法取得了更高的识别率。实验结果表明,改进算法相比于原始算法能在较低的特征维度下对图像光照、旋转变化具有较好的鲁棒性。     

An effective scheme for image texture classification based on binary local structure pattern

Effectiveness of local binary pattern (LBP) features is well proven in the field of texture image classification and retrieval. This paper presents a more effective completed modeling of the LBP. The traditional LBP has a shortcoming that sometimes it may represent different structural patterns with same LBP code. In addition, LBP also lacks global information and is sensitive to noise. In this paper, the binary patterns generated using threshold as a summation of center pixel value and average local differences are proposed. The proposed local structure patterns (LSP) can more accurately classify different textural structures as they utilize both local and global information. The LSP can be combined with a simple LBP and center pixel pattern to give a completed local structure pattern (CLSP) to achieve higher classification accuracy. In order to make CLSP insensitive to noise, a robust local structure pattern (RLSP) is also proposed. The proposed scheme is tested over three representative texture databases viz. Outex, Curet, and UIUC. The experimental results indicate that the proposed method can achieve higher classification accuracy while being more robust to noise.     

基于纹理特征融合的人脸表情识别

局部二值模式(LBP)和韦伯局部描述算子(WLD)是两种图像的纹理描述算子,在图像的特征提取方面有较强的能力。为了更加准确地对人脸表情进行识别与分类,针对LBP在特征提取的过程中只考虑了中心像素点与周围的其他像素点的灰度值之差,WLD仅考虑中心像素点与周围像素点灰度值之间的激励强度与梯度方向关系的问题,提出一种新的特征提取算法—局部二值韦伯模式(LBWP)。首先对图像进行预处理,检验人脸和裁剪有效的表情区域,接着对图像进行LBWP特征提取,在特征提取之后采用SVM的分类器对表情进行识别和分类。该算法在CK+数据集和JAFFE数据集上进行实验仿真,识别率分别达到了97.14%和95.77%。实验结果验证了LBWP算法在表情识别方面的有效性,且丰富了人脸图像特征提取方法。     

多通道多模式融合LBP特征的纹理相似度计算

纹理相似度计算是大数据分析和数据挖掘的基本手段之一。为现有纹理特征对彩色图像鉴别能力不强的问题,提出了一种改进LBP特征的纹理相似度计算方法。该方法提出了极值模式、求和模式和编码模式三种特征融合模式,对彩色图像的H、S和V三个通道上获取的LBP特征进行融合,得到彩色图像的纹理描述特征。融合操作在邻域像素点LBP计算、中心像素点LBP计算、直方图特征提取三个阶段进行,提高特征鉴别能力。在VisTex纹理数据库上进行纹理相似度计算实验,结果表明该方法的错误接受率、错误拒绝率和等错误率明显低于文献[7,8,9]所述方法。     

基于局部二值模式的中值滤波检测算法

近年来,数字图像盲取证技术是国际上新兴的一个研究领域,针对数字图像处理及篡改中一种常用的处理模式---中值滤波,提出一种基于局部二值模式（LBP）的中值滤波篡改检测方法。首先对待测图像利用基于中心对称像素的局部二值模式算子（C-LBP）定位其特征提取区域,随后基于局部区域中像素之间的关系提出一种改进型的局部二值模式算子,并将其直方图统计作为最终的检测特征。实验证明,与其他传统滤波检测算法相比,该算子不仅大大降低了计算时间,而且在低维度的条件下取得了较高的检测率,是一种有效的中值滤波检测算子。     

基于2维偏最小二乘法的图像局部特征提取及其在面部表情识别中的应用

为了更有效地提取图像的局部特征,提出了一种基于2维偏最小二乘法(two-dimensional partial leastsquare,2DPLS)的图像局部特征提取方法,并将其应用于面部表情识别中。该方法首先利用局部二元模式(localbinary pattern,LBP)算子提取一幅图像中所有子块的纹理特征,并将其组合成局部纹理特征矩阵。由于样本图像被转化为局部纹理特征矩阵,因此可将传统PLS方法推广为2DPLS方法,用来提取其中的判别信息。2DPLS方法通过对类成员关系矩阵的构造进行相应的修改,使其适应样本的矩阵形式,并能体现出人脸局部信息重要性的差异。同时,对于类成员关系协方差矩阵的奇异性问题,也推导出了其广义逆的解析解。基于JAFFE人脸表情库的实验结果表明,该方法不但可以有效地提取图像局部特征,并能取得良好的表情识别效果。     

基于改进型LBP算法的植物叶片图像识别研究

为了解决LBP算法抽取的纹理特征仅考虑了邻域像素的特征,忽略关键的局部和全局特征的问题,提出一种基于改进型LBP算法的WCM-LBP植物叶片图像特征提取方法。该算法融合了加权局部均值算法WRM-LBP和加权全局均值算法WOM-LBP,通过提取叶片基于区域的关键几何特征和纹理特征对LBP特征描述符进行加权改造,并采用加权局部均值和加权全局均值代替传统的中心像素点,最后将叶片图像的R、G和B通道颜色分量和灰度值作为特征输入矩阵进行图像分析。该算法结合特征加权的模糊半监督聚类算法（SFFD）应用于经典的Flavia、Swedish、Foliage以及自测图片集等4种植物叶片图像数据集中进行实验。实验结果表明,该算法具有很强的鲁棒性,能够有效区分机器视觉下植物叶片图像的关键性识别特征,有效解决叶片图像的分类识别中关键特征的描述问题。     

半色调图像纹理特征提取方法

提出基于局部二值化模式和像素相关算子的半色调图像纹理特征提取方法,以实现误差分散类半色调图像的分类。该方法是将误差分散类图像先进行局部二值化模式变换,再以任一像素点为中心,取适当的距离提取八个方向的像素相关值作为图像的特征向量,最后将提取的特征通过BP神经网络进行分类。实验结果表明,提出的算法适用于二值图像的特征提取,能够降低局部二值模式的特征维数,提高时间效率和空间利用率;相对灰度共生矩阵算法提出的算法在计算复杂度、识别精度等性能方面都有所改善。     

纹理谱描述符及其在图像检索中的应用

为了提高纹理谱描述符的性能并降低其特征维数,在中心对称局部二值模式纹理谱描述符的基础上,提出一种融合局部区域中心像素以及灰度均值的改进纹理描述模式.首先根据图像局部区域内中心像素与其邻域像素间的灰度变化关系,定义了新的局部纹理模式;然后通过比较局部区域内灰度均值与图像全局灰度均值的大小,对局部纹理模式进行了增强处理.采用不同纹理图像库及不同的性能评价准则进行实验的结果表明,文中方法在基于内容图像检索中取得了较好的效果.     

基于梯度和局部多值模式的图像纹理特征提取

为了进一步增强局部二值模式的纹理特征表达能力,提出了一种将图像梯度同局部多值模式相结合的纹理特征提取方法.该方法首先计算出图像的梯度幅度和梯度方向,并根据量化的梯度方向对幅度图进行分解,之后利用得到的幅度图对其进行局部多值模式特征的提取,得到一种新的纹理特征,最后将得到的特征进行图像检索实验.实验结果表明,在纹理丰富的检索库上,该方法所提取的纹理特征更加具有通用性,相对传统局部二值模式图像检索方法具有更好的稳健性和更好的检索效果.     

Extended complete local binary pattern for texture classification

In this paper, an extended complete LBP (ELBP) for texture classification is proposed, in which the local feature vectors are composed of the ratio of the central pixel and its neighborhood pixels to a specific threshold. ECLBP_C represents the gray level of the image, which is obtained by comparing the center pixel with the global threshold. ECLBP_S and ECLBP_M represent the symbol component and the magnitude component of the 3-neighbor region of the center pixel respectively, which are obtained by calculating two binary codes using the original LBP algorithm for the 3-neighbor region of the center pixel. In order to make the proposed algorithm scalable, in addition to the 3-neighbor pixels of the central pixel, the proposed algorithm use the center pixel as the center, r as the radius in the circle with ɑ as the filter’s radius to generate extended binary coding, such as ECLBP_ES_r,α ECLBP_EM_ r,α. In order to describe the local region feature vector in detail, specified ECLBP_ES_r,α and ECLBP_EM_r,α can be obtained by defining the number of extensions according to actual needs, and then established and concatenated all ECLBP gray histograms for statistics. In the experimental part, we analyze the performance of the proposed algorithm in detail, and prove that the algorithm has good scalability and robustness. The experimental results show that the classification accuracy of the proposed algorithm is up to 99% after 3 expansions in Table 2. The source codes of the proposed algorithm can be downloaded from https://github.com/zenqiang/ECLBP.git.