Image retrieval using both color and texture features

In order to improve the retrieval performance of images, this paper proposes an efficient approach for extracting and retrieving color images. The block diagram of our proposed approach to content-based image retrieval (CBIR) is given firstly, and then we introduce three image feature extracting arithmetic including color histogram, edge histogram and edge direction histogram, the histogram Euclidean distance, cosine distance and histogram intersection are used to measure the image level similarity. On the basis of using color and texture features separately, a new method for image retrieval using combined features is proposed. With the test for an image database including 766 general-purpose images and comparison and analysis of performance evaluation for features and similarity measures, our proposed retrieval approach demonstrates a promising performance. Experiment shows that combined features are superior to every single one of the three features in retrieval.     

Texture-based image indexing in the process of lossless data compression

The authors describe a new approach for content-based image indexing and retrieval by extracting texture features from the process of image compression via JPEG-LS. Since the compression technique adopted incorporates local edge detection to formulate predictive values for pixels being encoded, the texture features extracted by the proposed algorithms are also capable of describing image content in terms of edges and shapes of local objects without adding any significant complexity to the original JPEG-LS. While lossless data compression helps in saving storage space automatically for image databases, the extensive experiments also show that this type of feature extraction produces better retrieval results in comparison with existing similar indexing techniques which are carried out without data compression.     

一种基于区域的图像检索方法的研究

针对目前基于全局特征的图像检索系统存在的局限性,提出了一种基于区域的检索方案.首先应用K均值聚类算法将图像中的像素按颜色进行聚类,每一类近似对应于图像中的一个一致性区域,在区域上提取颜色和纹理特征.这种方式将检索过程深入到图像内部的物体中去,在一定程度上体现了图像的语义特性;在相似性匹配阶段,提出了一种基于区域的相似性匹配算法,并在实验中证明了其有效性.     

A comparative study of irregular pyramid matching in bag-of-bags of words model for image retrieval

In this paper, we assess three standard approaches to build irregular pyramid partitions for image retrieval in the bag-of-bags of words model that we recently proposed. These three approaches are: kernel \(k\)-means to optimize multilevel weighted graph cuts, normalized cuts and graph cuts, respectively. The bag-of-bags of words (BBoW) model is an approach based on irregular pyramid partitions over the image. An image is first represented as a connected graph of local features on a regular grid of pixels. Irregular partitions (subgraphs) of the image are further built by using graph partitioning methods. Each subgraph in the partition is then represented by its own signature. The BBoW model with the aid of graph extends the classical bag-of-words model, by embedding color homogeneity and limited spatial information through irregular partitions of an image. Compared with existing methods for image retrieval, such as spatial pyramid matching, the BBoW model does not assume that similar parts of a scene always appear at the same location in images of the same category. The extension of the proposed model to pyramid gives rise to a method we name irregular pyramid matching. The experiments on Caltech-101 benchmark demonstrate that applying kernel \(k\)-means to graph clustering process produces better retrieval results, as compared with other graph partitioning methods such as graph cuts and normalized cuts for BBoW. Moreover, this proposed method achieves comparable results and outperforms SPM in 19 object categories on the whole Caltech-101 dataset.     

Integrated spectral and spatial information mining in remote sensing imagery

Most existing remote sensing image retrieval systems allow only simple queries based on sensor, location, and date of image capture. This approach does not permit the efficient retrieval of useful hidden information from large image databases. This paper presents an integrated approach to retrieving spectral and spatial patterns from remotely sensed imagery using state-of-the-art data mining and advanced database technologies. Land cover information corresponding to spectral characteristics is identified by supervised classification based on support vector machines with automatic model selection, while textural features characterizing spatial information are extracted using Gabor wavelet coefficients. Within identified land cover categories, textural features are clustered to acquire search-efficient space in an object-oriented database with associated images in an image database. Interesting patterns are then retrieved using a query-by-example approach. The evaluation of the study results using coverage and novelty measures validates the effectiveness of the proposed remote sensing image information mining framework, which is potentially useful for applications such as agricultural and environmental monitoring.     

一种改进的综合BTC颜色矩和DT-CWT的图像检索算法

摘 要：特征提取是基于内容的图像检索中的关键技术。针对基于单一特征检索效果不理想的问题,提出一种改进的综合颜色和纹理特征的图像检索算法。该算法在YIQ颜色空间中进行特征提取,首先结合方块编码（BTC）的思想,提取颜色矩作为颜色特征;采用双树复小波变换（DT-CWT）提取纹理特征,融合两种特征并利用相似性度量方式进行图像检索。实验结果表明算法所提取的颜色、纹理特征更利于检索,使用综合特征检索的平均查准率比同类算法更高。     

A new way for multidimensional medical data management: volume of interest (VOI)-based retrieval of medical images with visual and functional features.

The advances in digital medical imaging and storage in integrated databases are resulting in growing demands for efficient image retrieval and management. Content-based image retrieval (CBIR) refers to the retrieval of images from a database, using the visual features derived from the information in the image, and has become an attractive approach to managing large medical image archives. In conventional CBIR systems for medical images, images are often segmented into regions which are used to derive two-dimensional visual features for region-based queries. Although such approach has the advantage of including only relevant regions in the formulation of a query, medical images that are inherently multidimensional can potentially benefit from the multidimensional feature extraction which could open up new opportunities in visual feature extraction and retrieval. In this study, we present a volume of interest (VOI) based content-based retrieval of four-dimensional (three spatial and one temporal) dynamic PET images. By segmenting the images into VOIs consisting of functionally similar voxels (e.g., a tumor structure), multidimensional visual and functional features were extracted and used as region-based query features. A prototype VOI-based functional image retrieval system (VOI-FIRS) has been designed to demonstrate the proposed multidimensional feature extraction and retrieval. Experimental results show that the proposed system allows for the retrieval of related images that constitute similar visual and functional VOI features, and can find potential applications in medical data management, such as to aid in education, diagnosis, and statistical analysis.     

Zernike moments and LDP-weighted patches for content-based image retrieval

This paper proposes a new algorithm using global and local features for content-based image retrieval. Global features are extracted using the magnitude of Zernike moments (ZMs). Local features are obtained through local directional pattern (LDP). Generally, LDP is used to extract texture-based features from an image. In this paper, LDP is used to encode both texture and shape information of an image to represent more meaningful features. To encode texture-based features, original image is used to compute the LDP features. To extract shape information from an image, dual-tree complex wavelet transform (DT-CWT) is applied on image which generates six directional wavelets. These six directional wavelets are superimposed in order to obtain shape-encoded image. LDP is then applied on this wavelet-based shape-encoded image. Further, to enhance retrieval accuracy, LDP features are extracted from patches of both original and shape-encoded images. These patches are assigned with weights based on average discrimination capability of features in a patch. Experiments are performed using three different standard databases with various variations such as pose, distortion, partial occlusion and complex structure. The proposed technique achieves 96.4 and 98.76 % retrieval accuracy at a recall of 50 %, for Kimia-99 and COIL-100 databases, respectively. For MPEG-7 CE-2 shape database, retrieval accuracy of 61.93 % is achieved in terms of average Bull’s eye performance (BEP). The proposed technique is also tested on Springer medical image database to explore its scope in other areas, wherein it attains average BEP of 69.68 % in comparison with 61.52 % with ZMs. It is observed that the proposed technique outperforms other well-known existing methods of image retrieval.     

Content-based image retrieval using a fusion of global and local features

Color, texture, and shape act as important information for images in human recognition. For content-based image retrieval, many studies have combined color, texture, and shape features to improve the retrieval performance. However, there have not been many powerful methods for combining all color, texture, and shape features. This study proposes a content-based image retrieval method that uses the combined local and global features of color, texture, and shape. The color features are extracted from the color autocorrelogram; the texture features are extracted from the magnitude of a complete local binary pattern and the Gabor local correlation revealing local image characteristics; and the shape features are extracted from singular value decomposition that reflects global image characteristics. In this work, an experiment is performed to compare the proposed method with those that use our partial features and some existing techniques. The results show an average precision that is 19.60% higher than those of existing methods and 9.09% higher than those of recent ones. In conclusion, our proposed method is superior over other methods in terms of retrieval performance.     

基于MPEG-7的图像检索模型研究

研究了基于内容的图像检索系统中的目标描述模型的建立方法。首先指出了目标描述模型是图像检索的关键技术,然后分析了ＭＰＥＧ－７草案中有关多媒体描述的基本术语、描述机制和ＭＰＥＧ－７的应用框架,最后基于ＭＰＥＧ－７提出了一种适合于图像检索的目标描述模型。该模型对提取出的多种视觉特征和相应的表示方法采用了分层结构。模型满足用户对所需特征进行不同级别检索的要求。     

Semantic-Sensitive Satellite Image Retrieval

Content-based image-retrieval techniques based on query scenes are a powerful means for exploration and mining of large remote sensing image databases. However, the gap between low-level unsupervised extracted features in content-based retrieval and the high-level semantic concepts of user queries limits the performance. Therefore, this paper proposes a specialized approach using a context-sensitive Bayesian network for semantic inference of segmented scenes. The regions' remote sensing related semantic concepts are inferred in a multistage process based on their spectral and textural characteristics as well as the semantics of adjacent regions. During the actual retrieval, the semantics are employed for the extraction of candidate scenes which are evaluated and ranked in a consecutive step. The approach was implemented and compared with a different strategy that utilizes the extracted features from the imagery directly to infer the semantics. In summary, the developed system achieved higher precision and recall rates using the same training data     

A new image retrieval model based on monogenic signal representation

This paper proposes a novel image retrieval model based on monogenic signal representation. An original image is decomposed into three complementary components: amplitude, orientation and phase by monogenic signal representation. The monogenic variation in each local region and monogenic feature in each pixel are encoded, and then the statistical features of the local features encoded are calculated. In order to overcome the problem of high feature dimensionality, the local statistical features extracted from the complementary monogenic components are projected by block-based fisher discriminant analysis, which not only reduces the dimensionality of the features extracted, but also enhances its discriminative power. Finally, these features reduced are fused for effective image retrieval. Experimental results show that our scheme can effectively describe an image, and obviously improve the average retrieval precision.     

A shape-based image retrieval method using salient edges

Content-based image retrieval is emerging as an important research area with applications in digital libraries and multimedia databases. In this paper, we present a novel five-stage image retrieval method based on salient edges. In the first stage, the Canny operator is performed to detect edge points. Then, the Water-Filling algorithm is employed to extract edge curves. In the third stage, salient edges are selected and the shape features in terms of the salient edges are yielded. In the fourth stage, a similarity measure, namely the integrated salient edge matching, that integrates properties of all the salient edges, is introduced, and used to compare the similarity of the query image with the images in the database. Finally, the best matches are returned in similarity order. The presented approach is easy to implement and can be efficiently applied to retrieve images with clear edges. Preliminary experimental results on a database containing 6500 images are very promising.     

基于颜色矢量角的彩色图像检索算法研究

通过分析利用颜色直方图进行图像检索时存在的问题,提出了一种基于图像边缘空间分布特征的图像检索算法。即利用颜色矢量角对亮度不敏感,对色度和饱和度敏感的特性来提取图像的边缘信息。在图像的边缘空间,提取图像边缘点的颜色矢量角直方图,以此来描述图像的内容。该算法充分利用了图像的颜色信息、边缘信息及形状信息,实验表明该算法具有较好的光照不变性、尺度不变性、平移不变性和旋转不变性。     

基于边缘方向直方图的形状检索

近年来,随着多媒体技术和数字设备的出现,如何有效地管理和访问图像信息已成为人们亟待解决的问题.因此,一种新的图像检索技术——基于内容的图像检索技术被提出来.其中,由于图像的形状特征更符合人们的视觉感知,因此基于形状的图像检索越来越受到研究者的关注.旨在研究基于形状轮廓特征的图像检索,提出了基于边缘方向的直方图形状检索算法.通过对常用边缘检测算子的分析和比较,给出了边缘方向直方图特征提取的具体实现技术,对采用的特征匹配方法做了描述,最后通过实验的结果与分析验证了算法的性能.     

基于全局和局部颜色特征的图像检索方法

提出了一种基于图像全局和局部颜色特征的图像检索方法.首先在符合视觉感知特性的Lab颜色空间中提取全局颜色特征;再对图像进行图像子块划分,同时利用具有人眼视觉特性的高斯加权系数对其进行加权,然后利用二值化得到的颜色位图作为局部颜色特征,并进一步加入了方向性的考虑,对图像子块进行垂直和水平投影,最后合理地融合了全局和局部颜色特征的相似性进行图像检索.对Corel图像数据库的实验结果表明,此算法具有良好的检索效率.     

基于标准差梯度的模糊边缘检测算法

红外图像的边缘检测是图像处理领域的难题之一。结合红外图像的特点,将最小误差原理推广到模糊域进而应用到红外图像的边缘检测上,提出了一种基于标准差梯度的红外图像模糊边缘检测算法。首先提出了一种基于标准差的梯度算子,将图像中潜在的边缘区域很好地区分出来;而后引入模糊最小误差阈值算法．根据此算法自适应提取了标准差梯度图像中的最优阈值,从而实现了红外图像的目标边缘检测。与传统的基于梯度的红外图像边缘检测算法进行对比实验,结果表明,该算法用于红外图像边缘检测能获得更好的效果。     

基于颜色和边缘的快速图像检索研究

在分析传统的图像检索技术基础上,研究了一种基于颜色和边缘特征的快速图像检索技术。首先,在HSI颜色空间中,使用色调直方图对原图像库进行初步检索,获得初级检索图像库;然后,用改进的数学形态学算法对初级检索图像库进行边缘提取,使用边缘像素点集合颜色直方图对初级检索图像库进行再次检索,从而得到最终的检索结果。实验结果表明方法在提高图像检索精度的同时,大大缩短了检索时间。