A new matching strategy for content based image retrieval system

Adopting effective model to access the desired images is essential nowadays with the presence of a huge amount of digital images. The present paper introduces an accurate and rapid model for content based image retrieval process depending on a new matching strategy. The proposed model is composed of four major phases namely: features extraction, dimensionality reduction, ANN classifier and matching strategy. As for the feature extraction phase, it extracts a color and texture features, respectively, called color co-occurrence matrix (CCM) and difference between pixels of scan pattern (DBPSP). However, integrating multiple features can overcome the problems of single feature, but the system works slowly mainly because of the high dimensionality of the feature space. Therefore, the dimensionality reduction technique selects the effective features that jointly have the largest dependency on the target class and minimal redundancy among themselves. Consequently, these features reduce the calculation work and the computation time in the retrieval process. The artificial neural network (ANN) in our proposed model serves as a classifier so that the selected features of query image are the input and its output is one of the multi classes that have the largest similarity to the query image. In addition, the proposed model presents an effective feature matching strategy that depends on the idea of the minimum area between two vectors to compute the similarity value between a query image and the images in the determined class. Finally, the results presented in this paper demonstrate that the proposed model provides accurate retrieval results and achieve improvement in performance with significantly less computation time compared with other models.     

Automatic content based image retrieval using semantic analysis

We present a new text-to-image re-ranking approach for improving the relevancy rate in searches. In particular, we focus on the fundamental semantic gap that exists between the low-level visual features of the image and high-level textual queries by dynamically maintaining a connected hierarchy in the form of a concept database. For each textual query, we take the results from popular search engines as an initial retrieval, followed by a semantic analysis to map the textual query to higher level concepts. In order to do this, we design a two-layer scoring system which can identify the relationship between the query and the concepts automatically. We then calculate the image feature vectors and compare them with the classifier for each related concept. An image is relevant only when it is related to the query both semantically and content-wise. The second feature of this work is that we loosen the requirement for query accuracy from the user, which makes it possible to perform well on users’ queries containing less relevant information. Thirdly, the concept database can be dynamically maintained to satisfy the variations in user queries, which eliminates the need for human labor in building a sophisticated initial concept database. We designed our experiment using complex queries (based on five scenarios) to demonstrate how our retrieval results are a significant improvement over those obtained from current state-of-the-art image search engines.     

Feed-forward content based image retrieval using adaptive tetrolet transforms

This paper proposes a new approach for content based image retrieval based on feed-forward architecture and Tetrolet transforms. The proposed method addresses the problems of accuracy and retrieval time of the retrieval system. The proposed retrieval system works in two phases: feature extraction and retrieval. The feature extraction phase extracts the texture, edge and color features in a sequence. The texture features are extracted using Tetrolet transform. This transform provides better texture analysis by considering the local geometry of the image. Edge orientation histogram is used for retrieving the edge feature while color histogram is used for extracting the color features. Further retrieval phase retrieves the images in the feed-forward manner. At each stage, the number of images for next stage is reduced by filtering out irrelevant images. The Euclidean distance is used to measure the distance between the query and database images at each stage. The experimental results on COREL- 1 K and CIFAR - 10 benchmark databases show that the proposed system performs better in terms of the accuracy and retrieval time in comparison to the state-of-the-art methods.     

FReBIR: An image retrieval system based on fuzzy region matching

In this paper, we present a method of image indexing and retrieval which takes into account the relative positions of the regions within the image. Indexing is based on a segmentation of the image into fuzzy regions; we propose an algorithm which produces a fuzzy segmentation. The image retrieval is based on inexact graph matching, taking into account both the similarity between regions and the spatial relation between them. We propose, on one hand a solution to reduce the combinatorial complexity of the graph matching, and on the other hand, a measure of similarity between graphs allowing the result images ranking. A relevance feedback process based on region classifiers allows then a good generalization to a large variety of the regions. The method is adapted to partial queries, aiming for example at retrieving images containing a specific type of object. Applications may be of two types, firstly an on-line search from a partial query, with a relevance feedback aiming at interactively leading the search, and secondly an off-line learning of categories from a set of examples of the object. The name of the system is FReBIR for Fuzzy Region-Based Image Retrieval.     

基于层级匹配的维吾尔文关键词文档图像检索

为实现基于关键词的维吾尔文文档图像检索,提出一种基于由粗到细层级匹配的关键词文档图像检索方法。使用改进的投影切分法将经过预处理的文档图像切分成单词图像库,使用模板匹配对关键词进行粗匹配;在粗匹配的基础上,提取单词图像的方向梯度直方图(HOG)特征向量;通过支持向量机(SVM)分类器学习特征向量,实现关键词图像检索。在包含108张文档图像的数据库中进行实验,实验结果表明,检索准确率平均值为91.14%,召回率平均值为79.31%,该方法能有效实现基于关键词的维吾尔文文档图像检索。     

Tongue image matching using color content

This paper addresses the problem of color image matching in medical diagnosis. The color matching of tongue images in different color spaces with different metrics have been investigated and is reported in this article. Two new metrics namely, sorted metric and probabilistic combined metric, are proposed. Existing distance measurements in coordinate space do not satisfy the reflexivity axiom. That means, they are not the valid metrics. To overcome this limitation, the sorted metric in coordinate space is proposed in coordinate space. To improve the matching performance, a probabilistic combined metric is proposed based on the theory of combining classifier. These metrics are applied for the matching of tongue color images and the results are encouraging.     

隐私保护的图像内容检索技术研究综述

随着智能设备与社交媒体的广泛普及,图片数据的数量急剧增长,数据拥有者将本地数据外包至云平台,在云服务器上实现数据的存储、分享和检索。然而,图像数据含有大量有关用户的敏感信息,外部攻击者和不完全可信的云服务器都试图获取原始图像的内容,窥探用户隐私,造成严重的隐私泄露风险。回顾了近年来隐私保护需求下图像内容检索技术的研究进展,总结了应用于该技术的图像加密算法,包括同态加密、随机化加密和比较加密,围绕这3种密码技术,详细分析和比较了典型的解决方案,并介绍了索引构造的改进策略。最后,总结和展望了未来的研究趋势。     

基于内容图像检索的聚类算法研究*

介绍了基于内容图像检索的系统结构、特征提取等内容,并将数据挖掘的聚类算法与之结合,对各种聚类算法进行了总结,最后提出了一些未来的发展方向。     

遗传反馈的多特征图像检索

基于内容的图像检索是随着数字多媒体技术的发展和普及而新兴的一门信息检索技术。针对当前该领域存在的对图像描述不准确、查询精度低以及反馈次数较多的问题,提出一种基于遗传反馈的图像检索算法。该算法以遗传算法和相关反馈为基础,利用多特征进行检索,避免在利用单一特征进行检索时所出现的不同图像具有相同单一特征（颜色、纹理和形状等）的问题,对图像进行多特征描述可以从多个角度对图像进行定义,大大减少了不同图像却具有相同特征的概率。与现有的算法相比,其具有自动调整图像特征权重、较低反馈次数和较高查询精度的特性。实验结果表明,该算法对于旋转、平移和尺度变化具有较强的鲁棒性,同时具有减少反馈次数和较高查询精度的性能。     

Edge based features for content based image retrieval

The common problem in content based image retrieval (CBIR) is selection of features. Image characterization with lesser number of features involving lower computational cost is always desirable. Edge is a strong feature for characterizing an image. This paper presents a robust technique for extracting edge map of an image which is followed by computation of global feature (like fuzzy compactness) using gray level as well as shape information of the edge map. Unlike other existing techniques it does not require pre segmentation for the computation of features. This algorithm is also computationally attractive as it computes different features with limited number of selected pixels.     

基于内容图像检索中的相关反馈技术研究*

简要介绍了基于内容的图像检索,讨论了相关反馈的基本思想及其交互过程,重点对现有的相关反馈算法进行了分类总结和分析,并展望了今后相关反馈技术的发展趋势。     

基于多颜色空间的图像检索方法

介绍了HSV在低饱和度和低亮度时的色调奇异性,分析了HSV的色调奇异性对图像检索的影响。在此基础上,提出了基于多颜色空间的图像检索方法,奇异区域的像素点用YUV颜色空间表示,其他像素点用HSV颜色空间表示。实验表明,该算法在一定程度上克服了HSV的色调奇异性对图像检索的影响,提高了检索性能。     

State of the art content based image retrieval techniques using deep learning: a survey

In the recent years the rapid growth of multimedia content makes the image retrieval a challenging research task. Content Based Image Retrieval (CBIR) is a technique which uses features of image to search user required image from large image dataset according to the user’s request in the form of query image. Effective feature representation and similarity measures are very crucial to the retrieval performance of CBIR. The key challenge has been attributed to the well known semantic gap issue. The machine learning has been actively investigated as possible solution to bridge the semantic gap. The recent success of deep learning inspires as a hope for bridging the semantic gap in CBIR. In this paper, we investigate deep learning approach used for CBIR tasks under varied settings from our empirical studies; we find some encouraging conclusions and insights for future research.

     

Robust image retrieval based on color histogram of local feature regions

Color histograms lack spatial information and are sensitive to intensity variation, color distortion and cropping. As a result, images with similar histograms may have totally different semantics. The region-based approaches are introduced to overcome the above limitations, but due to the inaccurate segmentation, these systems may partition an object into several regions that may have confused users in selecting the proper regions. In this paper, we present a robust image retrieval based on color histogram of local feature regions (LFR). Firstly, the steady image feature points are extracted by using multi-scale Harris-Laplace detector. Then, the significant local feature regions are ascertained adaptively according to the feature scale theory. Finally, the color histogram of local feature regions is constructed, and the similarity between color images is computed by using the color histogram of LFRs. Experimental results show that the proposed color image retrieval is more accurate and efficient in retrieving the user-interested images. Especially, it is robust to some classic transformations (additive noise, affine transformation including translation, rotation and scale effects, partial visibility, etc.).     

基于层次匹配下多种特征融合的蕾丝花边检索方法

针对基于图像纹理特征的蕾丝花边检索方法效率低下问题,为提高蕾丝花边检索效率,提出一种基于层次匹配下多种特征融合的蕾丝花边检索方法。通过运用图像纹理特征标识图像,利用Canny算子处理纹理图像,得到彩色Canny图像及其灰度梯度共生矩阵GGCM,采用能量、梯度平均、灰度平均、相关等二次统计特征参数描述图像的纹理特征,将上述提取纹理特征结合形状特征和SURF特征进行逐层匹配,实现层次匹配下多种特征的融合,弥补单个匹配方法的不足,同时在蕾丝花边库中验证所提检索方法的正确率。实验结果表明,与其他匹配方法相比,该方法提取的纹理特征具有更强的纹理鉴别能力,能较好地实现蕾丝花边检索,有效地提高了检索方法的速率和准确率。     

An efficient bi-layer content based image retrieval system

Multimedia Tools and Applications - Large amount of multi-media content, generated by various image capturing devices, is shared and downloaded by millions of users across the globe, every second....     

Inexact graph matching based on kernels for object retrieval in image databases

In the framework of online object retrieval with learning, we address the problem of graph matching using kernel functions. An image is represented by a graph of regions where the edges represent the spatial relationships. Kernels on graphs are built from kernel on walks in the graph. This paper firstly proposes new kernels on graphs and on walks, which are very efficient for graphs of regions. Secondly we propose fast solutions for exact or approximate computation of these kernels. Thirdly we show results for the retrieval of images containing a specific object with the help of very few examples and counter-examples in the framework of an active retrieval scheme.     

基于高亮模型匹配的SAR建筑物高度反演方法

针对高分辨率SAR图像中的建筑物高度提取问题,提出了一种基于高亮模型匹配的建筑物高度反演方法。通过对建筑物的成像特征进行分析构建出高亮特征模型,建立模型与SAR图像之间的匹配度函数,运用多种群遗传算法对匹配度函数进行优化搜索出最优的高度参数。基于模拟和实测SAR图像的实验结果表明该算法可以用于SAR图像建筑物高度反演,并具有较高的反演精度。