结合改进CNN和双线性模型的CBIR方法

针对现有基于内容的图像检索（Content-Based Image Retrieval,CBIR）方法中图像特征维度较大等问题,提出一种结合改进卷积神经网络（Convolutional Neural Network,CNN）和双线性模型的CBIR方法。采用一种低维度池化方法代替传统CNN中的池化过程,以此降低图像特征映射的维度。基于双线性模型的思想,使用两个特征提取器进行特征提取,并在每个图像位置上对两个特征进行内积,以形成最终的图像描述符。通过计算图像间的曼哈顿距离度量来评估相似性,获得相关图像及其排序。实验结果表明,该方法能够准确检索出相关图像,并具有较低的检索时间和内存消耗。     

基于主色选择的CBIR检索

基于内容和图像检索（CBIR）是多媒体检索研究的前沿课题，利用颜色特征作为索引进行图像检索是最重要的战术，在提取图像主要颜色特征的基础上，进一步提取了相应的主色空间分布信息-主色矩特征，作为图像库的索引，在改进加权二次型相似性度量方法的基础上，提出了相应的主色多特征相似性度量方法，由于用户对图像中不同的主色具有不同的检索要求，提出了主色调选择的用户模型，用于更精确的图像检索，实现了WWW发布方式的CBIR原型系统，实验结果表明加入主色选择使得图像检索的效果更好。     

几种基于内容的图像检索的方法

基于内容的图像检索(CBIR)技术依赖于对图像特征(例如颜色直方图、纹理、草图、形状等)的提取,相对于传统的基于文本的图像检索方式,这种方式提高了检索效率和检索的准确率。文中主要介绍了基于颜色和基于纹理特征这两种特征提取方法。这两种方法既能够反映全局特征,又能够兼顾所感兴趣区域的局部特征,是基于内容的图像检索的两种非常有效的方法。     

基于内容的图象检索技术

随着数字图象的日益增多,基于内容的图象检索已成为图象使用者和管理者迫切需要解决的问题,近年来,各国研究者纷纷加入该领域的研究.为了使人们对该领域现状有个概略了解,以推动该领域研究进一步开展,首先概括介绍了基于内容图象检索的产生、发展及其关键技术;然后介绍了特征提取(包括低层特征和语义特征)及其相似性计算、相关反馈等的原理及算法;最后指出了基于内容的图象检索技术与计算机视觉技术的区别所在,并对目前存在的问题和应着重的研究内容以及发展方向进行了分析.     

基于色彩和边缘特征的图像检索方法

为了改善基于内容的图像检索的效果和提高其检索效率,提出一种基于色彩和边缘特征的图像检索方法。首先将RGB图像分成几个子图像的形式,然后,对于每一个子图像提取其色彩特征和边缘特征,其中边缘特征的获得采用了瞬时保持（MP）边缘检测技术。将这两种特征结合在一起使用,可以实现准确快捷的图像检索。实验结果表明,该方法在检索精度和检索效率上都高于Cheng的两种方法且所用的时间分别为Cheng的方法的10%和3%,检索精度提高近20%。     

颜色的模糊识别方法及其在图像检索中的应用

基于内容的图像检索（Content-based Image Retrieval,CBIR）以其极高的理论与应用价值成为了图像处理领域的研究热点。提取和匹配图像特征是CBIR的主要手段。然而提取图像的有效特征是极其困难的。利用HSV颜色空间特性以及人类对颜色的感知规律,提出一种颜色识别方法。应用此方法对图像的像素进行一种保持结构的分类,并在类内提取结构特征。图像的特征匹配将在同类像素集合间进行,降低了图像特征提取与匹配的复杂性。实验表明,提出的图像检索方法有良好的效果。     

Content-based image retrieval using growing hierarchical self-organizing quadtree map

In this paper, a growing hierarchical self-organizing quadtree map (GHSOQM) is proposed and used for a content-based image retrieval (CBIR) system. The incorporation of GHSOQM in a CBIR system organizes images in a hierarchical structure. The retrieval time by GHSOQM is less than that by using direct image comparison using a flat structure. Furthermore, the ability of incremental learning enables GHSOQM to be a prospective neural-network-based approach for CBIR systems. We also propose feature matrices, image distance and relevance feedback for region-based images in the GHSOQM-based CBIR system. Experimental results strongly demonstrate the effectiveness of the proposed system.     

Relevance Feedback and Learning in Content-Based Image Search

A major bottleneck in content-based image retrieval (CBIR) systems or search engines is the large gap between low-level image features used to index images and high-level semantic contents of images. One solution to this bottleneck is to apply relevance feedback to refine the query or similarity measures in image search process. In this paper, we first address the key issues involved in relevance feedback of CBIR systems and present a brief overview of a set of commonly used relevance feedback algorithms. Almost all of the previously proposed methods fall well into such framework. We present a framework of relevance feedback and semantic learning in CBIR. In this framework, low-level features and keyword annotations are integrated in image retrieval and in feedback processes to improve the retrieval performance. We have also extended framework to a content-based web image search engine in which hosting web pages are used to collect relevant annotations for images and users' feedback logs are used to refine annotations. A prototype system has developed to evaluate our proposed schemes, and our experimental results indicated that our approach outperforms traditional CBIR system and relevance feedback approaches.     

综合颜色和纹理特征的图像检索算法

基于内容的图像检索是当前多媒体信息检索的热点之一。基于内容的图像检索技术是根据对图像内容(特征)的描述和提取,在图像库中找到具有指定内容(特征)的图像。本文对图像颜色特征和纹理特征的提取、相似性度量等基于内容的图像检索的关键技术进行了分析和研究,并在此基础上,提出了一个基于颜色特征和纹理特征的图像检索算法并验证了其有效性。该算法采用HSV颜色空间的直方图作为颜色特征向量,采用灰度共生矩阵的四个纹理特征:能量、熵、惯性矩和相关性构成纹理特征向量,采用欧氏距离进行相似性度量。实验结果表明,该算法实现的系统具有良好的图像检索功能。     

基于内容图像检索的特征子空间抽取

作为一种有效的解决手段,相关反馈(relevance feedback)技术在基于内容图像检索(content based image retrieval)的研究中得到了深入的发展.尽管有效,已有的反馈算法却始终没有解决特征空间的有指导降维和特征中的噪声去除这两个问题.提出了一种新的方法,通过对用户在检索过程中提供的正反馈样本在各特征空间中的分布特性,利用主成分分析(principal component analysis)来消除特征中的噪声,实现了对特征空间进行有效的降维.试验结果显示,该方法在不牺牲检索精度的前提下提高了检索速度,降低了存储复杂度.     

一种基于视觉单词的图像检索方法

基于内容的图像检索技术最主要的问题是图像的低层特征和高层语义之间存在着"语义鸿沟"。受文本内容分析的启发,有研究学者借鉴传统词典中用文本单词组合解释术语的思路,将图像视为视觉单词的组合,利用一系列视觉单词的组合来描述图像的语义内容。为此,利用SIFT进行图像的视觉单词特征提取,然后构建视觉单词库,最后实现了一个基于视觉单词的图像检索系统。实验结果表明,该方法在一定程度上提高了图像检索的查准率。     

Content-based image retrieval with the normalized information distance

The main idea of content-based image retrieval (CBIR) is to search on an image’s visual content directly. Typically, features (e.g., color, shape, texture) are extracted from each image and organized into a feature vector. Retrieval is performed by image example where a query image is given as input by the user and an appropriate metric is used to find the best matches in the corresponding feature space. We attempt to bypass the feature selection step (and the metric in the corresponding feature space) by following what we believe is the logical continuation of the CBIR idea of searching visual content directly. It is based on the observation that, since ultimately, the entire visual content of an image is encoded into its raw data (i.e., the raw pixel values), in theory, it should be possible to determine image similarity based on the raw data alone. The main advantage of this approach is its simplicity in that explicit selection, extraction, and weighting of features is not needed. This work is an investigation into an image dissimilarity measure following from the theoretical foundation of the recently proposed normalized information distance (NID) [M. Li, X. Chen, X. Li, B. Ma, P. Vitányi, The similarity metric, in: Proceedings of the 14th ACM-SIAM Symposium on Discrete Algorithms, 2003, pp. 863–872]. Approximations of the Kolmogorov complexity of an image are created by using different compression methods. Using those approximations, the NID between images is calculated and used as a metric for CBIR. The compression-based approximations to Kolmogorov complexity are shown to be valid by proving that they create statistically significant dissimilarity measures by testing them against a null hypothesis of random retrieval. Furthermore, when compared against several feature-based methods, the NID approach performed surprisingly well.     

An Efficient Deep Learning-based Content-based Image Retrieval Framework

The use of massive image databases has increased drastically over the few years due to evolution of multimedia technology. Image retrieval has become one of the vital tools in image processing applications. Content-Based Image Retrieval (CBIR) has been widely used in varied applications. But, the results produced by the usage of a single image feature are not satisfactory. So, multiple image features are used very often for attaining better results. But, fast and effective searching for relevant images from a database becomes a challenging task. In the previous existing system, the CBIR has used the combined feature extraction technique using color auto-correlogram, Rotation-Invariant Uniform Local Binary Patterns (RULBP) and local energy. However, the existing system does not provide significant results in terms of recall and precision. Also, the computational complexity is higher for the existing CBIR systems. In order to handle the above mentioned issues, the Gray Level Co-occurrence Matrix (GLCM) with Deep Learning based Enhanced Convolution Neural Network (DLECNN) is proposed in this work. The proposed system framework includes noise reduction using histogram equalization, feature extraction using GLCM, similarity matching computation using Hierarchal and Fuzzy c- Means (HFCM) algorithm and the image retrieval using DLECNN algorithm. The histogram equalization has been used for computing the image enhancement. This enhanced image has a uniform histogram. Then, the GLCM method has been used to extract the features such as shape, texture, colour, annotations and keywords. The HFCM similarity measure is used for computing the query image vector's similarity index with every database images. For enhancing the performance of this image retrieval approach, the DLECNN algorithm is proposed to retrieve more accurate features of the image. The proposed GLCM+DLECNN algorithm provides better results associated with high accuracy, precision, recall, f-measure and lesser complexity. From the experimental results, it is clearly observed that the proposed system provides efficient image retrieval for the given query image.     

发掘相关反馈日志中关联信息的图像检索方法

相关反馈日志蕴含着丰富的对象语义关联信息,但大多数基于内容的图像检索(CBIR)方法却缺乏对它们的重用.提出一种发掘反馈日志中图像关联信息的自动化图像检索方法,将反馈事例中图像的共生现象视为一定上下文中的图像分类.检索时,结合CBIR的检索结果和多种上下文中的图像分类实例,借鉴HITS算法的思想从中提炼图像的本质性关联,获得综合内容和语义的图像检索结果.对6万幅Corel图像数据库的实验表明,该方法可以显著改善查全率和查准率,且检索结果能够更好地满足用户的语义检索需求.     

融合相机元信息的基于区域的手机图片搜索

照相手机的流行及其具有的随身携带性,使得人们能够随时随地进行拍照。相比传统的相机来说,手机的联网性使得人们能够实时地进行图片搜索和分享。由此而来的手机图片数量的急剧增长,又使得如何高效地组织、管理以及检索这些图片成为了研究热点。为了高效地进行手机图片搜索,提出了一种融合相机元信息(Exif)的基于区域的手机图片搜索算法,同时利用这个算法实现了一个在线的用户手机拍摄图片的搜索系统。通过与传统的基于内容的手机图片搜索的对比可见,该算法通过融合进相机元信息以及物体的区域特征,在一定程度上降低了"语义鸿沟"问题。实验结果表明,该算法优于传统的基于底层特征的图片搜索算法。     

A novel image retrieval model based on the most relevant features

This paper presents a proposed model for content-based image retrieval (CBIR) which depends only on extracting the most relevant features according to a feature selection technique. The suggested feature selection technique aims at selecting the optimal features that not only maximize the detection rate but also simplify the computation of the image retrieval process. The proposed model is divided into three main techniques, the first one is concerned with the features extraction from images database, the second is performing feature discrimination, and the third is concerned with the feature selection from the original ones. As for the first technique, the 3D color histogram and the Gabor filter algorithm are used to extract the color and texture features respectively. While the second technique depends on a genetic algorithm (GA) for replacing numerical features with nominal features that represent intervals of numerical domains with discrete values. The GA is utilized in this technique to obtain the optimal boundaries of these intervals, and consequently to reduce the complexity in feature space. In the third technique, the feature selection performs two successive functions which are called preliminary and deeply reduction for extracting the most relevant features from the original features set. Indeed, the main contribution of the proposed model is providing a precise image retrieval in a short time.     

Parallel heterogeneous CBIR system for efficient hyperspectral image retrieval using spectral mixture analysis

The purpose of content‐based image retrieval (CBIR) is to retrieve, from real data stored in a database, information that is relevant to a query. In remote sensing applications, the wealth of spectral information provided by latest‐generation (hyperspectral) instruments has quickly introduced the need for parallel CBIR systems able to effectively retrieve features of interest from ever‐growing data archives. To address this need, this paper develops a new parallel CBIR system that has been specifically designed to be run on heterogeneous networks of computers (HNOCs). These platforms have soon become a standard computing architecture in remote sensing missions due to the distributed nature of data repositories. The proposed heterogeneous system first extracts an image feature vector able to characterize image content with sub‐pixel precision using spectral mixture analysis concepts, and then uses the obtained feature as a search reference. The system is validated using a complex hyperspectral image database, and implemented on several networks of workstations and a Beowulf cluster at NASA's Goddard Space Flight Center. Our experimental results indicate that the proposed parallel system can efficiently retrieve hyperspectral images from complex image databases by efficiently adapting to the underlying parallel platform on which it is run, regardless of the heterogeneity in the compute nodes and communication links that form such parallel platform. Copyright © 2009 John Wiley & Sons, Ltd.     

Content-based image retrieval by using tree-structured features and multi-layer self-organizing map

A new approach for content-based image retrieval (CBIR) is described. In this study, a tree-structured image representation together with a multi-layer self-organizing map (MLSOM) is proposed for efficient image retrieval. In the proposed tree-structured image representation, a root node contains the global features, while child nodes contain the local region-based features. This approach hierarchically integrates more information of image contents to achieve better retrieval accuracy compared with global and region features individually. MLSOM in the proposed method provides effective compression and organization of tree-structured image data. This enables the retrieval system to operate at a much faster rate than that of directly comparing query images with all images in databases. The proposed method also adopts a relevance feedback scheme to improve the retrieval accuracy by a respectable level. Our obtained results indicate that the proposed image retrieval system is robust against different types of image alterations. Comparative results corroborate that the proposed CBIR system is promising in terms of accuracy, speed and robustness.