基于粒子群的图像检索相关反馈算法

 将粒子群优化算法的进化搜索过程与用户的反馈过程有效结合,提出了一种基于粒子群的图像检索相关反馈算法,避免了初始检索对用户认知的影响以及对反馈效果造成的局限性,并使得用户对检索目标的理解逐渐清晰,能够有效全面的搜索图片库,同时避免多次反馈造成的算法效率和检索效果之间的矛盾.通过实验验证了算法的有效性.     

一种融合图学习与区域显著性分析的图像检索算法

 为弥合图像低层视觉特征和高层语义之间的语义鸿沟,改善图像检索的效果,机器学习算法经常被引入到图像检索问题中.通常情况下,机器学习算法是与相关反馈机制相结合,通过用户的交互操作,标定出若干正反例图像,很自然地就可以将图像检索问题转化为模式识别中的分类问题.目前融合区域显著性分析的区域图像检索算法尚没有与机器学习算法相融合.本文结合图像区域显著性分析,并针对用户参与反馈的情况,分别提出了两种图像检索解决方案.其一,在没有用户反馈以及用户只反馈正例图像的情形下,将图像检索问题转化为直推式学习问题(Transductive Learning),改进已有的基于图的半监督学习算法,提出了融合区域显著性分析的层次化图表示(Hierarchical Graph Representation)方式,用以实现标记传播;其二,在用户同时反馈正反例图像的情形下,利用用户反馈得到的正反例图像构建相似性邻接矩阵,通过流形排序算法(Manifold-Ranking)学习出用户感兴趣的查询目标概念并用相应的特征向量集合表示,并据此查询图像库返回用户语义相关的图像集合.实验结果验证了这两种检索策略的有效性.     

基于主动学习的相关反馈算法研究

相关反馈(reference feedback)是信息检索领域中一种常用技术,近年来,该技术被广泛应用与基于内容的图像检索(CBIR)领域中,旨在通过用户与图像检索系统间的交互过程,克服图像底层特征与高层语义之间的语义鸿沟问题。将主动学习算法结合到相关反馈技术当中,其目的是利用主动学习算法,从无标记图像集中选择最具有信息化的部分图像作为反馈图像,减少用户与系统之间的反馈次数。在COREL图像库和VOC图像库上,对基于主动学习的相关反馈技术进行实验验证,实验结果证明了,基于主动学习的相关反馈技术可以有效提高图像检索系统的性能。     

基于散布矩阵分析的相关反馈算法及应用

相关反馈技术是一种较常用的提高信息检索精度的方法.在图像检索领域,相关反馈技术被认为是解决图像高层语义内容和低层视觉特征之间差异的一种有效方法.视觉特征的权值调整是一类应用较多的相关反馈技术,权值调整方法中存在矩阵奇异问题,本文提出了一种新的基于散布矩阵分析的相关反馈算法,解决了矩阵奇异问题.该方法通过分析与检索目标相关图像在特征空间中的散布来构造目标图像类的投影空间,该空间对应于一个高层语义类在特征空间中分布密集的子空间,在投影空间中计算相似图像;同时根据每次反馈的信息不断修正投影空间来提高系统的检索性能.在Cord图像数据库中的实验结果表明该算法具有良好的检索性能.     

基于潜在语义分析和相关反馈的图像检索方法

为了解决传统的CBIR系统中存在的"语义鸿沟"问题,提出一种基于潜在语义索引技术(LSI)和相关反馈技术的图像检索方法.在进行图像检索时,先在HSV空间下提取颜色直方图作为底层视觉特征进行图像检索,然后引入潜在语义索引技术试图将底层特征赋予更高层次的语义含义;并且结合相关反馈技术,通过与用户交互进一步提高检索精度.实验...     

基于词汇树层次语义模型的图像检索算法

解决语义鸿沟必须建立图像低层特征到高层语义的映射,针对此问题,本文提出了一种基于词汇树层次语义模型的图像检索方法.首先提取图像包含颜色信息的SIFT特征来构造图像库的特征词汇树,生成描述图像视觉信息的视觉词汇.并在此基础上利用Bayesian决策理论实现视觉词汇到语义主题信息的映射,进而构造了一个层次语义模型,并在此模型基础上完成了基于内容的语义图像检索算法.通过检索过程中用户的相关反馈,不仅可以加入正反馈图像扩展图像查询库,同时能够修正高层语义映射.实验结果表明,基于该模型的图像检索算法性能稳定,并且随着反馈次数的增加,检索效果明显提升.     

一种自适应提取最优特征维的相关反馈算法

本文提出一种新的相关反馈算法,该算法依据用户的反馈信息自适应选取用户最感兴趣的特征维用于图像检索,并结合正负反馈图像集的预处理,图像检索精确度得到较大提高。算法在500幅和4500幅两个图像库中做了实验,通过与RuiY特征内相关反馈算法的比较,验证了算法的高效性。     

基于改进布谷鸟搜索算法的相关反馈图像检索

由于视觉低层特征与高层语义间存在"语义鸿沟",基于内容的检索算法难以找到满足用户要求的图像,为了提高图像检索准确率,提出一种基于布谷鸟搜索算法的相关反馈图像检索方法(MCS)。首先分别提取图像的颜色、纹理、形状特征。然后根据用户的反馈信息,采用布谷鸟搜索算法动态调整特征的权值,从而建立满足用户实际偏好的图像相似度模型。最后采用仿真实验测试MCS的有效性。结果表明,相对于遗传算法、粒子群算法以及传统图像检索算法,MCS算法不仅提高了图像检索准确度,同时加快了图像检索效率,更好地满足图像检索要求。     

基于特征的文档子图像检索及其相关反馈

探讨纯文本图像的子图像检索问题.提取其层次结构特征进行匹配,同时为了提高检索精度,又提出了一种适合文档子图像检索的相关反馈算法.实验采用6千幅英文手写体纯文本图像作为样本集,每次迭代返回给用户12幅图像,结果表明每次迭代用时约4秒,6次迭代后召回率基本稳定在83%.     

视频检索中相关反馈算法研究

本文提出了一种基于贝叶斯学习的视频检索相关反馈算法,该算法使用概率框架描述检索问题,根据贝叶斯公式按照用户标记相关和不相关样本集来更新视频库中镜头的目标概率,实现自动相关反馈.通过增量学习,使系统的检索能力不断得到提高.对包含几千个镜头的视频库的实验表明,新算法能够显著提高检索的性能,并在有限的几次反馈后就能快速收敛于用户的查询概念.     

Structural image retrieval using automatic image annotation and region based inverted file

Image retrieval has lagged far behind text retrieval despite more than two decades of intensive research effort. Most of the research on image retrieval in the last two decades are on content based image retrieval or image retrieval based on low level features. Recent research in this area focuses on semantic image retrieval using automatic image annotation. Most semantic image retrieval techniques in literature, however, treat an image as a bag of features/words while ignore the structural or spatial information in the image. In this paper, we propose a structural image retrieval method based on automatic image annotation and region based inverted file. In the proposed system, regions in an image are treated the same way as keywords in a structural text document, semantic concepts are learnt from image data to label image regions as keywords and weight is assigned to each keyword according to spatial position and relationship. As the result, images are indexed and retrieved in the same way as structural document retrieval. Specifically, images are broken down to regions which are represented using colour, texture and shape features. Region features are then quantized to create visual dictionaries which are similar to monolingual dictionaries like English or Chinese dictionaries. In the next step, a semantic dictionary similar to a bilingual dictionary like the English–Chinese dictionary is learnt to mapping image regions to semantic concepts. Finally, images are then indexed and retrieved using a novel region based inverted file data structure. Results show the proposed method has significant advantage over the widely used Bayesian annotation models.     

A novel long-term learning algorithm for relevance feedback in content-based image retrieval

Relevance feedback has proven to be a powerful tool to bridge the semantic gap between low-level features and high-level human concepts in content-based image retrieval (CBIR). However, traditional short-term relevance feedback technologies are confined to using the current feedback record only. Log-based long-term learning captures the semantic relationships among images in a database by analyzing the historical relevance information to boost the retrieval performance effectively. In this paper, we propose an expanded-judging model to analyze the historical log data’s semantic information and to expand the feedback sample set from both positive and negative relevant information. The index table is used to facilitate the log analysis. The expanded-judging model is applied in image retrieval by combining with short-term relevance feedback algorithms. Experiments were carried out to evaluate the proposed algorithm based on the Corel image database. The promising experimental results validate the effectiveness of our proposed expanded-judging model.     

A memory learning framework for effective image retrieval.

Most current content-based image retrieval systems are still incapable of providing users with their desired results. The major difficulty lies in the gap between low-level image features and high-level image semantics. To address the problem, this study reports a framework for effective image retrieval by employing a novel idea of memory learning. It forms a knowledge memory model to store the semantic information by simply accumulating user-provided interactions. A learning strategy is then applied to predict the semantic relationships among images according to the memorized knowledge. Image queries are finally performed based on a seamless combination of low-level features and learned semantics. One important advantage of our framework is its ability to efficiently annotate images and also propagate the keyword annotation from the labeled images to unlabeled images. The presented algorithm has been integrated into a practical image retrieval system. Experiments on a collection of 10,000 general-purpose images demonstrate the effectiveness of the proposed framework.     

Research on image feature extraction and retrieval algorithms based on convolutional neural network

With the rapid development of mobile Internet and digital technology, people are more and more keen to share pictures on social networks, and online pictures have exploded. How to retrieve similar images from large-scale images has always been a hot issue in the field of image retrieval, and the selection of image features largely affects the performance of image retrieval. The Convolutional Neural Networks (CNN), which contains more hidden layers, has more complex network structure and stronger ability of feature learning and expression compared with traditional feature extraction methods. By analyzing the disadvantage that global CNN features cannot effectively describe local details when they act on image retrieval tasks, a strategy of aggregating low-level CNN feature maps to generate local features is proposed. The high-level features of CNN model pay more attention to semantic information, but the low-level features pay more attention to local details. Using the increasingly abstract characteristics of CNN model from low to high. This paper presents a probabilistic semantic retrieval algorithm, proposes a probabilistic semantic hash retrieval method based on CNN, and designs a new end-to-end supervised learning framework, which can simultaneously learn semantic features and hash features to achieve fast image retrieval. Using convolution network, the error rate is reduced to 14.41% in this test set. In three open image libraries, namely Oxford, Holidays and ImageNet, the performance of traditional SIFT-based retrieval algorithms and other CNN-based image retrieval algorithms in tasks are compared and analyzed. The experimental results show that the proposed algorithm is superior to other contrast algorithms in terms of comprehensive retrieval effect and retrieval time.     

基于“点到面”策略的图像检索

图像检索是计算机视觉领域的一个重要分支。其主要目的是从图像数据库中找出与查询图像相似的语义图像。传统的图像检索方法是在查询图像和数据库图像之间进行“点到点”检索。但是,单个查询图像包含的类别提示较少,即类别信息较弱,使得检索结果并不理想。为了解决这个问题,本文提出了一种基于“点到面”的类别检索策略来扩展一个图像（点）到一个图像类别（面）,这意味着从单个查询图像到整个图像类别的语义扩展。该方法挖掘了查询图像的类别信息。在两个常用的数据集上对所提出方法的性能进行了评估。实验表明,该方法可以显著提高图像检索的性能。      

基于投影梯度的NMF相关反馈医学图像检索算法

相关反馈技术是近年来在图像检索中较为重要的研究方法,由于有人的参与,它能在一定程度上弥补图像的底层特征难以表达图像语义内容的不足.由于NMF在一定程度上勾勒出了相关图像在基矩阵所代表的空间中的分布,因而对整个图像库进行检索时可以查找到更多的相关图像.提出了一种基于投影梯度的非负矩阵分解(NMF)相关反馈方法,与常用的基...     

DRM: dynamic region matching for image retrieval using probabilistic fuzzy matching and boosting feature selection

This paper considers the semantic gap in content-based image retrieval from two aspects: (1) irrelevant visual contents (e.g. background) scatter the mapping from image to human perception; (2) unsupervised feature extraction and similarity ranking method can not accurately reveal users’ image perception. This paper proposes a novel region-based retrieval framework—dynamic region matching (DRM) to bridge the semantic gap. (1) To address the first issue, a probabilistic fuzzy region matching algorithm is adopted to retrieve and match images precisely at object level, which copes with the problem of inaccurate segmentation. (2) To address the second issue, a “FeatureBoost” algorithm is proposed to construct an effective “eigen” feature set in relevance feedback (RF) process. And the significance of each region is dynamically updated in RF learning to automatically capture users’ region of interest (ROI). (3) User’s retrieval purpose is predicted using a novel log-learning algorithm, which predicts users’ retrieval target in the feature space using the accumulated user operations. Extensive experiments have been conducted on Corel image database with over 10,000 images. The promising experimental results reveal the effectiveness of our scheme in bridging the semantic gap.