基于语义的信息检索中的反馈技术

首先分析了两种基于语义的信息检索系统的基本框架。由于相关反馈计算在基于内容的图像检索中受到广泛重视，因此对相关反馈中的加权距离进行了讨论和总结。这种相关反馈技术使得高层次语义特征能够逐步嵌入到低层次特征的图像检索中，使检索的准确率大大提高。     

综合语义与颜色特征的图像检索技术研究

针对多媒体搜索引擎系统中的图像检索技术，本文提出了应用图像的高层语义特征和底层颜色特征作为图像检索的综合指标，将图像文本和视觉信息融合起来，给出了一种综合语义和颜色特征的图像检索系统的体系架构．以填补多媒体底层特征和高层语义之间的差异，并在此基础上提出了相关算法，使图像检索能够满足用户的需求．提高图像检索的效率和精度。     

基于词汇树层次语义模型的图像检索算法

解决语义鸿沟必须建立图像低层特征到高层语义的映射,针对此问题,本文提出了一种基于词汇树层次语义模型的图像检索方法.首先提取图像包含颜色信息的SIFT特征来构造图像库的特征词汇树,生成描述图像视觉信息的视觉词汇.并在此基础上利用Bayesian决策理论实现视觉词汇到语义主题信息的映射,进而构造了一个层次语义模型,并在此模型基础上完成了基于内容的语义图像检索算法.通过检索过程中用户的相关反馈,不仅可以加入正反馈图像扩展图像查询库,同时能够修正高层语义映射.实验结果表明,基于该模型的图像检索算法性能稳定,并且随着反馈次数的增加,检索效果明显提升.     

基于视觉感知的图像检索的研究

基于内容图像检索的一个突出问题是图像低层特征与高层语义之间存在的巨大鸿沟.针对相关反馈和感兴趣区检测在弥补语义鸿沟时存在主观性强、耗时的缺点,提出了视觉信息是一种客观反映图像高层语义的新特征,基于视觉信息进行图像检索可以有效减小语义鸿沟;并在总结视觉感知的研究进展和实现方法的基础上,给出了基于视觉感知的图像检索在感兴趣区检测、图像分割、相关反馈和个性化检索四个方面的研究思路.     

基于投影梯度的NMF相关反馈医学图像检索算法

相关反馈技术是近年来在图像检索中较为重要的研究方法,由于有人的参与,它能在一定程度上弥补图像的底层特征难以表达图像语义内容的不足.由于NMF在一定程度上勾勒出了相关图像在基矩阵所代表的空间中的分布,因而对整个图像库进行检索时可以查找到更多的相关图像.提出了一种基于投影梯度的非负矩阵分解(NMF)相关反馈方法,与常用的基...     

基于目标语义特征的图像检索系统

为克服当前基于内容的图像检索技术中低级特征无法准确全面地描述高级语义的问题,该文设计和实现了一个基于目标高级语义特征的检索系统。该系统利用了一个多级图像描述模型将语义特征结合到图像检索技术中。该图像描述模型通过在不同层次上对图像内容进行分析和描述,实现了从低级特征到高级语义的过渡。在此模型的基础上还研究了相应的检索机制和反馈技术。该系统的检索机制定位于图像中目标的语义内容,与传统的图像检索系统相比更接近人对图像内容的理解,从而使检索过程更简便,检索效率也得到很大提高。基于目标描述的自适应相关反馈可针对不同用户的不同需求给出相应的检索方案,从而使检索结果得到优化。     

基于人工神经网络的图像检索平台的设计与开发

用户描述图像的高层抽象语义与图像内在的底层特征之间存在差异,此时仅依靠图像内容特征进行检索的系统无法准确完成用户的检索任务。针对以上问题,提出了使用神经网络进行图像的匹配计算方法,通过样例自动学习和用户反馈学习两种学习方式,形成图像底层特征到图像分类的正确映射,学习后的神经网络可以进行图像的自动分类及检索。该方法结合了图像的底层特征描述及用户的高层语义反馈,有效地弥补了语义鸿沟。最后,系统通过整合Web前端、图像提取模块、神经网络模块及数据库模块,实现了神经网络学习及图像检索的完整流程。     

基于主动学习的相关反馈算法研究

相关反馈(reference feedback)是信息检索领域中一种常用技术,近年来,该技术被广泛应用与基于内容的图像检索(CBIR)领域中,旨在通过用户与图像检索系统间的交互过程,克服图像底层特征与高层语义之间的语义鸿沟问题。将主动学习算法结合到相关反馈技术当中,其目的是利用主动学习算法,从无标记图像集中选择最具有信息化的部分图像作为反馈图像,减少用户与系统之间的反馈次数。在COREL图像库和VOC图像库上,对基于主动学习的相关反馈技术进行实验验证,实验结果证明了,基于主动学习的相关反馈技术可以有效提高图像检索系统的性能。     

基于散布矩阵分析的相关反馈算法及应用

相关反馈技术是一种较常用的提高信息检索精度的方法.在图像检索领域,相关反馈技术被认为是解决图像高层语义内容和低层视觉特征之间差异的一种有效方法.视觉特征的权值调整是一类应用较多的相关反馈技术,权值调整方法中存在矩阵奇异问题,本文提出了一种新的基于散布矩阵分析的相关反馈算法,解决了矩阵奇异问题.该方法通过分析与检索目标相关图像在特征空间中的散布来构造目标图像类的投影空间,该空间对应于一个高层语义类在特征空间中分布密集的子空间,在投影空间中计算相似图像;同时根据每次反馈的信息不断修正投影空间来提高系统的检索性能.在Cord图像数据库中的实验结果表明该算法具有良好的检索性能.     

图像语义自描述性的实现方法研究

根据语义特征进行检索是多媒体检索技术的发展趋势.图像是最重要的媒体之一,本文提出了一种实现图像语义自描述性的方法.通过在JPEG文件中嵌入描述图像语义的XML文件,使计算机可以对图像进行语义级的检索.实验表明,该方法创建的语义描述可以从图像文件中读取,具有标准化、结构性和可读性的特点,尤其适用于在Internet上检索图像.该方法对于提高图像信息的利用率具有重要的意义.     

Semantic content-based image retrieval: A comprehensive study

The complexity of multimedia contents is significantly increasing in the current digital world. This yields an exigent demand for developing highly effective retrieval systems to satisfy human needs. Recently, extensive research efforts have been presented and conducted in the field of content-based image retrieval (CBIR). The majority of these efforts have been concentrated on reducing the semantic gap that exists between low-level image features represented by digital machines and the profusion of high-level human perception used to perceive images. Based on the growing research in the recent years, this paper provides a comprehensive review on the state-of-the-art in the field of CBIR. Additionally, this study presents a detailed overview of the CBIR framework and improvements achieved; including image preprocessing, feature extraction and indexing, system learning, benchmarking datasets, similarity matching, relevance feedback, performance evaluation, and visualization. Finally, promising research trends, challenges, and our insights are provided to inspire further research efforts.     

Exploring Semantic Association Rules Between Keyword and Visual Feature Clusters for Web Image Retrieval

The semantic gap is a big challenge in image retrieval area. Previous studies in web image retrieval have mainly focused on Relevance feedback （RF） and Latent semantic indexing （LSI） to alleviate the gap. This paper proposes an approach base on Frequent itemset mining （FIM） and Association rule （AR） techniques, which explores the semantic association rule between the two modalities that are represented by keyword and visual feature clusters. The rules are obtained oftline based on the inverted file, and utilized in query process online to realize the integration of the two modalities of web im- ages. Our approach improves the retrieval performance and is scalable well, as well as satisfies the requirement of the web users with no additional interactions. The exper- iments are carried out in our web image retrieval system named VAST （VisuAl ＆ SemanTic image search）, and the results show the effectiveness of the proposed approach.     

A novel long-term learning algorithm for relevance feedback in content-based image retrieval

Relevance feedback has proven to be a powerful tool to bridge the semantic gap between low-level features and high-level human concepts in content-based image retrieval (CBIR). However, traditional short-term relevance feedback technologies are confined to using the current feedback record only. Log-based long-term learning captures the semantic relationships among images in a database by analyzing the historical relevance information to boost the retrieval performance effectively. In this paper, we propose an expanded-judging model to analyze the historical log data’s semantic information and to expand the feedback sample set from both positive and negative relevant information. The index table is used to facilitate the log analysis. The expanded-judging model is applied in image retrieval by combining with short-term relevance feedback algorithms. Experiments were carried out to evaluate the proposed algorithm based on the Corel image database. The promising experimental results validate the effectiveness of our proposed expanded-judging model.     

一种自适应提取最优特征维的相关反馈算法

本文提出一种新的相关反馈算法,该算法依据用户的反馈信息自适应选取用户最感兴趣的特征维用于图像检索,并结合正负反馈图像集的预处理,图像检索精确度得到较大提高。算法在500幅和4500幅两个图像库中做了实验,通过与RuiY特征内相关反馈算法的比较,验证了算法的高效性。     

Similarity-based online feature selection in content-based image retrieval.

Content-based image retrieval (CBIR) has been more and more important in the last decade, and the gap between high-level semantic concepts and low-level visual features hinders further performance improvement. The problem of online feature selection is critical to really bridge this gap. In this paper, we investigate online feature selection in the relevance feedback learning process to improve the retrieval performance of the region-based image retrieval system. Our contributions are mainly in three areas. 1) A novel feature selection criterion is proposed, which is based on the psychological similarity between the positive and negative training sets. 2) An effective online feature selection algorithm is implemented in a boosting manner to select the most representative features for the current query concept and combine classifiers constructed over the selected features to retrieve images. 3) To apply the proposed feature selection method in region-based image retrieval systems, we propose a novel region-based representation to describe images in a uniform feature space with real-valued fuzzy features. Our system is suitable for online relevance feedback learning in CBIR by meeting the three requirements: learning with small size training set, the intrinsic asymmetry property of training samples, and the fast response requirement. Extensive experiments, including comparisons with many state-of-the-arts, show the effectiveness of our algorithm in improving the retrieval performance and saving the processing time.     

System profiles in content-based image indexing and retrieval

In this paper, a novel study on system profiles and adaptation of parameters for end-users of content-based indexing and retrieval (CBIR) applications are presented. The main objective of the study is improving the overall CBIR application performance in different hardware platforms having different technical capabilities and conditions. We define CBIR system profiles in terms of hardware and system platform attributes and propose CBIR parameters for each profile. Hence, the study consists of two main parts: system profiling and adaptation of indexing and retrieval parameters for each profile. The proposed CBIR parameters are appropriate configurations for optimal CBIR use on every platform. The proposed parameters for each system profile are assessed over a large set of experiments. Experimental studies show that the proposed parameters for each system profile have satisfactory semantic retrieval performance, with reduced computational complexity and storage space requirement. 45 to 78% improvement is achieved in the computational complexity of the retrieval process depending on the profile.     

Hybrid textual-visual relevance learning for content-based image retrieval

Learning effective relevance measures plays a crucial role in improving the performance of content-based image retrieval (CBIR) systems. Despite extensive research efforts for decades, how to discover and incorporate semantic information of images still poses a formidable challenge to real-world CBIR systems. In this paper, we propose a novel hybrid textual-visual relevance learning method, which mines textual relevance from image tags and combines textual relevance and visual relevance for CBIR. To alleviate the sparsity and unreliability of tags, we first perform tag completion to fill the missing tags as well as correct noisy tags of images. Then, we capture users’ semantic cognition to images by representing each image as a probability distribution over the permutations of tags. Finally, instead of early fusion, a ranking aggregation strategy is adopted to sew up textual relevance and visual relevance seamlessly. Extensive experiments on two benchmark datasets well verified the promise of our approach.     

Pictures are not taken in a vacuum - an overview of exploiting context for semantic scene content understanding

Considerable research has been devoted to the problem of multimedia indexing and retrieval in the past decade. However, limited by state-of-the-art in image understanding, the majority of the existing content-based image retrieval (CBIR) systems have taken a relatively low-level approach and fallen short of higher-level interpretation and knowledge. Recent research has begun to focus on bridging the semantic and conceptual gap that exists between man and computer by integrating knowledge-based techniques, human perception, scene content understanding, psychology, and linguistics. In this article, we provide an overview of exploiting context for semantic scene content and understanding     

A new SVM-based relevance feedback image retrieval using probabilistic feature and weighted kernel function

Relevance feedback (RF) is an effective approach to bridge the gap between low-level visual features and high-level semantic meanings in content-based image retrieval (CBIR). The support vector machine (SVM) based RF mechanisms have been used in different fields of image retrieval, but they often treat all positive and negative feedback samples equally, which will inevitably degrade the effectiveness of SVM-based RF approaches for CBIR. In fact, positive and negative feedback samples, different positive feedback samples, and different negative feedback samples all always have distinct properties. Moreover, each feedback interaction process is usually tedious and time-consuming because of complex visual features, so if too many times of iteration of feedback are asked, users may be impatient to interact with the CBIR system. To overcome the above limitations, we propose a new SVM-based RF approach using probabilistic feature and weighted kernel function in this paper. Firstly, the probabilistic features of each image are extracted by using principal components analysis (PCA) and the adapted Gaussian mixture models (AGMM) based dimension reduction, and the similarity is computed by employing Kullback–Leibler divergence. Secondly, the positive feedback samples and negative feedback samples are marked, and all feedback samples’ weight values are computed by utilizing the samples-based Relief feature weighting. Finally, the SVM kernel function is modified dynamically according to the feedback samples’ weight values. Extensive simulations on large databases show that the proposed algorithm is significantly more effective than the state-of-the-art approaches.