基于教与学优化算法的相关反馈图像检索

为提高基于内容的图像检索的检索性能和检索速度,克服低层视觉特征与高层语义概念间的“语义鸿沟”,提出一种基于教与学优化的图像检索相关反馈算法（TLBO-RF）.结合图像检索问题的特殊性和粒子群优化算法的优点,对TLBO算法中个体的更新机制进行了改进,通过将相关图像集的中心作为教师以及引入学员最好学习状态Pbest,使之朝用户感兴趣的相关图像区域快速收敛.将该算法与目前效果最好的两种基于进化算法的相关反馈技术在两套标准图像测试集上进行对比,结果表明本文算法相较于另外两种算法具有明显的优势,不仅提高了图像检索性能,同时也加快了图像检索速度,更好地满足了用户的检索要求.     

基于词汇树层次语义模型的图像检索算法

解决语义鸿沟必须建立图像低层特征到高层语义的映射,针对此问题,本文提出了一种基于词汇树层次语义模型的图像检索方法.首先提取图像包含颜色信息的SIFT特征来构造图像库的特征词汇树,生成描述图像视觉信息的视觉词汇.并在此基础上利用Bayesian决策理论实现视觉词汇到语义主题信息的映射,进而构造了一个层次语义模型,并在此模型基础上完成了基于内容的语义图像检索算法.通过检索过程中用户的相关反馈,不仅可以加入正反馈图像扩展图像查询库,同时能够修正高层语义映射.实验结果表明,基于该模型的图像检索算法性能稳定,并且随着反馈次数的增加,检索效果明显提升.     

基于主动学习的相关反馈算法研究

相关反馈(reference feedback)是信息检索领域中一种常用技术,近年来,该技术被广泛应用与基于内容的图像检索(CBIR)领域中,旨在通过用户与图像检索系统间的交互过程,克服图像底层特征与高层语义之间的语义鸿沟问题。将主动学习算法结合到相关反馈技术当中,其目的是利用主动学习算法,从无标记图像集中选择最具有信息化的部分图像作为反馈图像,减少用户与系统之间的反馈次数。在COREL图像库和VOC图像库上,对基于主动学习的相关反馈技术进行实验验证,实验结果证明了,基于主动学习的相关反馈技术可以有效提高图像检索系统的性能。     

交互式图像检索系统应用前向神经网络

近年来基于内容图像检索中的研究重点是反馈技术，它缩短了图像的底层视觉特征和用户的高层语义概念的不一致，大大提高了系统的检索精度。本文站在机器学习的立场，讨论了在前向神经网络中的三种经典网络学习算法：BP、FP、RBFN，并分析了反馈技术在网络中的应用特点。并且展望了相关技术的发展前景和研究方向     

基于本体和奇异值分解的图像数据索引查询算法

提出一种基于领域本体潜在语义索引和奇异值分解的图像数据查询算法,将查询扩展向量映射到潜在语义空间,根据相似度计算方法计算查询向量与图像文档之间的相似度,并将相似度大于阀值的文档作为检索结果降序排列返回给用户.该算法能更有效地提高图像检索的查准率和查全率.     

基于融合特征的现勘图像检索结果优化算法

刑侦现勘图像数据库是具有保密性高、图像内容罕见等极具行业特色的图像数据库.针对现勘图像内容复杂、目标物体不明确的特点,提出了DCT-DCT波纹理特征,并与HSV颜色直方图特征、GIST特征相融合构成融合特征.与常用的图像特征相比,DCT-DCT波纹理特征能够得到较高的检索效率,而融合特征的平均检索查准率高于构成其本身的三种特征的平均检索查准率.最后,将语义分析技术引入到检索过程中,提出基于检索结果优化的现勘图像检索算法,利用支持向量机（Support Vector Machine,SVM）分类器对查询图像进行语义提取,并对初次检索的结果进行语义分析,根据初检结果中语义类别的占比选择二次检索方案,该算法能在按例查询的基础上进一步提高平均检索查准率.     

基于人工神经网络的图像检索平台的设计与开发

用户描述图像的高层抽象语义与图像内在的底层特征之间存在差异,此时仅依靠图像内容特征进行检索的系统无法准确完成用户的检索任务。针对以上问题,提出了使用神经网络进行图像的匹配计算方法,通过样例自动学习和用户反馈学习两种学习方式,形成图像底层特征到图像分类的正确映射,学习后的神经网络可以进行图像的自动分类及检索。该方法结合了图像的底层特征描述及用户的高层语义反馈,有效地弥补了语义鸿沟。最后,系统通过整合Web前端、图像提取模块、神经网络模块及数据库模块,实现了神经网络学习及图像检索的完整流程。     

基于SVM和背景模型的显著性目标检测算法

针对显著性目标多样性和不确定性,机器学习算法无法检测没有先验信息的图像问题,提出了一种基于图像边缘信息构建背景模型结合SVM分类算法的显著性目标检测算法.该方法对输入图像进行超像素预处理,使像素级转化为超像素级,既抑制噪声,又提高了计算效率.利用图像边缘超像素构建图像的初始背景模型,得到初始显著图.基于SVM算法建立目...     

基于潜在语义分析和相关反馈的图像检索方法

为了解决传统的CBIR系统中存在的"语义鸿沟"问题,提出一种基于潜在语义索引技术(LSI)和相关反馈技术的图像检索方法.在进行图像检索时,先在HSV空间下提取颜色直方图作为底层视觉特征进行图像检索,然后引入潜在语义索引技术试图将底层特征赋予更高层次的语义含义;并且结合相关反馈技术,通过与用户交互进一步提高检索精度.实验...     

基于改进布谷鸟搜索算法的相关反馈图像检索

由于视觉低层特征与高层语义间存在"语义鸿沟",基于内容的检索算法难以找到满足用户要求的图像,为了提高图像检索准确率,提出一种基于布谷鸟搜索算法的相关反馈图像检索方法(MCS)。首先分别提取图像的颜色、纹理、形状特征。然后根据用户的反馈信息,采用布谷鸟搜索算法动态调整特征的权值,从而建立满足用户实际偏好的图像相似度模型。最后采用仿真实验测试MCS的有效性。结果表明,相对于遗传算法、粒子群算法以及传统图像检索算法,MCS算法不仅提高了图像检索准确度,同时加快了图像检索效率,更好地满足图像检索要求。     

利用遗传编程排序图像

Web image retrieval is a challenging task. One central problem of web image retrieval is to rank a set of images according to how well they meet the user information need. The problem of learning to rank has inspired numerous approaches to resolve it in the text information retrieval, related work for web image retrieval, however, are still limited. We focus on the problem of learning to rank images for web image retrieval, and propose a novel ranking model, which employs a genetic programming architecture to automatically generate an effective ranking function, by combining various types of evidences in web image retrieval, including text information, image visual content features, link structure analysis and temporal information. The experimental results show that the proposed algorithms are capable of learning effective ranking functions for web image retrieval. Significant improvement in relevancy obtained, in comparison to some other well-known ranking techniques, in terms of MAP, NDCG@n and D@n.     

Semi-Automatically Labeling Objects in Images

Labeling objects in images plays a crucial role in many visual learning and recognition applications that need training data, such as image retrieval, object detection and recognition. Manually creating object labels in images is time consuming and, thus, becomes impossible for labeling a large image dataset. In this paper, we present a family of semi-automatic methods based on a graph-based semi-supervised learning algorithm for labeling objects in images. We first present SmartLabel that proposes to label images with reduced human input by iteratively computing the harmonic solutions to minimize a quadratic energy function on the Gaussian fields. SmartLabel tackles the problem of lacking negative data in the learning by embedding relevance feedback after the first iteration, which also leads to one limitation of SmartLabel—needing additional human supervision. To overcome the limitation and enhance SmartLabel, we propose SmartLabel-2 that utilizes a novel scheme to sample negative examples automatically, replace regular patch partitioning in SmartLabel by quadtree partitioning and applies image over-segmentation (superpixels) to extract smooth object contours. Evaluation on six diverse object categories have indicated that SmartLabel-2 can achieve promising results with a small amount of labeled data (e.g., 1%–5% of image size) and obtain close-to-fine extraction of object contours on different kinds of objects.      

A Dynamic User Concept Pattern Learning Framework for Content-Based Image Retrieval

A rapid increase in the amount of image data and the inefficiency of traditional text-based image retrieval systems have served to make content-based image retrieval an active research field. It is crucial to effectively discover users' concept patterns through an acquired understanding of the subjective role played by humans in the retrieval process for such systems. A learning and retrieval framework is used to achieve this. It seamlessly incorporates multiple instance learning for relevant feedback to discover users concept patterns-especially in the region of greatest user interest. It also maps the local feature vector of that region to the high-level concept pattern. This underlying mapping can be progressively discovered through feedback and learning. The user guides the retrieval systems learning process using his/her focus of attention. Retrieval performance is tested to establish the feasibility and effectiveness of the proposed learning and retrieval framework     

流形学习和相关反馈相融合的医学图像检索

图像检索是医学图像辅助诊断的基础,为了提高医学图像检索的正确率,提出一种流形学习和相关反馈相融合的医学图像检索算法(LLE-MF)。首先根据方块编码的思想提取颜色分量的信息熵,并利用邻域灰度共生矩阵提取纹理特征;然后采用非线性流形学习对颜色和纹理特征进行组合、降维处理,并采用欧式距离相似度量模型对图像初步进行检索,最后最小二乘支持向量机对初步检索结果进行相关反馈,并进行仿真测试。结果表明,相对于其它医学检索算法,LLE-MF不仅提高了医学图像的检索准确率,同时提高了医学图像的检索效率,可以准确地找到用户所需的图像.     

Statistical modeling and many-to-many matching for view-based 3D object retrieval

We address the task of view-based 3D object retrieval, in which each object is represented by a set of views taken from different positions, rather than a geometrical model based on polygonal meshes. As the number of views and the view point setting cannot always be the same for different objects, the retrieval task is more challenging and the existing methods for 3D model retrieval are infeasible. In this paper, the information in the sets of views is exploited from two aspects. On the one hand, the form of histogram is converted from vector to state sequence, and Markov chain (MC) is utilized for modeling the statistical characteristics of all the views representing the same object. On the other hand, the earth mover's distance (EMD) is involved to achieve many-to-many matching between two sets of views. For 3D object retrieval, by combining the above two aspects together, a new distance measure is defined, and a novel approach to automatically determine the edge weights in graph-based semi-supervised learning is proposed. Experimental results on different databases demonstrate the effectiveness of our proposal.     

Similarity-based online feature selection in content-based image retrieval.

Content-based image retrieval (CBIR) has been more and more important in the last decade, and the gap between high-level semantic concepts and low-level visual features hinders further performance improvement. The problem of online feature selection is critical to really bridge this gap. In this paper, we investigate online feature selection in the relevance feedback learning process to improve the retrieval performance of the region-based image retrieval system. Our contributions are mainly in three areas. 1) A novel feature selection criterion is proposed, which is based on the psychological similarity between the positive and negative training sets. 2) An effective online feature selection algorithm is implemented in a boosting manner to select the most representative features for the current query concept and combine classifiers constructed over the selected features to retrieve images. 3) To apply the proposed feature selection method in region-based image retrieval systems, we propose a novel region-based representation to describe images in a uniform feature space with real-valued fuzzy features. Our system is suitable for online relevance feedback learning in CBIR by meeting the three requirements: learning with small size training set, the intrinsic asymmetry property of training samples, and the fast response requirement. Extensive experiments, including comparisons with many state-of-the-arts, show the effectiveness of our algorithm in improving the retrieval performance and saving the processing time.     

A novel long-term learning algorithm for relevance feedback in content-based image retrieval

Relevance feedback has proven to be a powerful tool to bridge the semantic gap between low-level features and high-level human concepts in content-based image retrieval (CBIR). However, traditional short-term relevance feedback technologies are confined to using the current feedback record only. Log-based long-term learning captures the semantic relationships among images in a database by analyzing the historical relevance information to boost the retrieval performance effectively. In this paper, we propose an expanded-judging model to analyze the historical log data’s semantic information and to expand the feedback sample set from both positive and negative relevant information. The index table is used to facilitate the log analysis. The expanded-judging model is applied in image retrieval by combining with short-term relevance feedback algorithms. Experiments were carried out to evaluate the proposed algorithm based on the Corel image database. The promising experimental results validate the effectiveness of our proposed expanded-judging model.     

现勘图像检索综述

现勘图像检索是进行证据图像比对以获取物证信息的重要手段.本文基于目前应用广泛的现勘图像数据库,根据图像内容将图像分为鞋印、指纹、纹身等种类.并通过对现勘图像的两项关键技术即低层数字特征提取和高层语义分析的总结,从颜色特征、纹理特征、边缘提取等方面综述了现勘图像低层数字特征提取技术,从利用语义模板和数据库本体结构、机器学习算法、引入人工反馈三大类高层语义提取技术综述了现勘图像高层语义分析的研究成果.最后,结合公安行业利用现勘图像获取物证线索的实际应用需求,指出了通过引入公安行业先验知识来提高检索效率等研究方向.     

基于显著点特征多示例学习的图像检索方法

提出了一种基于图像显著点特征进行多示例学习(Multiple-instance learning)的图像检索方法.该方法对图像进行小波分解并跟踪不同尺度小波系数提取图像显著点;然后利用显著点特征进行检索,并在相关反馈中将图像看作多示例包,通过期望最大多样性密度(EM-DD,expectation maximization diverse density)方法进行多示例学习,获得体现图像语义的日标特征.在Corel和SIVAL两个图像库进行实验,结果表明该方法明显提高了检索的准确性.