利用二部图匹配进行图像相似性度量

基于内容图像检索是多媒体信息检索领域研究的热点，而现有的算法和系统离成熟的应用还相距甚远，其检索效率和准确性都相当低。提高基于内容图像检索性能的关键在于实现对图像的对象级访问，但是已有的很多的基于区域的图像检索算法和系统都没有考虑多区域的匹配问题，因而不具有一般性、实用性。文中提出一种基于二部图最大权匹配的图像相似性度量算法，该算法建立在图像分割的基础上，由于它能有效地解决多区域图像相似性度量问题，并能有效地避免由于分割不准确带来的影响，因此能极大地提高检索的相关性和准确性。     

Content-based image retrieval by using tree-structured features and multi-layer self-organizing map

A new approach for content-based image retrieval (CBIR) is described. In this study, a tree-structured image representation together with a multi-layer self-organizing map (MLSOM) is proposed for efficient image retrieval. In the proposed tree-structured image representation, a root node contains the global features, while child nodes contain the local region-based features. This approach hierarchically integrates more information of image contents to achieve better retrieval accuracy compared with global and region features individually. MLSOM in the proposed method provides effective compression and organization of tree-structured image data. This enables the retrieval system to operate at a much faster rate than that of directly comparing query images with all images in databases. The proposed method also adopts a relevance feedback scheme to improve the retrieval accuracy by a respectable level. Our obtained results indicate that the proposed image retrieval system is robust against different types of image alterations. Comparative results corroborate that the proposed CBIR system is promising in terms of accuracy, speed and robustness.     

基于主色选择的CBIR检索

基于内容和图像检索（CBIR）是多媒体检索研究的前沿课题，利用颜色特征作为索引进行图像检索是最重要的战术，在提取图像主要颜色特征的基础上，进一步提取了相应的主色空间分布信息-主色矩特征，作为图像库的索引，在改进加权二次型相似性度量方法的基础上，提出了相应的主色多特征相似性度量方法，由于用户对图像中不同的主色具有不同的检索要求，提出了主色调选择的用户模型，用于更精确的图像检索，实现了WWW发布方式的CBIR原型系统，实验结果表明加入主色选择使得图像检索的效果更好。     

基于模糊支持向量机的面向语义图像检索算法*

为了缩减图像低层特征和高层语义之间的“语义鸿沟”,本文提出一种基于模糊支持向量机的面向语义图像检索(SBIR-FSVM)算法。在提取图像的低层特征的基础上,本文将最小隶属度模糊支持向量机引入到图像检索技术中,获取图像语义信息及消除传统支持向量机(SVM)在多类分类中产生的不可分区域,从而实现面向语义的图像检索。实验结果表明,本文提出的SBIR-FSVM算法与基于SVM的图像检索算法及综合多特征的基于内容的图像检索算法相比均有了显著的改进。     

基于改进距离聚合向量的图像检索算法

针对Sajjanhar等提出的基于距离聚合向量的图像检索算法的不足,提出一种改进距离聚合向量的图像检索算法。该算法在距离聚合向量的基础上加入最大连通聚合像素平均坐标的质心距离特征,新增的特征向量具有平移、旋转和尺度不变性。对于原聚合向量特征和新增的质心距离特征,分别采用不同的相似性度量函数进行相似度匹配。该改进算法融入比距离聚合向量更多的空间信息。实验结果表明,该算法具有更高的查全率和准确率。     

A wavelet based multiresolution algorithm for rotation invariant feature extraction

The present work aims at proposing a new wavelet representation formula for rotation invariant feature extraction. The algorithm is a multilevel representation formula involving no wavelet decomposition in standard sense. Using the radial symmetry property, that comes inherently in the new representation formula, we generate the feature vectors that are shown to be rotation invariant. We show that, using a hybrid data mining technique, the algorithm can be used for rotation invariant content based image retrieval (CBIR). The proposed rotation invariant retrieval algorithm, suitable for both texture and nontexture images, avoids missing any relevant images but may retrieve some other images which are not very relevant. We show that the higher precision can however be achieved by pruning out irrelevant images.     

An image retrieval system with automatic query modification

Most interactive "query-by-example" based image retrieval systems utilize relevance feedback from the user for bridging the gap between the user's implied concept and the low-level image representation in the database. However, traditional relevance feedback usage in the context of content-based image retrieval (CBIR) may not be very efficient due to a significant overhead in database search and image download time in client-server environments. In this paper, we propose a CBIR system that efficiently addresses the inherent subjectivity in user perception during a retrieval session by employing a novel idea of intra-query modification and learning. The proposed system generates an object-level view of the query image using a new color segmentation technique. Color, shape and spatial features of individual segments are used for image representation and retrieval. The proposed system automatically generates a set of modifications by manipulating the features of the query segment(s). An initial estimate of user perception is learned from the user feedback provided on the set of modified images. This largely improves the precision in the first database search itself and alleviates the overheads of database search and image download. Precision-to-recall ratio is improved in further iterations through a new relevance feedback technique that utilizes both positive as well as negative examples. Extensive experiments have been conducted to demonstrate the feasibility and advantages of the proposed system.     

Reasoning about pictures and similarity retrieval for image information systems based on SK-set knowledge representation

Spatial reasoning and similarity retrieval are two important functions of any image information system. Good spatial knowledge representation for images is necessary to adequately support these two functions. In this paper, we propose a new spatial knowledge representation, called the SK-set based on morphological skeleton theories. Spatial reasoning algorithms which achieve more accurate results by directly analysing skeletons are described. SK-set facilitates browsing and progressive visualization. We also define four new types of similarity measures and propose a similarity retrieval algorithm for performing image retrieval. Moreover, using SK-set as a spatial knowledge representation will reduce the storage space required by an image database significantly.     

Collaborative image retrieval via regularized metric learning

In content-based image retrieval (CBIR), relevant images are identified based on their similarities to query images. Most CBIR algorithms are hindered by the semantic gap between the low-level image features used for computing image similarity and the high-level semantic concepts conveyed in images. One way to reduce the semantic gap is to utilize the log data of users' feedback that has been collected by CBIR systems in history, which is also called “collaborative image retrieval.” In this paper, we present a novel metric learning approach, named “regularized metric learning,” for collaborative image retrieval, which learns a distance metric by exploring the correlation between low-level image features and the log data of users' relevance judgments. Compared to the previous research, a regularization mechanism is used in our algorithm to effectively prevent overfitting. Meanwhile, we formulate the proposed learning algorithm into a semidefinite programming problem, which can be solved very efficiently by existing software packages and is scalable to the size of log data. An extensive set of experiments has been conducted to show that the new algorithm can substantially improve the retrieval accuracy of a baseline CBIR system using Euclidean distance metric, even with a modest amount of log data. The experiment also indicates that the new algorithm is more effective and more efficient than two alternative algorithms, which exploit log data for image retrieval.     

面向内容检索的彩色图像分割

稳健有效的图像自动分割是面向内容图像检索中的一个重要问题，适应内容检索的需要，提出了一种融合颜色，纹理特征，采用特征聚类的彩色图像分割新算法，该算法采用线性加权方式融合颜色，纹理特征，并依据图像功率谱分布自适应确定融合权值，它采用提出的基于编码代价的自淬火（self annealing)方法对特征空间聚类，该聚类算法具有可自动确定类别数目，对初始聚类中心选择不敏感的优点，将新算法有于分割多幅自然图像，实验结果证明了算法的有效性。     

Content-based image retrieval based on a fuzzy approach

A typical content-based image retrieval (CBIR) system would need to handle the vagueness in the user queries as well as the inherent uncertainty in image representation, similarity measure, and relevance feedback. We discuss how fuzzy set theory can be effectively used for this purpose and describe an image retrieval system called FIRST (fuzzy image retrieval system) which incorporates many of these ideas. FIRST can handle exemplar-based, graphical-sketch-based, as well as linguistic queries involving region labels, attributes, and spatial relations. FIRST uses fuzzy attributed relational graphs (FARGs) to represent images, where each node in the graph represents an image region and each edge represents a relation between two regions. The given query is converted to a FARG, and a low-complexity fuzzy graph matching algorithm is used to compare the query graph with the FARGs in the database. The use of an indexing scheme based on a leader clustering algorithm avoids an exhaustive search of the FARG database. We quantify the retrieval performance of the system in terms of several standard measures.     

遗传反馈的多特征图像检索

基于内容的图像检索是随着数字多媒体技术的发展和普及而新兴的一门信息检索技术。针对当前该领域存在的对图像描述不准确、查询精度低以及反馈次数较多的问题,提出一种基于遗传反馈的图像检索算法。该算法以遗传算法和相关反馈为基础,利用多特征进行检索,避免在利用单一特征进行检索时所出现的不同图像具有相同单一特征（颜色、纹理和形状等）的问题,对图像进行多特征描述可以从多个角度对图像进行定义,大大减少了不同图像却具有相同特征的概率。与现有的算法相比,其具有自动调整图像特征权重、较低反馈次数和较高查询精度的特性。实验结果表明,该算法对于旋转、平移和尺度变化具有较强的鲁棒性,同时具有减少反馈次数和较高查询精度的性能。     

Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine

In recent years, the rapid growth of multimedia content makes content-based image retrieval (CBIR) a challenging research problem. The content-based attributes of the image are associated with the position of objects and regions within the image. The addition of image content-based attributes to image retrieval enhances its performance. In the last few years, the bag-of-visual-words (BoVW) based image representation model gained attention and significantly improved the efficiency and effectiveness of CBIR. In BoVW-based image representation model, an image is represented as an order-less histogram of visual words by ignoring the spatial attributes. In this paper, we present a novel image representation based on the weighted average of triangular histograms (WATH) of visual words. The proposed approach adds the image spatial contents to the inverted index of the BoVW model, reduces overfitting problem on larger sizes of the dictionary and semantic gap issues between high-level image semantic and low-level image features. The qualitative and quantitative analysis conducted on three image benchmarks demonstrates the effectiveness of the proposed approach based on WATH.     

VISTO: A new CBIR system for vector images

In this paper, we present the main features of VISTO (Vector Image Search TOol), a new content-based image retrieval (CBIR) system for vector images. Though unsuitable for photo-realistic imagery, vector graphics are continually becoming more advanced and diffused. Vector images are fully scalable, resolution independent, not restricted to rectangular shape, allowing layering and editable/searchable text. Notwithstanding this increasing interest, the research area concerning CBIR systems for vectorial images is quite new, and our research on a vector based CBIR system actually derives from a precise request of vector based application experts that did not find appropriate solutions to their retrieval problems in customary shape-based CBIR system. To the best of our knowledge, VISTO is the first CBIR system for vector images proposed in the literature, and it supports the retrieval of images in SVG (scalable vector graphics) format.     

Embedding neural networks for semantic association in content based image retrieval

Content based image retrieval (CBIR) systems provide potential solution of retrieving semantically similar images from large image repositories against any query image. The research community are competing for more effective ways of content based image retrieval, so they can be used in serving time critical applications in scientific and industrial domains. In this paper a Neural Network based architecture for content based image retrieval is presented. To enhance the capabilities of proposed work, an efficient feature extraction method is presented which is based on the concept of in-depth texture analysis. For this wavelet packets and Eigen values of Gabor filters are used for image representation purposes. To ensure semantically correct image retrieval, a partial supervised learning scheme is introduced which is based on K-nearest neighbors of a query image, and ensures the retrieval of images in a robust way. To elaborate the effectiveness of the presented work, the proposed method is compared with several existing CBIR systems, and it is proved that the proposed method has performed better then all of the comparative systems.

     

图像的语义关联与图像索引

基于内容图像检索的主要挑战在于不断变化的图像检索要求、难于表达的图像内容以及图像表达的数字阵列与通常可以被人类所接受的概念化内容之间的语义鸿沟.提出了一个基于语义关联的图像检索方法,在语义关联的基础上形成一个场景类别的语义表达,以便用户可以将感知上相似的图像组织在一起,形成概念上下文,使得用户可以解释和标记图像而无需给...     

基于小波多尺度分析的彩色图像检索方法

多媒体技术的普及和Internet技术的实施导致了大量图像信息的出现，基于文本关键词的传统检索方法已不能适应图像信息检索的要求，这使得基于内容的图像检索技术逐渐成为目前的研究热点。基于内容检索技术中必不可少的关键步骤就是图像特征的提取，其中可提取的特征有颜色、纹理和形状等。但是，由于图像的每种特征只能抓住图像相似性的某一个方面，因此如何能更好地表示图像就成为基于内容图像检索中一个重要的研究方向。针对该问题，提出了一种基于图像颜色和纹理特征的图像检索方法，其中颜色特征采用HSV颜色空间的直方图，纹理特征采用图像小波多尺度表示方法中细节信息的方差统计量，这样就充分利用了颜色的丰富表现性和小波变换的多分辨性及其变换系数的统计特性。通过对不同类型图像使用不同特征组合进行图像检索查准率的对比实验结果表明，这种图像检索方法是行之有效的。