Image indexing and retrieval based on vector quantization

To effectively utilize information stored in a digital image library, effective image indexing and retrieval techniques are essential. This paper proposes an image indexing and retrieval technique based on the compressed image data using vector quantization (VQ). By harnessing the characteristics of VQ, the proposed technique is able to capture the spatial relationships of pixels when indexing the image. Experimental results illustrate the robustness of the proposed technique and also show that its retrieval performance is higher compared with existing color-based techniques.     

Image and video indexing using vector quantization

Visual (image and video) database systems require efficient indexing to enable fast access to the images in a database. In addition, the large memory capacity and channel bandwidth requirements for the storage and transmission of visual data necessitate the use of compression techniques. We note that image/video indexing and compression are typically pursued independently. This reduces the storage efficiency and may degrade the system performance. In this paper, we present novel algorithms based on vector quantization (VQ) for indexing of compressed images and video. To start with, the images are compressed using VQ. In the first technique, for each codeword in the codebook, a histogram is generated and stored along with the codeword. We note that the superposition of the histograms of the codewords, which are used to represent an image, is a close approximation of the histogram of the image. This histogram is used as an index to store and retrieve the image. In the second technique, the histogram of the labels of an image is used as an index to access the image. We also propose an algorithm for indexing compressed video sequences. Here, each frame is encoded in the intraframe mode using VQ. The labels are used for the segmentation of a video sequence into shots, and for indexing the representative frame of each shot. The proposed techniques not only provide fast access to stored visual data, but also combine compression and indexing. The average retrieval rates are 95% and 94% at compression ratios of 16:1 and 64:1, respectively. The corresponding cut detection rates are 97% and 90%, respectively.     

Web-based image indexing and retrieval in JPEG compressed domain

As the majority of content-based image retrieval systems operate on full images in pixel domain, decompression is a prerequisite for the retrieval of compressed images. To provide a possible on-line indexing and retrieval technique for those jpg image files, we propose a novel pseudo-pixel extraction algorithm to bridge the gap between the existing image indexing technology, developed in the pixel domain, and the fact that an increasing number of images stored on the Web are already compressed by JPEG at the source. Further, we describe our Web-based image retrieval system, WEBimager, by using the proposed algorithm to provide a prototype visual information system toward automatic management, indexing, and retrieval of compressed images available on the Internet. This provides users with efficient tools to search the Web for compressed images and establish a database or a collection of special images to their interests. Experiments using texture- and colour-based indexing techniques support the idea that the proposed algorithm achieves significantly better results in terms of computing cost than their full decompression or partial decompression counterparts. This technology will help control the explosion of media-rich content by offering users a powerful automated image indexing and retrieval tool for compressed images on the Web.J. Jiang: Contacting author     

Data hiding based on compressed VQ indices of images

The VQ-based data hiding technique has not received much attention compared to various spatial domain-based data hiding techniques in digital images. Consequently, a new data hiding scheme, applied in the VQ-compressed domain of cover images, is introduced in this article. To provide more hiding capacity for secret data and to keep an acceptable bit rate for the compressed cover images, the search-order-coding (SOC) algorithm was implemented to compress the VQ indices of the cover images in the process of data hiding. During the process of data hiding, the proposed scheme embeds secret data into the compressed VQ indices of the cover image adaptively, adjusting the bit rate according to the size of the secret data and the compressed cover image. In addition, the hiding process induces no extra coding distortion. Experiments show that the receiver can efficiently receive both the secret data and the compressed cover image simultaneously with an acceptable bit rate. Simulation results also demonstrate that our proposed scheme outperforms earlier proposed methods.     

基于压缩域的图像检索技术

图像检索技术是多媒体应用中的关键技术，现有的基于内容图像检索技术大都是基于非压缩域的，对于目前普遍存在的压缩格式图像，采用这种技术必须先解压再检索，不但计算量大，而且需占用较多的中介存储空间，所以严重影响了检索系统的实时性和灵活性，同时各种压缩标准(如JPEG，MPEG，JPEG2000等)的推出与普及也促使人们寻求可以直接在压缩域操作的检索技术，该文对现有的压缩域图像检索技术的发展进行综述，并讨论了未来可能的研究方向。     

基于JPEG的图像检索综述

基于内容的检索是近年来的研究热点之一，现在已有许多基于象素域的图像检索技术，目前数据压缩也已成为多媒体应用的标准模式，静态图像压缩主要采用JPEG技术，研究基于传统JPEG和JPEG2000的图像检索方法成为必然。本文综述近年来出现的基于JPEG核心算法离散余弦变换和JPEG2000核心算法离散小波变换的图像检索技术。     

Image retrieval based on histogram of fractal parameters

Image indexing and retrieval techniques are important for efficient management of visual databases. These techniques are generally developed based on the associated compression techniques. In the fractal domain, luminance offset and contrast scaling parameter are typically used as the fractal indices. However, luminance offset and contrast scaling parameter are strongly correlated. In this paper, we prove that range block mean and contrast scaling parameters are independent. Based on this independence, we propose four statistical indices for efficient image retrieval. In addition, we propose an efficient hierarchical indexing strategy based on the de and ac component analysis. Experimental results on a database of 416 texture images, created by decomposing 26 images, indicate that the proposed indices significantly improve the retrieval rate, compared to other retrieval methods.     

基于迭代分形的图象压缩和检索方法

图象所具有的海量性和无序性的特点，决定了多媒体应用的构建必须解决图象数据的高效压缩和有效检索两个关键问题，而由于传统的压缩和检索技术的研究是相互分离的，因而限制了多媒体应用系统整体性能的提高，针对此问题，从两者相互结合的观点，对图象压缩和检索方法进行了研究，首先在小波变换域内，基于迭代分形对图象数据进行压缩，然后在图象分形码的基础上，利用迭代函数系统分布特性构建的特征量来支持图象检索，实验结果验证了该方法的可行性和有效性，同时也表明了基于迭代分形的图象检索方法所具有的巨大应用潜力。     

基于纹理和高斯密度特征的图像检索算法

直接从DCT域中提取图像的特征是提高图像的检索效率的方法.直接从压缩域中提取图像的高斯密度,即计算图像在8个方向上的分段累加值,形成一个8*4的二维向量,再结合图像的纹理特征来进行图像检索.为了验证算法的可行性,建立了10000幅图像的图像库.实验结果表明,该方法能够准确地检索出目标图像,有效地提高了图像检索的精度和速度.     

Image retrieval based on shape similarity by edge orientation autocorrelogram

This paper introduces a new feature vector for shape-based image indexing and retrieval. This feature classifies image edges based on two factors: their orientations and correlation between neighboring edges. Hence it includes information of continuous edges and lines of images and describes major shape properties of images. This scheme is effective and robustly tolerates translation, scaling, color, illumination, and viewing position variations. Experimental results show superiority of proposed scheme over several other indexing methods. Averages of precision and recall rates of this new indexing scheme for retrieval as compared with traditional color histogram are 1.99 and 1.59 times, respectively. These ratios are 1.26 and 1.04 compared to edge direction histogram.     

基于压缩域的图象检索技术研究进展

压缩标准的出现 ,使得图象数据格式普遍为压缩格式 ,从而促进了压缩域内图象检索技术的迅速发展 .为了使人们对基于压缩域的图象检索技术有一概括了解 ,该文对目前的压缩域检索技术进行了回顾和讨论 :首先 ,介绍了图象检索系统的基本概念 ;然后 ,分类分析了不同压缩域的检索技术 ,包括变换域方法 (如傅立叶变换、离散余弦变换 (DCT)以及子带和小波变换 )和空域方法 (如矢量量化和分形等 ) ;接着 ,对这些检索方法进行了讨论和比较 ,并得出一些有用的结论 ;还举例介绍了基于压缩域图象检索技术的实际应用 ;最后对压缩域图象检索技术的研究发展及其应用前景指出了一些可能的方向 .     

Compressed domain content based retrieval using H.264 DC-pictures

A fast and simple method for content based retrieval using the DC-pictures of H.264 coded video without full decompression is presented. Compressed domain retrieval is very desirable for content analysis and retrieval of compressed image and video. Even though, DC-pictures are among the most widely used compressed domain indexing and retrieval methods in pre H.264 coded videos, they are not generally used in the H.264 coded video. This is due to two main facts, first, the I-frame in the H.264 standard are spatially predicatively coded and second, the H.264 standard employs Integer Discrete Cosine Transform. In this paper we have applied color histogram indexing method on the DC-pictures derived from H.264 coded I-frames. Since the method is based on independent I-frame coded pictures, it can be used either for video analysis of H.264 coded videos, or image retrieval of the I-frame based coded images such as advanced image coding. The retrieval performance of the proposed algorithm is compared with that the fully decoded images. Simulation results indicate that the performance of the proposed method is very close to the fully decompressed image systems. Moreover the proposed method has much lower computational load.     

Image database indexing using JPEG coefficients

Image database indexing is used for efficient retrieval of images in response to a query expressed as an example image. The query image is processed to extract information that is matched against the index to provide pointers to similar images. We present a technique that facilitates content similarity-based retrieval of jpeg-compressed images without first having to uncompress them. The technique is based on an index developed from a subset of jpeg coefficients and a similarity measure to determine the difference between the query image and the images in the database. This method offers substantial efficiency as images are processed in compressed format, information that was derived during the original compression of the images is reused, and extensive early pruning is possible. Initial experiments with the index have provided encouraging results. The system outputs a set of ranked images in the database with respect to the query using the similarity measure, and can be limited to output a specified number of matched images by changing the threshold match.     

Error Concealment Using Adaptive Multilayer Perceptrons (MLPs) for Block-Based Image Coding

Image coding algorithms such as Vector Quantisation (VQ), JPEG and MPEG have been widely used for encoding image and video. These compression systems utilise block-based coding techniques to achieve a higher compression ratio. However, a cell loss or a random bit error during network transmission will permeate into the whole block, and then generate several damaged blocks. Therefore, an efficient Error Concealment (EC) scheme is essential for diminishing the impact of damaged blocks in a compressed image. In this paper, a novel adaptive EC algorithm is proposed to conceal the error for block-based image coding systems by using neural network techniques in the spatial domain. In the proposed algorithm, only the intra-frame information is used for reconstructing the image with damaged blocks. The information of pixels surrounding a damaged block is used to recover the errors using the neural network models. Computer simulation results show that the visual quality and the PSNR evaluation of a reconstructed image are significantly improved using the proposed EC algorithm.     

An invisible hybrid color image system using spread vector quantization neural networks with penalized FCM

In this paper, an invisible hybrid color image hiding scheme based on spread vector quantization (VQ) neural network with penalized fuzzy c-means (PFCM) clustering technology (named SPFNN) is proposed. The goal is to offer safe exchange of a color stego-image in the internet. In the proposed scheme, the secret color image is first compressed by a spread-unsupervised neural network with PFCM based on interpolative VQ (IVQ), then the block cipher Data Encryption Standard (DES) and the Rivest, Shamir and Adleman (RSA) algorithms are hired to provide the mechanism of a hybrid cryptosystem for secure communication and convenient environment in the internet. In the SPFNN, the penalized fuzzy clustering technology is embedded in a two-dimensional Hopfield neural network in order to generate optimal solutions for IVQ. Then we encrypted color IVQ indices and sorted the codebooks of secret color image information and embedded them into the frequency domain of the cover color image by the Hadamard transform (HT). Our proposed method has two benefits comparing with other data hiding techniques. One is the high security and convenience offered by the hybrid DES and RSA cryptosystems to exchange color image data in the internet. The other benefit is that excellent results can be obtained using our proposed color image compression scheme SPFNN method.     

图象和视频的检索技术

随着网络技术的发展,多媒体数据将成为网络服务的主要内容,因此对多媒体数据管理问题的研究成为近几年的热点。由于媒体信息表现性质的不同,传统关系数据库的检索方式不再适用于图象和视频,因此,必须采用基于自身内容的检索方式。文章对基于内容的图象和视频检索技术分不同层次进行了全面的总结,内容包括依据基本特征,色彩、纹理、形状、和位置关系的技术,视频的场景分割、关键帧提取技术以及基于声音、文字的检索技术等,并阐述了各种方法的优缺点,现状及发展方向。     

A survey on compressed domain video analysis techniques

Image and video analysis requires rich features that can characterize various aspects of visual information. These rich features are typically extracted from the pixel values of the images and videos, which require huge amount of computation and seldom useful for real-time analysis. On the contrary, the compressed domain analysis offers relevant information pertaining to the visual content in the form of transform coefficients, motion vectors, quantization steps, coded block patterns with minimal computational burden. The quantum of work done in compressed domain is relatively much less compared to pixel domain. This paper aims to survey various video analysis efforts published during the last decade across the spectrum of video compression standards. In this survey, we have included only the analysis part, excluding the processing aspect of compressed domain. This analysis spans through various computer vision applications such as moving object segmentation, human action recognition, indexing, retrieval, face detection, video classification and object tracking in compressed videos.     

An encoding method for both image compression and data lossless information hiding

Reversible image data hiding technology means the cover image can be totally recovered after the embedded secret data is extracted. In this paper, we propose a reversible image data hiding scheme based on vector quantization (VQ) compressed images. The secret bits are embedded into the VQ index table by modifying the index value according to the difference of neighboring indices. The data hiding capacity and the size of the final codestream (embedded result) are a trade-off, and it can be decided by users. In other words, the proposed scheme has flexible hiding capacity ability. To estimate the performance, the proposed scheme was compared with the scheme proposed by Wang and Lu (2009). The results of the comparison showed that our proposed scheme is superior to the scheme proposed by Wang and Lu in both data hiding capacity and bit rate.