Similarity and affine invariant distances between 2D point sets

We develop expressions for measuring the distance between 2D point sets, which are invariant to either 2D affine transformations or 2D similarity transformations of the sets, and assuming a known correspondence between the point sets. We discuss the image normalization to be applied to the images before their comparison so that the computed distance is symmetric with respect to the two images. We then give a general (metric) definition of the distance between images, which leads to the same expressions for the similarity and affine cases. This definition avoids ad hoc decisions about normalization. Moreover, it makes it possible to compute the distance between images under different conditions, including cases where the images are treated asymmetrically. We demonstrate these results with real and simulated images     

Elemental image array generation method by using optimized depth image‐based rendering algorithm for integral imaging display

We propose an elemental image array (EIA) generation method by using an optimized depth image‐based rendering (DIBR) algorithm. In this method, the EIA is synthesized by the reference and virtual viewpoint elemental images, and the virtual viewpoint elemental images at the given locations are generated by DIBR algorithm. We optimize the existing DIBR algorithm by adaptively repairing the warped depth images in the processing part and extend the generation dimension of the virtual viewpoint elemental images from one dimension to two dimensions. The optimized DIBR algorithm can effectively solve the problem: the low quality of virtual viewpoint elemental images caused by discontinuous depth values and disocclusion regions. We also implement the generations of virtual viewpoint elemental images and EIA in graph processing unit to reduce the time cost. Experimental results show that the proposed method can not only improve the quality of the virtual viewpoint images but also accelerate the generations of the virtual viewpoint elemental images and EIA.     

Indoor vs. outdoor scene classification in digital photographs

This paper proposes a new technique for the classification of indoor and outdoor images based on edge analysis. Our technique is based on analysing edge straightness in images. We make an original proposal that indoor images have a greater proportion of edges that are straight compared to outdoor images, and use multi-resolution estimates on edge straightness to improve our results. We also consider this method's possible applications in a real-time system. We compare our proposed technique with a number of other approaches that have been published on indoor/outdoor classification of images and convincingly show on a large database that our method generates much higher accuracy.     

The Amsterdam Library of Object Images

We present the ALOI collection of 1,000 objects recorded under various imaging circumstances. In order to capture the sensory variation in object recordings, we systematically varied viewing angle, illumination angle, and illumination color for each object, and additionally captured wide-baseline stereo images. We recorded over a hundred images of each object, yielding a total of 110,250 images for the collection. These images are made publicly available for scientific research purposes.     

ON IMAGE CLASSIFICATION: CITY IMAGES VS. LANDSCAPES

Grouping images into semantically meaningful categories using low-level visual features is a challenging and important problem in content-based image retrieval. Based on these groupings, effective indices can be built for an image database. In this paper, we show how a specific high-level classification problem (city images vs landscapes) can be solved from relatively simple low-level features geared for the particular classes. We have developed a procedure to qualitatively measure the saliency of a feature towards a classification problem based on the plot of the intra-class and inter-class distance distributions. We use this approach to determine the discriminative power of the following features: color histogram, color coherence vector, DCT coefficient, edge direction histogram, and edge direction coherence vector. We determine that the edge direction-based features have the most discriminative power for the classification problem of interest here. A weighted k-NN classifier is used for the classification which results in an accuracy of 93.9% when evaluated on an image database of 2716 images using the leave-one-out method. This approach has been extended to further classify 528 landscape images into forests, mountains, and sunset/sunrise classes. First, the input images are classified as sunset/sunrise images vs forest & mountain images (94.5% accuracy) and then the forest & mountain images are classified as forest images or mountain images (91.7% accuracy). We are currently identifying further semantic classes to assign to images as well as extracting low level features which are salient for these classes. Our final goal is to combine multiple 2-class classifiers into a single hierarchical classifier.     

Tiny videos: a large data set for nonparametric video retrieval and frame classification

In this paper, we present a large database of over 50,000 user-labeled videos collected from YouTube. We develop a compact representation called "tiny videos" that achieves high video compression rates while retaining the overall visual appearance of the video as it varies over time. We show that frame sampling using affinity propagation-an exemplar-based clustering algorithm-achieves the best trade-off between compression and video recall. We use this large collection of user-labeled videos in conjunction with simple data mining techniques to perform related video retrieval, as well as classification of images and video frames. The classification results achieved by tiny videos are compared with the tiny images framework [24] for a variety of recognition tasks. The tiny images data set consists of 80 million images collected from the Internet. These are the largest labeled research data sets of videos and images available to date. We show that tiny videos are better suited for classifying scenery and sports activities, while tiny images perform better at recognizing objects. Furthermore, we demonstrate that combining the tiny images and tiny videos data sets improves classification precision in a wider range of categories.     

基于有监督模糊C-均值算法的混合像元分解

遥感影像中普遍存在混合像元,混合像元的分解是遥感图像处理的一大难点,同时也是人们研究的热点。使用有监督的模糊C-均值算法对遥感影像的混合像元进行分解。在传统的模糊C-均值算法的基础上结合先验知识引入优化初始聚类中心的方法,结合通过降采样产生的模拟数据、ETM遥感影像和MODIS遥感影像对算法性能进行了实验。结果表明,算法适用于多光谱遥感图像的混合像元分解,是一种简易可行的方法。     

Central catadioptric image processing with geodesic metric

Because of the distortions produced by the insertion of a mirror, catadioptric images cannot be processed similarly to classical perspective images. Now, although the equivalence between such images and spherical images is well known, the use of spherical harmonic analysis often leads to image processing methods which are more difficult to implement. In this paper, we propose to define catadioptric image processing from the geodesic metric on the unitary sphere. We show that this definition allows to adapt very simply classical image processing methods. We focus more particularly on image gradient estimation, interest point detection, and matching. More generally, the proposed approach extends traditional image processing techniques based on Euclidean metric to central catadioptric images. We show in this paper the efficiency of the approach through different experimental results and quantitative evaluations.     

Multi-scale edge detection on range and intensity images

Multi-scale feature extraction has become prominent in recent years. Additionally, processing images containing sparse or irregularly distributed data has become increasingly important, in particular with respect to the use of range image data. We present a family of multi-scale gradient-based edge detection algorithms that are suitable for use on either regularly or irregularly distributed image data; these algorithms can be applied directly to the range and intensity images without any image pre-processing. We quantitatively evaluate our algorithms on synthetic intensity and range images and also provide comparative visual output, using real images. The results demonstrate that this approach can be successfully applied to both range and intensity images, providing results that for intensity images are more accurate than from traditional gradient operators and for range images are more accurate than from the scan-line approximation.