Off-the-shelf CNN features for 3D object retrieval

Multimedia Tools and Applications - Effective feature representation is crucial to view-based 3D object retrieval (V3OR). Most previous works employed hand-crafted features to represent the views...     

View-wised discriminative ranking for 3D object retrieval

In this paper, we propose a new framework which can capture the latent relative information within the multiple views of 3D model, named View-wised Discriminative Ranking(VDR). Different to existing view-based methods which treat the multiple views as the independent information, we want to model the relative information within multiple views. By placing the views of model in certain order, we learn the parameters of ranking function as a new robust model representation. We evaluate our proposal on several challenging datasets for 3D retrieval and the comparison experiments demonstrate the superiority of the proposed method in both retrieval accuracy and efficiency.     

Convolutional deep learning for 3D object retrieval

In recent years, with the development of 3D technologies, 3D model retrieval has become a hot topic. The key point of 3D model retrieval is to extract robust feature for 3D model representation. In order to improve the effectiveness of method on 3D model retrieval, this paper proposes a feature extraction model based on convolutional neural networks (CNN). First, we extract a set of 2D images from 3D model to represent each 3D object. SIFT detector is utilized to detect interesting points from each 2D image and extract interesting patches to represent local information of each 3D model. X-means is leveraged to generate the CNN filters. Second, a single CNN layer learns low-level features which are then given as inputs to multiple recursive neural networks (RNN) in order to compose higher order features. RNNs can generate the final feature for 2D image representation. Finally, nearest neighbor is used to compute the similarity between different 3D models in order to handle the retrieval problem. Extensive comparison experiments were on the popular ETH and MV-RED 3D model datasets. The results demonstrate the superiority of the proposed method.     

基于混合光场描述符的三维目标检索研究

针对三维目标（3D object）检索问题,提出了一种基于新型描述符的3D目标检索方法。首先,在分析现行基于视图的3D模型描述符在描述方法上不充分的基础上,提出了混合描述符H_D的总体思路。进而讨论了H_D总体框架,即在光场图像阵列自适应的基础上,实现了直方图颜色描述符H_CD,shock图形状描述符H_SD及贝叶斯网络（Bayesian Network,BN）纹理描述符H_TD的优化组合。其次,讨论了H_D各部分的具体实现及度量机制,最后,对H_D检索性能进行了实验分析,结果表明提出的方法是优于其他基于视图的检索方法。     

3D object retrieval based on Spatial+LDA model

Multimedia Tools and Applications - Latent Dirichlet Allocation (LDA) is one popular topic extraction method, which has been applied in many applications such as textual retrieval, user...     

Local commute-time guided MDS for 3D non-rigid object retrieval

In this paper, we propose a 3D non-rigid shape retrieval method based on canonical shape analysis. Our main idea is to transform the problem of non-rigid shape retrieval into a rigid shape retrieval problem via the well-known multidimensional scaling (MDS) approach and random walk on graphs. We first segment the non-rigid shape into local partitions based on its salient features. Then, we calculate a local MDS problem for each partition, where the local commute time distance is used as weighting function in order to preserve local shape details. Finally, we aggregate the set of local MDS problems as a global constrained problem. The constraint is formulated using the biharmonic function between local salient features. In contrast to MDS method, the proposed local MDS is computationally efficient, parameters free and gives isometry-invariant forms with minimum features distortion. Due to these advantageous properties, the proposed method achieved good retrieval accuracy on non-rigid shape benchmark datasets.     

3D object retrieval in an atlas of neuronal structures

Circuit neuroscience tries to solve one of the most challenging questions in biology: How does the brain work? An important step toward an answer to this question is to gather detailed knowledge about the neuronal circuits of the model organism Drosophila melanogaster. Geometric representations of neuronal objects of the Drosophila are acquired using molecular genetic methods, confocal microscopy, nonrigid registration and segmentation. These objects are integrated into a constantly growing common atlas. The comparison of new segmented neuronal objects to already known neuronal structures is a frequent task, which evolves with a growing amount of data into a bottleneck of the knowledge discovery process. Thus, the exploration of the atlas by means of domain specific similarity measures becomes a pressing need. To enable similarity based retrieval of neuronal objects, we defined together with domain experts tailored dissimilarity measures for each of the three typical neuronal structures cell body, projection, and arborization. Moreover, we defined the neuron enhanced similarity for projections and arborizations. According to domain experts, the developed system has big advantages for all tasks, which involve extensive data exploration.     

3D object retrieval based on multi-view convolutional neural networks

Multimedia Tools and Applications - Recently, 3D objects have been widely designed and applied in various technical applications. In this paper, we propose a novel 3D model retrieval method based...     

Reeb graph path dissimilarity for 3D object matching and retrieval

We introduce a skeletal graph for topological 3D shape representation using Morse theory. The proposed skeletonization algorithm encodes a 3D shape into a topological Reeb graph using a normalized mixture distance function. We also propose a novel graph matching algorithm by comparing the relative shortest paths between the skeleton endpoints. Experimental results demonstrate the feasibility of the proposed topological Reeb graph as a shape signature for 3D object matching and retrieval.     

Content-based image retrieval methods

Creation of a content-based image retrieval system implies solving a number of difficult problems, including analysis of low-level image features and construction of feature vectors, multidimensional indexing, design of user interface, and data visualization. Quality of a retrieval system depends, first of all, on the feature vectors used, which describe image content. The paper presents a survey of common feature extraction and representation techniques and metrics of the corresponding feature spaces. Color, texture, and shape features are considered. A detailed classification of the currently known features’ representations is given. Experimental results on efficiency comparison of various methods for representing and comparing image content as applied to the retrieval and classification tasks are presented.     

基于内容的多媒体检索技术

基于内容的多媒体信息检索在图像检索中意义重大,其检索的依据主要是多媒体的特征向量值,因此多媒体信息特别是图像的特征向量的组织直接影响到数据检索的效率.对基于内容的多媒体检索技术进行了研究,同时借鉴基于关键字的检索技术,引进了二叉排序树来组织图像的特征向量,利用成熟的二叉排序树算法进行特征向量值的检索,提高了图像检索的效率.     

3D object retrieval via range image queries in a bag-of-visual-words context

3D object retrieval based on range image queries that represent partial views of real 3D objects is presented. The complete 3D models of the database are described by a set of panoramic views, and a Bag-of-Visual-Words model is built using SIFT features extracted from them. To address the problem of partial matching, we suggest a histogram computation scheme, on the panoramic views, that represents local information by taking into account spatial context. Furthermore, a number of optimization techniques are applied throughout the process for enhancing the retrieval performance. Its superior performance is shown by evaluating it against state-of-the-art methods on standard datasets.