Using a genetic algorithm to register an uncalibrated image pair to a 3D surface model

In this paper we present a successful application of genetic algorithms to the registration of uncalibrated optical images to a 3D surface model. The problem is to find the projection matrices corresponding to the images in order to project the texture on the surface as precisely as possible. Recently, we have proposed a novel method that generalises the photo-consistency approach by Clarkson et al. to the case of uncalibrated cameras by using a genetic algorithm. In previous studies we focus on the computer vision aspects of the method, while here we analyse the genetic part. In particular, we use semi-synthetic data to study the performance of different GAs and various types of selector, mutation and crossover. New experimental results on real data are also presented to demonstrate the efficiency of the method.     

三维图像边缘曲面模型交互式选择抽取算法

提出一种新的三维图像边缘曲面模型选择抽取算法,能以交互方式获取用户感兴趣的三维边缘曲面模型.用户在二维断层图像的切片区选择目标三维边缘曲面模型对应的二维区域,将选定坐标映射到三维区域,利用基于Laplacian算子的三维边缘检测算子检测三维区域内的部分边缘立方体,除噪后置为种子立方体,根据立方体共面和三维区域增长法原理追踪获得用户感兴趣的具有亚体素精度三维图像边缘曲面模型.     

DART: a 3D model for simulating satellite images and studying surface radiation budget

DART (Discrete Anisotropic Radiative Transfer) is a radiative transfer model that simulates remotely acquired images. It was originally developed to work in the short wavelengths (0.3–3?µm) within 3D natural scenes that are represented as matrices of rectangular cells containing trees, shrubs, grass, soil, etc. DART was recently modified to extend its domain of application and to improve its accuracy. This paper summarizes the major features of DART and presents the changes that were implemented for improving its accuracy. Presently, this model works with natural and urban landscapes, on the whole optical domain (thermal infrared included) and with a multispectral approach that uses optical data bases from 0.3?µm up to 15?µm. It simulates radiative transfer in the whole ‘atmosphere–Earth’ system and it accounts for the instrumental transfer function. Three major changes allowed us to improve DART accuracy by a factor of three: more accurate simulation of single and multiple scattering, use of a scheme that oversamples DART cells and a better account of the direction of radiation that gives rise to multiple scattered radiation.     

3D reconstruction of a femoral shape using a parametric model and two 2D fluoroscopic images

In medical diagnostic imaging, the X-ray CT scanner and the MRI system have been widely used to examine 3D shapes and internal structures of living organisms and bones. However, these apparatuses are generally large and very expensive. Since an appointment is also required before examination, these systems are not suitable for urgent fracture diagnosis in emergency treatment. However, X-ray/fluoroscopy has been widely used as traditional medical diagnosis. Therefore, the realization of the reconstruction of precise 3D shapes of living organisms or bones from a few conventional 2D fluoroscopic images might be very useful in practice, in terms of cost, labor, and radiation exposure. The present paper proposes a method by which to estimate a patient-specific 3D shape of a femur from only two fluoroscopic images using a parametric femoral model. First, we develop a parametric femoral model by the statistical analysis of 3D femoral shapes created from CT images of 56 patients. Then, the position and shape parameters of the parametric model are estimated from two 2D fluoroscopic images using a distance map constructed by the Level Set Method. Experiments using synthesized images, fluoroscopic images of a phantom femur, and in vivo images for hip prosthesis patients are successfully carried out, and it is verified that the proposed system has practical applications.     

Preparation of 2D sequences of corneal images for 3D model building

A confocal microscope provides a sequence of images, at incremental depths, of the various corneal layers and structures. From these, medical practioners can extract clinical information on the state of health of the patient's cornea. In this work we are addressing problems associated with capturing and processing these images including blurring, non-uniform illumination and noise, as well as the displacement of images laterally and in the anterior–posterior direction caused by subject movement. The latter may cause some of the captured images to be out of sequence in terms of depth. In this paper we introduce automated algorithms for classification, reordering, registration and segmentation to solve these problems. The successful implementation of these algorithms could open the door for another interesting development, which is the 3D modelling of these sequences.     

Constructing a 3D trunk model from two images

Trees stand for a key component in the natural environment, thus modeling realistic trees has received much attentions of researchers in computer graphics. However, most trees in computer graphics are generated according to some procedural rules in conjunction with some random perturbations, thus they are generally different from the real trees in the natural environment. In this paper, we propose a systematic approach to create a 3D trunk graphical model from two images so that the created trunk has a similar 3D trunk structure to the real one. In the proposed system, the trunk is first segmented from the image via an interactive segmentation tool and its skeleton is then extracted. Some points on the skeleton are selected and their context relations are established for representing the 2D trunk structure. A camera self-calibration algorithm appropriate for the two-view case is developed, and a minimum curvature constraint is employed to recover the 3D trunk skeleton from the established 2D trunk structure and the calibrated camera. The trunk is then modeled by a set of generalized cylinders around the recovered 3D trunk skeleton. A polygonal mesh representing the trunk is finally generated and a textured 3D trunk model is also produced by mapping the image onto the surface of the 3D trunk model. We have conducted some experiments and the results demonstrated that the proposed system can actually yield a visually plausible 3D trunk model which is similar to the real one in the image.     

3D Euclidean versus 2D non-Euclidean: two approaches to 3D recoveryfrom images

Methods of 3D recovery in computer vision for computing the shape and motion of an object from projected images when an object model is available are classified into two types: the 3D Euclidean approach, which is based on geometrical constraints in 3D Euclidean space, and the 2D non-Euclidean space. Implications of these two approaches are discussed, and some illustrating examples are presented     

Optimizing a mathematical model of a 3D body surface

A general method is proposed to select the number and arrangement of horizontal and vertical sections of a surface sufficient to describe this surface by splines of two variables with an accuracy sufficient from the technological point of view. An analytical review is given to methods that can be used to solve the problem posed (spline-interpolation, spline-interlineation of functions, R-functions, the theory of polynomial operator interpolation). The results of a computation experiment are presented. __________ Translated from Kibernetika i Sistemnyi Analiz, No. 1, pp. 103–112, January–February 2006.     

Minimizing user intervention in registering 2D images to 3D models

This paper proposes a novel technique to speed up the registration of 2D images to 3D models. This problem often arises in the process of digitalization of real objects, because pictures are often taken independently from the 3D geometry. Although there are a number of methods for solving the problem of registration automatically, they all need some further assumptions, so in the most general case the process still requires the user to provide some information about how the image corresponds to geometry, for example providing point-to-point correspondences. We propose a method based on a graph representation where the nodes represent the 2D photos and the 3D object, and arcs encode correspondences, which are either image–to–geometry or image–to–image point pairs. This graph is used to infer new correspondences from the ones specified by the user and from successful alignment of single images and to factually encode the state of the registration process. After each action performed by the user, our system explores the states space to find the shortest path from the current state to a state where all the images are aligned, i.e. a final state and, therefore, guides the user in the selection of further alignment actions for a faster completion of the job. Experiments on empirical data are reported to show the effectiveness of the system in reducing the user workload considerably.     

Automated surface micro-machining mask creation from a 3D model

We have developed and implemented a method, which given a three-dimensional object can infer from topology the two-dimensional masks needed to produce that object with surface micromachining. The masks produced by this design tool can be generic, process independent masks, or if given process constraints, specific for a target process. This design tool calculates the two-dimensional mask set required to produce a given three-dimensional model by investigating the vertical topology to the model. The 3D model is first separated into bodies that are non-intersecting, made from different materials or only linked through a ground plane. Next, for each body unique vertical cross sections are located and arranged into a tree based on their topological relationship. A branch-wise search of the tree uncovers locations where deposition boundaries must lie and identifies candidate masks creating a generic mask set for the 3D model. Finally, in the last step specific process requirements are considered that may constrain the generic mask set. Constraints can include the thickness or number of deposition layers, specific ordering of masks as required by a process and type of material used in a given layer. Candidate masks are reconciled with the process constraints through a constrained optimization.     

3维图像中边界曲面的分类追踪及抽取

3维图像分析中,边界曲面的检测与重构是一个非常重要的问题。已有的连续隐边界曲面的抽取及逼近计算技术存在着把某些零交叉曲面片错误地识别为边界曲面片的缺陷。为此,提出一个新的边界曲面的追踪及抽取的方法。该方法首先将包含边界曲面的全部立方体分为两类:包含一个连通零交叉曲面片的立方体叫第1类边缘立方体,包含两个及其以上不连通零交叉曲面片的立方体叫第2类边缘立方体;然后根据边界曲面的连续性连通性,便可追踪出两类边缘立方体;对于追踪出的第1类边缘立方体直接提取边界曲面片,对于追踪出的第2类边缘立方体的边界曲面片通过其相邻的第1类边缘立方体来提取。实验结果表明本文方法是可行有效的,而且可以有效地克服已有技术的缺陷。     

An automatic 2D to 3D video conversion approach based on RGB-D images

3D movies/videos have become increasingly popular in the market; however, they are usually produced by professionals. This paper presents a new technique for the automatic conversion of 2D to 3D video based on RGB-D sensors, which can be easily conducted by ordinary users. To generate a 3D image, one approach is to combine the original 2D color image and its corresponding depth map together to perform depth image-based rendering (DIBR). An RGB-D sensor is one of the inexpensive ways to capture an image and its corresponding depth map. The quality of the depth map and the DIBR algorithm are crucial to this process. Our approach is twofold. First, the depth maps captured directly by RGB-D sensors are generally of poor quality because there are many regions missing depth information, especially near the edges of objects. This paper proposes a new RGB-D sensor based depth map inpainting method that divides the regions with missing depths into interior holes and border holes. Different schemes are used to inpaint the different types of holes. Second, an improved hole filling approach for DIBR is proposed to synthesize the 3D images by using the corresponding color images and the inpainted depth maps. Extensive experiments were conducted on different evaluation datasets. The results show the effectiveness of our method.

     

Using surface variability characteristics for segmentation of deformable 3D objects with application to piecewise statistical deformable model

To cope with the small sample size problem in the construction of Statistical Deformable Models (SDM), this paper proposes two novel measures that quantify the similarity of the variability characteristics among deforming 3D meshes. These measures are used as the basis of our proposed technique for partitioning a 3D mesh for the construction of piecewise SDM in a divide-and-conquer strategy. Specifically, the surface variability information is extracted by performing a global principal component analysis on the set of sample meshes. An iterative face clustering algorithm is developed for segmenting a mesh that favors grouping triangular faces having similar variability characteristics into a same mesh component. We apply the proposed mesh segmentation algorithm to the construction of piecewise SDM and evaluate the representational ability of the resulting piecewise SDM through the reconstruction of unseen meshes. Experimental results show that our approach outperforms several state-of-the-art methods in terms of the representational ability of the resulting piecewise SDM as evaluated by the reconstruction accuracy.     

Application of blurred circular 3D images on the human vision model

Microsystem Technologies - This study was developed based on the lateral inhibition effect and the Mach band effect. In the study, various human vision experiments involving blurred circular 3D...     

3D and 2D/3D holograms model

The estimating problem of 3D holograms orientation selectivity on angular, orthogonal, and azimuthal sensitivity parameters is formulated and solved. Tenfold increase of density 3D, 2D/3D holograms in comparison with 2D holograms at given selectivity for ones is shown in theory and experimentally.     

Constructing 3D human model from front and side images

Constructing 3D human model from 2D images provides a cost-effective approach to visualize digital human in virtual environment. This paper presents a systematic approach for constructing 3D human model using the front and side images of a person. The silhouettes of human body are first detected and the feature points on the silhouettes are subsequently identified. The feature points are further used to obtain the body dimensions that are necessary for identifying a template 3D human model. The shape of the template human model can be modified by the free-form deformation method. Moreover, the proposed approach has been applied for constructing the 3D human models of 30 subjects. The comparisons between the constructed 3D models and the 3D scanning models of the 30 subjects indicate that the proposed system is very effective and robust.     

3D reconstruction from 2D images with hierarchical continuous simplices

This paper presents an effective framework for the reconstruction of volumetric data from a sequence of 2D images. The 2D images are first aligned to generate an initial 3D volume, followed by the creation of a tetrahedral domain using the Carver algorithm. The resulting tetrahedralization preserves both the geometry and topology of the original dataset. Then a solid model is reconstructed using simplex splines with fitting and faring procedures. The reconstructed heterogenous volumetric model can be quantitatively analyzed and easily visualized. Our experiments demonstrated that our approach can achieve high accuracy in the data reconstruction. The novel techniques and algorithms proposed in this paper can be applied to reconstruct a heterogeneous solid model with complex geometry and topology from other visual data.     

基于三维表面模型的任意切割算法*

通过对三维表面模型进行切割,人们可以方便地观察物体的内部结构。针对三维表面模型,提出了一种任意切割算法。任意切割过程首先是交互生成切割曲线,生成切割面;然后通过切割面对表面模型进行切割,在切割面上生成交线序列;再由交线序列与切割面边界生成封闭的边界轮廓,确定各边界轮廓间的包含关系;最后对边界轮廓包围的截面区域进行Delaunay三角剖分并着色,得到完整的剖面。实验结果证明了该算法的有效性和可行性。     

Winding and Euler numbers for 2D and 3D digital images

New algorithms for computing the Euler number of a 3D digital image S are given, based on smoothing the image to a differentiable object and applying theorems of differential geometry and algebraic topology. They run in O(n) time, where n is the number of object elements of S with neighbors not in S. The basic idea is general and easily extended to images defined by other means, such as a hierarchical data structure or a union of isothetic (hyper) rectangles.     

基于数字人彩色图像的三维重建算法研究

对数字人彩色照片数据进行高质量的实时三维表面重建提出了一种新算法。该算法利用交互分割平台提取出彩色体数据中单个器官的三维表面点集,再根据对二值体数据滤波后的灰度值计算灰度梯度估算得到表面点的法向量。最后用带颜色的表面点来描述器官的三维表面,利用显卡OpenGL接口对表面点集进行三维显示。在微机环境下对美国数字人照片数据集中的肝脏和肺部两个器官进行了三维重建,在保证图像质量的前提下重建速度超过25帧/s。提出的算法能对高分辨率的彩色体数据进行高质量的实时三维表面重建。