Towards a real-time 3D shape reconstruction using a structured light system

This paper deals with 3D shape reconstruction using a structured light system (SLS) which projects a matrix of laser rays onto the scene to be analyzed. The intrinsic problem of such a system is the correspondence problem solving, which in this particular case amounts to matching up the imaged spots and the originating laser rays. In this paper, we propose a method for automatically obtaining configurations of the system (COS) (i.e. the relative positions of the camera, laser projector, and measuring scene) that permit to achieve a direct and unambiguous correspondence. After, we propose a splitting cell algorithm, which efficiently performs a real-time correspondence procedure. Experimental results obtained from both simulated and real data demonstrate that our method provides our SLS with possibilities for real-time applications.     

基于Java 3D的医学图像三维重建系统

系统采用分层组件化的设计思想,在逻辑上分为三层:图像预处理层、图像分割层和用户界面层,实现了医学图像的二维标注与测量、三维体数据的分割、三维重建与交互功能。介绍了系统的体系结构和系统开发的主要技术方法。最后指出了系统的实用性和对医学研究方面的价值。     

汽车类外观专利图像三维重建

为实现由汽车类外观设计专利图像到三维模型的恢复,结合汽车类外观专利图像的特点,提出融合从明暗恢复形状(SFS)与轮廓线法的汽车类外观专利图像三维重建方法.结合右视图及主视图的轮廓对由SFS得到的模型进行深度校正,得到较为精确的单幅图像三维模型;利用轮廓法恢复物体的整体模型,通过计算各单幅图像模型及整体模型的位置坐标,进行各模型之间的对齐操作,使两种方法得到的模型融为一体,得到融合模型.实验结果表明,与其它方法相比,该方法得到的三维模型在整体与细节方面都得到较大提升.     

Pose-invariant face recognition using a 3D deformable model

The paper proposes a novel, pose-invariant face recognition system based on a deformable, generic 3D face model, that is a composite of: (1) an edge model, (2) a color region model and (3) a wireframe model for jointly describing the shape and important features of the face. The first two submodels are used for image analysis and the third mainly for face synthesis. In order to match the model to face images in arbitrary poses, the 3D model can be projected onto different 2D viewplanes based on rotation, translation and scale parameters, thereby generating multiple face-image templates (in different sizes and orientations). Face shape variations among people are taken into account by the deformation parameters of the model. Given an unknown face, its pose is estimated by model matching and the system synthesizes face images of known subjects in the same pose. The face is then classified as the subject whose synthesized image is most similar. The synthesized images are generated using a 3D face representation scheme which encodes the 3D shape and texture characteristics of the faces. This face representation is automatically derived from training face images of the subject. Experimental results show that the method is capable of determining pose and recognizing faces accurately over a wide range of poses and with naturally varying lighting conditions. Recognition rates of 92.3% have been achieved by the method with 10 training face images per person.     

Automatic registration of laser reflectance and colour intensity images for 3D reconstruction

The objective of the work presented in this paper is to generate complete, high-resolution models of real world scenes from passive intensity images and active range sensors. In previous work, an automatic method has been developed in order to compute 3D models of real world scenes from laser range data. The aim of this project is to improve these existing models by fusing range and intensity data. The paper presents different techniques in order to find correspondences between the different sets of data. Based on these control points, a robust camera calibration is computed with a minimal user intervention in order to avoid the fastidious point and click phase that is still necessary in many systems. The intensity images are then re-projected into the laser coordinate frame to produce an image that combines the laser reflectance and the available video intensity images into a colour texture map.     

3D geometry reconstruction from orthographic views: A method based on 3D image processing and data fitting

Industrial esthetic designers typically produce hand-drawn sketches in the form of orthographic projections. A subsequent translation from 2D-drawings to 3D-models is usually necessary. This involves a considerably time consuming process, so that some automation is advisable.     

Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video

3D video [IEEE Multimedia (1997) 18] is the ultimate image media recording dynamic visual events in the real world as is; it records time varying 3D object shape with high fidelity surface properties (i.e., color and texture). Its applications cover wide varieties of personal and social human activities: entertainment (e.g., 3D game and 3D TV), education (e.g., 3D animal picture books), sports (e.g., sport performance analysis), medicine (e.g., 3D surgery monitoring), culture (e.g., 3D archive of traditional dances), and so on. In this paper, we propose: (1) a PC cluster system for real-time reconstruction of dynamic 3D object action from multi-view video images, (2) a deformable 3D mesh model for reconstructing the accurate dynamic 3D object shape, and (3) an algorithm of rendering natural-looking texture on the 3D object surface from the multi-view video images. Experimental results with quantitative performance evaluations demonstrate the effectiveness of these methods in generating high fidelity 3D video from multi-view video images.     

多视三维重构中连续能量模型的凸优化

利用融合了轮廓线及体视的序列图像信息,提出了一个面向多视三维重构的稳健能量模型;为了适配于可视性约束,提出一种针对该能量模型的连续全局优化方法;为了保证栅格连通性选择的一致性及独立性,实施了全局连续优化的超松弛离散化。实例证明,该方法的实用性好,极大地减少了算法处理的内存开销,实现了在更高分辨率上有效的多视重构。     

融合形状特征的MRG骨架树三维检索方法

提出一种基于MRG骨架树的三维模型检索方法。根据多分辨率Reeb图(MRG)的原理,提取反映模型拓扑特征的Reeb图骨架并且映射成树形结构,分析了节点的拓扑属性。针对拓扑属性在形状特征上的表达能力不足,在节点相应区域提取离散曲率和面积比例描绘局部的形状特征。有效地结合了模型的拓扑特征和形状特征计算模型的相似度。该方法突出了模型的整体拓扑特征和形状特征,实验结果表明了该方法的高效性和鲁棒性。     

The quasi-perspective model: Geometric properties and 3D reconstruction

The paper investigates geometric properties of quasi-perspective projection model in one and two-view geometry. The main results are as follows. (i) Quasi-perspective projection matrix has nine degrees of freedom (DOF), and the parallelism along X and Y directions in world system are preserved in images. (ii) Quasi-fundamental matrix can be simplified to a special form with only six DOFs. The fundamental matrix is invariant to any non-singular projective transformation. (iii) Plane induced homography under quasi-perspective model can be simplified to a special form defined by six DOFs. The quasi-homography may be recovered from two pairs of corresponding points with known fundamental matrix. (iv) Any two reconstructions in quasi-perspective space are defined up to a non-singular quasi-perspective transformation. The results are validated experimentally on both synthetic and real images.     

三维网格模型的分割及应用技术综述

对三维网格模型分割的定义、分类和应用情况做了简要回顾,介绍并评价了几种典型的网格模型分割算法,如分水岭算法、基于拓扑和几何信息的分割算法等;同时,对网格分割在几种典型应用中的研究工作进行了分类介绍和评价．最后对三维分割技术今后的发展方向做出展望．     

Serial 3D model reconstruction for machining evolution of rotational parts by merging semantic and graphic process planning information

The manufacturing of a mechanical part is a dynamic evolution process from a raw workpiece to the final part, in which the generation of serial 3D models reflecting the changes on geometric shapes is especially critical to digital manufacturing. In this paper, an approach driven by the process planning course, the machining semantics and the machining geometry to reconstruct incrementally the serial 3D models for rotational part’s dynamic evolution is proposed. The two major techniques involved are: (1) extraction of machining semantics based on process planning language understanding; (2) 3D reconstruction from 2D procedure working drawings guided by machining semantics and visualization for the reconstructed series of 3D models. Compared with the conventional 3D reconstruction methods, this approach introduced the process planning course and relevant information to implement a dynamic, incremental and knowledge-based reconstruction which can greatly reduce the efforts in reconstruction and extend the collection of geometric shapes to be reconstructed.     

3D model retrieval using principal plane analysis and dynamic programming

Three dimensional models play an important role in many applications; the problem is how to select the appropriate models from a 3D database rapidly and accurately. In recent years, a variety of shape representations, statistical methods, and geometric algorithms have been proposed for matching 3D shapes or models. In this paper, we propose a 3D shape representation scheme based on a combination of principal plane analysis and dynamic programming. The proposed 3D shape representation scheme consists of three steps. First, a 3D model is transformed into a 2D image by projecting the vertices of the model onto its principal plane. Second, the convex hall of the 2D shape of the model is further segmented into multiple disjoint triangles using dynamic programming. Finally, for each triangle, a projection score histogram and moments are extracted as the feature vectors for similarity searching. Experimental results showed the robustness of the proposed scheme, which resists translation, rotation, scaling, noise, and destructive attacks. The proposed 3D model retrieval method performs fairly well in retrieving models having similar characteristics from a database of 3D models.     

结合谱变换和马尔可夫模型的三维形状对齐

针对大尺度变形下的三维形状对齐问题,提出根据三维形状的等距性构造马尔可夫能量最小化模型,得到最优对齐结果。算法对三维模型进行谱变换,在变换空间中对三维模型进行初始化对齐。以谱距离和测地距离分别定义马尔可夫模型的单点势能函数和点对势能函数,形成可用于形状对齐的能量最小化模型。通过Alpha扩展算法对模型进行求解,得到最终的对齐结果。实验结果表明,算法在大尺度变形和拓扑变化等情况都能够输出很好的对齐结果。     

Topological model for 3D image representation: Definition and incremental extraction algorithm

In this paper, we define the three-dimensional topological map, a model which represents both the topological and geometrical information of a three-dimensional labeled image. Since this model describes the image’s topology in a minimal way, we can use it to define efficient image processing algorithms. The topological map is the last level of map hierarchy. Each level represents the region boundaries of the image and is defined from the previous level in the hierarchy, thus giving a simple constructive definition. This model is an extension of the similar model defined for 2D images. Progressive definition based on successive map levels allows us to extend this model to higher dimension. Moreover, with progressive definition, we can study each level separately. This simplifies the study of disconnection cases and the proofs of topological map properties. Finally, we provide an incremental extraction algorithm which extracts any map of the hierarchy in a single image scan. Moreover, we show that this algorithm is very efficient by giving the results of our experiments made on artificial images.     

Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements,opportunities, and challenges

Image-based 3D reconstruction of civil infrastructure is an emerging topic that is gaining significant interest both in the scientific and commercial sectors of the construction industry. Reliable computer vision-based algorithms have become available over the last decade and they can now be applied to solve real-life problems in uncontrolled environments. While a large number of such algorithms have been developed by the computer vision and photogrammetry communities, relatively little work has been done to study their performance in the context of infrastructure. This paper aims to analyze the state-of-the-art in image-based 3D reconstruction and categorize existing algorithms according to different metrics that are important for the given purpose. An ideal solution is portrayed to show what the ultimate goal is. This will be followed by identifying gaps in knowledge and highlighting future research topics that could contribute to the widespread adoption of this technology in the construction industry. Finally, a list of practical constraints that make the 3D reconstruction of infrastructure a challenging task is presented.     

Multi-View Scene Capture by Surfel Sampling: From Video Streams to Non-Rigid 3D Motion,Shape and Reflectance

In this paper we study the problem of recovering the 3D shape, reflectance, and non-rigid motion properties of a dynamic 3D scene. Because these properties are completely unknown and because the scene's shape and motion may be non-smooth, our approach uses multiple views to build a piecewise-continuous geometric and radiometric representation of the scene's trace in space-time. A basic primitive of this representation is the dynamic surfel, which (1) encodes the instantaneous local shape, reflectance, and motion of a small and bounded region in the scene, and (2) enables accurate prediction of the region's dynamic appearance under known illumination conditions. We show that complete surfel-based reconstructions can be created by repeatedly applying an algorithm called Surfel Sampling that combines sampling and parameter estimation to fit a single surfel to a small, bounded region of space-time. Experimental results with the Phong reflectancemodel and complex real scenes (clothing, shiny objects, skin) illustrate our method's ability to explain pixels and pixel variations in terms of their underlying causes—shape, reflectance, motion, illumination, and visibility.