Self-calibration from one circular motion sequence and two images

This paper describes a new method for self-calibration of camera with constant internal parameters under circular motion, using one sequence and two images captured with different camera orientations. Unlike the previous method, in which three circular motion sequences are needed with known motion, the new method computes the rotation angles and the projective reconstructions of the sequence and the images with circular constraint enforced, which is called a circular projective reconstruction, using a factorization-based method. It is then shown that the images of the circular points of each circular projective reconstruction can be readily obtained. Subsequently, the image of the absolute conic and the calibration matrix of the camera can be determined. Experiments on both synthetic and real image sequence are given, showing the accuracy and robustness of the new algorithm.     

Point set silhouettes via local reconstruction

We present an algorithm to compute the silhouette set of a point cloud. Previous methods extract point set silhouettes by thresholding point normals, which can lead to simultaneous over- and under-detection of silhouettes. We argue that additional information such as surface curvature is necessary to resolve these issues. To this end, we develop a local reconstruction scheme using Gabriel and intrinsic Delaunay criteria and define point set silhouettes based on the notion of a silhouette-generating set. The mesh umbrellas, or local reconstructions of one-ring triangles surrounding each point sample, generated by our method enable accurate silhouette identification near sharp features and close-by surface sheets, and provide the information necessary to detect other characteristic curves such as creases and boundaries. We show that these curves collectively provide a sparse and intuitive visualisation of point-cloud data.     

Implicit surface reconstruction from contours

This paper presents a fast and efficient surface reconstruction method from contour data sets. The reconstructed surface is defined as an implicit surface. We need not create any geometric skeleton and the blending of the three dimensional contour functions enables us to avoid the correspondence and the branching problems that occur in geometrical methods. Tests carried out with medical scanner data-sets show that the reconstruction may be performed at interactive rates.     

High-speed human motion recovery employing back projection

This paper describes a novel technique for high-speed human motion recovery. For 3-D human motion recovery, stereoscopic vision is a normal technique, as well as the employment of a magnetic field, but this cannot avoid the difficulty of marker tracking. In this article, a novel motion recovery technique is proposed based on the back projection of silhouette images. This technique has some advantages over others because it does not employ markers, and it has a simple architecture. In the experiment performed, the proposed motion recovery technique is implemented on a system containing a LAN, a host computer, and four pairs of camera and computer, and it achieves high-speed human motion recovery. This work was presented in part at the 10th International Symposium on Artificial Life and Robotics, Oita, Japan, February 4–6, 2005     

基于旋转多视角深度配准的三维重建方法

针对在旋转平台上采集得到的多视角数据,提出一种有效的配准方法,同时结合双目立体视觉测量构建了完整的三维重建系统。通过拍摄旋转平台上多个视角下的标定板图像,提取标定板图像角点信息,计算出旋转平台坐标系和摄像机坐标系的空间位置关系,进一步推导出不同视角下的坐标转换关系,从而实现不同视角的数据配准。实验结果表明,基于本配准方法的旋转多视角双目测量系统具有较高的配准精度,能有效用于物体表面三维重建。     

Direct surface reconstruction from a moving sensor

A technique is described for surface reconstruction from a sequence of images when the sensor motion is known. The reconstruction takes the form of an orthographic depth map in a viewer-independent frame. Following a mathematical justification, the technique is illustrated with examples using noisy synthetic images.     

Surface reconstruction from scan paths

Given a finite set of points sampled from a surface, a particular important topic of surface reconstruction is to find a triangular mesh connecting the sampling points and approximating the surface. We introduce a new solution for this problem which takes into consideration hidden structural information in form of scan paths. The scan paths, which often are available in sampling data sets, allow us to cope with creases or ridges more reliably than algorithms assuming unstructured point clouds. Moreover, the consideration of scan paths leads to a better reconstruction of surface boundaries than other heuristics.     

Super-resolution reconstruction of image sequence using multiple motion estimation fusion

Super-resolution reconstruction algorithm produces a high-resolution image from a low-resolution image sequence. The accuracy and the stability of the motion estimation (ME) are essential for the whole restoration. In this paper, a new super-resolution reconstruction algorithm is developed using a robust ME method, which fuses multiple estimated motion vectors within the sequence. The new algorithm has two major improvements compared with the previous research. First, instead of only two frames, the whole sequence is used to obtain a more accurate and stable estimation of the motion vector of each frame; second, the reliability of the ME is quantitatively measured and introduced into the cost function of the reconstruction algorithm. The algorithm is applied to both synthetic and real sequences, and the results are presented in the paper.     

基于形状特征点匹配的CT断层图象表面重建

当切片间距离较大时，如何快速，准确地重构出复杂器官的表面并显示它，在医学临床应用中已变得越来越重要。本文首先提出了一种保持轮廓形状特征的自适应特征点采样算法，该算法大大减少了后续处理的存储量和计算量，其次，在于对图象特性的分析，提出了一种特殊点匹配算法，该算法考虑到了特征点在原图象上的灰度，梯度幅值，梯度方向和位置对匹配的影响，提高了重建表面的准确度。实验结果证明了上述算法的有效性。     

Adaptive extraction and visualization of silhouette curves from volumetric datasets

An algorithm for silhouette extraction from volumetric data is presented. Trivariate tensor product B-spline functions are used to represent the data. An offline phase that arranges the data in a lookup table is employed to improve the computation time during an interactive session. A subdivision scheme is employed to extract the silhouette curves from an implicit trivariate B-spline function. The produced results are smooth, high-quality silhouette curves when compared to voxel-based silhouette extraction schemes.     

四元数样条插值的人体运动数据重构

为了得到平滑的人体动画,提出一种基于四元数的样条插值算法,利用提取的关键帧实现人体运动序列的有效重构。为减少重构误差、加快收敛速度,将已知关键帧集合作为初始条件,通过迭代算法求出样条曲线的控制点集合。利用样条曲线控制点计算贝塞尔曲线控制点,构造贝塞尔样条曲线段,将各段贝塞尔样条曲线段组合,构造一条基于四元数的样条曲线。根据德卡斯特里奥（de Casteljau）算法插值重构人体运动。实验结果表明,该算法在保证执行效率的同时,可得到光滑的插值结果,实现满足视觉要求的人体运动重构。     

A Delaunay-based region-growing approach to surface reconstruction from unorganized points

This paper presents a Delaunay-based region-growing (DBRG) surface reconstruction algorithm that holds the advantages of both Delaunay-based and region-growing approaches. The proposed DBRG algorithm takes a set of unorganized sample points from the boundary surface of a three-dimensional object and produces an orientable manifold triangulated model with a correct geometry and topology that is faithful to the original object. Compared with the traditional Delaunay-based approach, the DBRG algorithm requires only one-pass Delaunay computation and needs no Voronoi information because it improves the non-trivial triangle extraction by using a region-growing technique. Compared with the traditional region-growing methods, the proposed DBRG algorithm makes the surface reconstruction more systematic and robust because it inherits the structural characteristics of the Delaunay triangulation, which nicely complements the absence of geometric information in a set of unorganized points. The proposed DBRG algorithm is capable of handling surfaces with complex topology, boundaries, and even non-uniform sample points. Experimental results show that it is highly efficient compared with other existing algorithms.     

Splat-based surface reconstruction from defect-laden point sets

We introduce a method for surface reconstruction from point sets that is able to cope with noise and outliers. First, a splat-based representation is computed from the point set. A robust local 3D RANSAC-based procedure is used to filter the point set for outliers, then a local jet surface – a low-degree surface approximation – is fitted to the inliers. Second, we extract the reconstructed surface in the form of a surface triangle mesh through Delaunay refinement. The Delaunay refinement meshing approach requires computing intersections between line segment queries and the surface to be meshed. In the present case, intersection queries are solved from the set of splats through a 1D RANSAC procedure.     

基于shape from silhouette方法的虚拟人体构造

逼真的人体三维模型（虚拟人体）在产品设计，计算机动画，虚拟现实等领域都有着广泛的需求，为此，提出了一种基于shape from silhouette的人体三维模型构造方法，该方法所需要的器材只是一个普通的数码相机，通过从不同角度对人体进行拍摄，然后经过摄像机定标，体积生成，表面重建，纹理映射后就可重建出逼真的人体三维模型。实验结果表明，此方法精度较高，整个过程简单快捷，是一种非常实用的方法。     

Shape and motion from simultaneous equations with closed-loop solution

This paper proposes a method for simultaneously estimating 2D image motion and 3D object shape and motion from only two frames. The problem is formulated in a system of equations, including the differential epipolar constraint, a newly derived optical flow equation and surface normal constraint, under the assumption of perspective projection, rigid motion, Lambertian reflectance and distant lighting. A closed-loop solver is constructed based on the simultaneous equations to export accurate estimate for optical flow as well as dense shape and motion. Experimental results are also provided.     

Shape from shading using the facet model

In this paper, the facet model is used in the recovery of surface orientation from single and multiple images. Two methods for determining surface orientation from image shading are presented. The first method works in the single image domain and is formulated as a non-linear optimization problem. Since three-dimensional scene information available in a single image is usually ambiguous, the optimization procedure can result in multiple solutions. The possibility of adding boundary constraints to the optimization process is also investigated. In the second method, additional images are obtained from the same viewing position, but with changing illumination direction. With these additional images, local surface orientation is determined uniquely by a linear optimization procedure. Experimental results of the shape-from-shading methods are also described.     

Provably correct reconstruction of surfaces from sparse noisy samples

Automated three-dimensional surface reconstruction is a very large and still fast growing area of applied computer vision and there exists a huge number of heuristic algorithms. Nevertheless, the number of algorithms which give formal guarantees about the correctness of the reconstructed surface is quite limited. Moreover such theoretical approaches are proven to be correct only for objects with smooth surfaces and extremely dense samplings with no or very few noise. We define an alternative surface reconstruction method and prove that it preserves the topological structure of multi-region objects under much weaker constraints and thus under much more realistic conditions. We derive the necessary error bounds for some digitization methods often used in discrete geometry, i.e. supercover and m-cell intersection sampling. We also give a detailed analysis of the behavior of our algorithm and compare it with other approaches.     

Continuous global optimization in surface reconstruction from an oriented point cloud

We introduce a continuous global optimization method to the field of surface reconstruction from discrete noisy cloud of points with weak information on orientation. The proposed method uses an energy functional combining flux-based data-fit measures and a regularization term. A continuous convex relaxation scheme assures the global minima of the geometric surface functional. The reconstructed surface is implicitly represented by the binary segmentation of vertices of a 3D uniform grid and a triangulated surface can be obtained by extracting an appropriate isosurface. Unlike the discrete graph-cut solution, the continuous global optimization entails advantages like memory requirements, reduction of metrication errors for geometric quantities, and allowing globally optimal surface reconstruction at higher grid resolutions. We demonstrate the performance of the proposed method on several oriented point clouds captured by laser scanners. Experimental results confirm that our approach is robust to noise, large holes and non-uniform sampling density under the condition of very coarse orientation information.     

Composite freeform surface reconstruction using recursive interpolating subdivision scheme

Composite freeform surface reconstruction from 3D scanned data of a physical model has become a more and more important topic in the field of CAD/CAE/CAM. By repeated application of a fixed set of recursive interpolation subdivision schemes on the initial mesh of the 3D sparse scanned data of a physical model, a polygonal model of composite freeform surface can be constructed. In the paper, the algorithm for constructing the initial triangular mesh from 3D sparse scanned data is presented. The unified recursive interpolating subdivision scheme for triangular mesh is proposed. A special quad-tree data structure is suggested to store all the necessary information of the vertices and elements of the polygonal model. Examples of composite surface reconstruction are provided to explain the distinguished superiority of subdivision scheme for reconstructing the arbitrary topological complex surface.     

基于多个关键点对应性的手部动态重建

提出了一种新的基于单视图深度序列的手部运动跟踪和表面重建方法。在假设任 意一对关键点的对应性在所有手部姿态上均一致基础上,使用一个平滑的手部网格模板来提供 形状和拓扑先验,引入多个能量函数构造输入扫描与模板之间三维关键点到关键点的对应性, 并将其整合到一个可用的非刚性配准管线中,以实现精确的表面拟合。通过最小化手部模板和 输入深度图像序列之间的误差来捕获非刚性的手部运动。采用迭代求解的方法,通过显式的关 键点到关键点之间的对应性,逐步细化手部关节区域的变形,从而达到快速收敛和合理变形的 目的。在含有噪声的手部深度图像序列上的大量实验表明,该方法能够重建精确的手部运动, 并且对较大的变形和遮挡具有鲁棒性。