Efficient and Handy Texture Mapping on 3D Surfaces

There has been a rapid technical progress in three-dimensional (3D) computer graphics. But gathering surface and texture data is yet a laborious task. This paper addresses the problem of mapping photographic images on the surface of a 3D object whose geometric data are already known. We propose an efficient and handy method for acquiring textures and mapping them precisely on the surface, employing a digital camera alone. We describe an algorithm for selecting a minimal number of camera positions that can cover the entire surface of a given object and also an algorithm to determine camera's position and direction for each photograph taken so as to paste it to the corresponding surfaces precisely. We obtained a matching accuracy within a pixel on a surface through three experimental examples, by which the practicability of our method is demonstrated.     

Manual/automatic colorization for three-dimensional geometric models utilizing laser reflectivity

While laser scanners can produce a high-precision 3D shape of a real object, appearance information of the object has to be captured by an image sensor, such as a digital camera. This paper proposes a novel and simple technique for colorizing 3D geometric models based on laser reflectivity. Laser scanners capture the range data of a target object from the sensors. Simultaneously, the power of the reflected laser is obtained as a by-product of the range data. The reflectance image, which is a collection of laser reflectance depicted as a grayscale image, contains rich appearance information about the target object. The proposed technique is an alternative to texture mapping, which has been widely used to realize photo-realistic 3D modeling but requires strict alignment between range data and texture images. The proposed technique first colorizes a reflectance image based on the similarity of color and reflectance images. Then the appearance information (color and texture information) is added to a 3D model by transferring the color in the colorized reflectance image to the corresponding range image. Some experiments and comparisons between texture mapping and the proposed technique demonstrate the validity of the proposed technique.     

A flexible vehicle surround view camera system by central-around coordinate mapping model

The surround view camera system is an emerging driving assistant technology that can assist drivers in parking by providing top-down view of surrounding situations. Such a system usually consists of four wide-angle or fish-eye cameras that mounted around the vehicle, and a bird-eye view is synthesized from images of these cameras. Commonly there are two fundamental problems for the surround view synthesis, geometric alignment and image synthesis. Geometric alignment performs fish-eye calibration and computes the image perspective transformation between the bird-eye view and images from the surrounding cameras. Image synthesis technique dedicates to seamless stitch between adjacent views and color balancing. In this paper, we propose a flexible central-around coordinate mapping (CACM) model for vehicle surround view synthesis. The CACM model calculates perspective transformation between a top-view central camera coordinate and the around camera coordinates by a marker point based method. With the transformation matrices, we could generate the pixel point mapping relationship between the bird-eye view and images of the surrounding cameras. After geometric alignment, an image fusion method based on distance weighting is adopted for seamless stitch, and an effective overlapping region brightness optimization method is proposed for color balancing. Both the seamless stitch and color balancing can be easily operated by using two types of weight coefficient under the framework of the CACM model. Experimental results show that the proposed approaches could provide a high-performance surround view camera system.

     

采用几何模型切分的人脸纹理图像生成算法

为了克服传统的照片图像拼接方法中利用特征线进行不同照片之间公共交界线定位不准确的缺点,提出一种“几何模型切分”的人脸纹理图像生成算法。通过对人脸几何模型进行切分,以切分后模型图片的轮廓作为边界线裁剪相应的人脸照片,实现不同照片之间交界线的准确对接,并采用柱面纹理映射方法将生成的纹理图像映射到特定人脸几何模型上。实验结果表明,采用提出的“几何模型切分”算法生成的人脸纹理图像进行纹理映射可以得到较好的真实感三维人脸模型,是一种生成人脸纹理图像的有效方法。     

基于摄影原理的三维纹理重建技术研究

讨论的是基于摄影原理的三维物体表面纹理的重建技术.该技术从国内外研究现状和主要不足出发,对三维物体表面纹理的采集和映射方法进行研究和改进,提出了较为合理的算法.纹理采集过程中分析了回转工作台的结构、纹理采集的原则并建立相关的坐标系;根据拍照和投影变换的原理建立三个坐标系对应点间的关系、推导出坐标变换关系式和转换矩阵;对模型表面微小面片法向量进行均匀化处理;通过计算面片的法向量与纹理采集方向向量的位置关系确定其最佳纹理,最后通过多角度映射达到三维物体表面纹理重建的目的.     

Solving the recognition problem for six lines using the Dixon resultant

The “Six-line Problem” arises in computer vision and in the automated analysis of images. Given a three-dimensional (3D) object, one extracts geometric features (for example six lines) and then, via techniques from algebraic geometry and geometric invariant theory, produces a set of 3D invariants that represents that feature set. Suppose that later an object is encountered in an image (for example, a photograph taken by a camera modeled by standard perspective projection, i.e. a “pinhole” camera), and suppose further that six lines are extracted from the object appearing in the image. The problem is to decide if the object in the image is the original 3D object. To answer this question two-dimensional (2D) invariants are computed from the lines in the image. One can show that conditions for geometric consistency between the 3D object features and the 2D image features can be expressed as a set of polynomial equations in the combined set of two- and three-dimensional invariants. The object in the image is geometrically consistent with the original object if the set of equations has a solution. One well known method to attack such sets of equations is with resultants. Unfortunately, the size and complexity of this problem made it appear overwhelming until recently. This paper will describe a solution obtained using our own variant of the Cayley–Dixon–Kapur–Saxena–Yang resultant. There is reason to believe that the resultant technique we employ here may solve other complex polynomial systems.     

基于空间透视不变量的摄象机标定方法

本文给出了一种以空间不变量的数据来计算摄象机外部参数的方法．空间透视不变量是指在几何变换中如投影或改变观察点时保持不变的形状描述．由于它可以得到一个相对于外界来讲独立的物体景物的特征描述，故可以很广泛的应用到计算机视觉等方面．摄象机标定是确定摄象机摄取的２Ｄ图象信息及其３Ｄ实际景物的信息之间的变换关系，它包括内部参数和外部参数两个部分．内部参数表征的是摄象机的内部特征和光学特征参数，包括图象中心（Ｃｘ，Ｃｙ）坐标、图象尺度因子Ｓｘ、有效的焦距长度ｆ和透镜的畸变失真系数Ｋ；外部参数表示的是摄象机的位置和方向在世界坐标中的坐标参数，它包括平移矩阵Ｔ和旋转矩阵Ｒ３×３，一般情况下可以写成一个扩展矩阵［ＲＴ］３×４．本文基于空间透视不变量的计算数据，给出了一种标定摄象机外部参数的方法，实验结果表明该方法具有很强的鲁棒性．     

Estimating Photometric Properties from Image Collections

We address the problem of jointly estimating the scene illumination, the radiometric camera calibration and the reflectance properties of an object using a set of images from a community photo collection. The highly ill-posed nature of this problem is circumvented by using appropriate representations of illumination, an empirical model for the nonlinear function that relates image irradiance with intensity values and additional assumptions on the surface reflectance properties. Using a 3D model recovered from an unstructured set of images, we estimate the coefficients that represent the illumination for each image using a frequency framework. For each image, we also compute the corresponding camera response function. Additionally, we calculate a simple model for the reflectance properties of the 3D model. A robust non-linear optimization is proposed exploiting the high sparsity present in the problem.     

Camera calibration for a mobile robot prototype

Stereovision is an effective technique to use a CCD video camera to determine the 3D position of a target object from two or more simultaneous views of the scene. Camera calibration is a central issue in finding the position of objects in a stereovision system. This is usually carried out by calibrating each camera independently, and then applying a geometric transformation of the external parameters to find the geometry of the stereo setting. After calibration, the distance of various target objects in the scene can be calculated with CCD video cameras, and recovering the 3D structure from 2D images becomes simpler. However, the process of camera calibration is complicated. Based on the ideal pinhole model of a camera, we describe formulas to calculate intrinsic parameters that specify the correct camera characteristics, and extrinsic parameters that describe the spatial relationship between the camera and the world coordinate system. A simple camera calibration method for our CCD video cameras and corresponding experiment results are also given. This work was presented in part at the 7th International Symposium on Artificial Life and Robotics, Oita, Japan, January 16–18, 2002     

基于多幅实拍照片为真实景物模型添加纹理

利用实拍照片为基于真实景物创建的几何模型添加纹理的方法正在受到广泛的关注,实拍照片与几何模型的配准是这项技术的关键.以往方法采用3D-2D特征点匹配或侧影轮廓线匹配的方法进行配准,因此对空间物体的表面特征或轮廓线形状有特殊的要求.提出了一种新的配准方法来解决这一问题,由于采用了基于图像重建的采样点模型与已知几何模型在空间中匹配的方法实现配准,因而充分利用了物体几何形状本身的拓扑和曲率等信息,并可以一次性地实现所有图像与空间物体的配准.实验结果表明,该方法可以解决一部分用以往的方法尚无法处理的实际问题,且在重建空间采样点分布较为合理的情形下,纹理映射效果非常理想.     

双目视觉测量中三维坐标的求取方法研究

双目视觉测量将同一时刻拍摄的两副物体激光条纹图像,经过特征提取和立体匹配得到两两对应的像素点对,根据摄像机标定建立的物空间坐标到像平面坐标对应的矩阵,利用最小二乘法求取物体三维空间点的坐标.但是,由于最小二乘法没有考虑所建立的超限定方程组所代表的几何意义,计算出的点坐标精度不高.提出一种考虑方程组所代表几何意义的方法,利用异面直线公垂线中点去逼近物体空间点.     

基于形态和约束结构的几何哈希法

几何哈希法,作为一种有效的模型搜索算法,在物体识别中有着重要的应用。现有的几何哈希法仅适合于仿射变换下的二维景物识别,论文提出了适合透视投影变换下三维物体识别的几何哈希方法。该方法利用物体的三维形态和物体中具有射影不变量的几何约束结构来构造哈希表。一方面,几何约束结构提供了物体模型的索引功能;另一方面,物体的三维形态提供了物体成像位姿的有关信息,使后续的匹配验证得以简化。实验中使用人造物体对该方法进行了验证,实验表明该方法正确有效。     

Automatic Registration of Multi‐Projector Domes Using a Single Uncalibrated Camera

In this paper we present a novel technique for easily calibrating multiple casually aligned projectors on spherical domes using a single uncalibrated camera. Using the prior knowledge of the display surface being a dome, we can estimate the camera intrinsic and extrinsic parameters and the projector to display surface correspondences automatically using a set of images. These images include the image of the dome itself and a projected pattern from each projector. Using these correspondences we can register images from the multiple projectors on the dome. Further, we can register displays which are not entirely visible in a single camera view using multiple pan and tilted views of an uncalibrated camera making our method suitable for displays of different size and resolution. We can register images from any arbitrary viewpoint making it appropriate for a single head‐tracked user in a 3D visualization system. Also, we can use several cartographic mapping techniques to register images in a manner that is appropriate for multi‐user visualization. Domes are known to produce a tremendous sense of immersion and presence in visualization systems. Yet, till date, there exists no easy way to register multiple projectors on a dome to create a high‐resolution realistic visualizations. To the best of our knowledge, this is the first method that can achieve accurate geometric registration of multiple projectors on a dome simply and automatically using a single uncalibrated camera.     

非线性模型下的摄像机自标定

摄像机标定是从二维图像获取三维信息必不可少的步骤，线性（小孔）模型摄像机自标定，目前已成为计算机视觉领域的研究热点之一，对于非线性模型下摄像机的自标定，目前还未见到相关的研究报道，用于线性模型一般不能准确地描述真实像机的几何成像关系，因此对非线性模型摄像机自标定的研究具有十分重要的实际意义，该文主要探索非线性模型摄像机的自标定方法，基本原理是将非线性模型视为线性模型和畸变项的叠加，然后利用线性模型的基本矩阵或单应矩阵，给出非线性模型参数的约束方程，从而实现非线性模型摄像机的自标定，模拟和真实图像实验均表明该文所给的方法是可行的，具有一定的实用价值。     

A Geometric Calibration Methodology for Single-Head Cone-Beam X-Ray Systems

During X-ray based quality inspection, accurate reconstruction of a 3D object model from a set of its 2D X-ray projections requires efficient geometric calibration, i.e., accurate estimation of the geometric parameters of the setup. We present a calibration methodology for the estimation of the geometric parameters of single-head cone-beam X-ray radiography systems. Our method is related to known approaches regarding camera calibration and geometric calibration of tomography/radiography systems, but performs better in terms of computational efficiency.     

基于序列图像的鲁棒三维重建方法

提出了基于序列图像的鲁棒三维重建方法。首先利用两幅图像的最优参数估计,然后添加新图像并采用稀疏调整,减少图像坐标测量值的最小几何误差。通过对三维结构和摄像机参数进行全局优化处理,以提高重建的鲁棒性。实验结果表明,该方法提高了重建的精度和鲁棒性,并真实地再现了物体的三维模型。     

Video synchronization and its application to object transfer

In video post-production applications, camera motion analysis and alignment are important in order to ensure the geometric correctness and temporal consistency. In this paper, we trade some generality in estimating and aligning camera motion for reduced computational complexity and increased image-based nature. The main contribution is to use fundamental ratios to synchronize video sequences of distinct scenes captured by cameras undergoing similar motions. We also present a simple method to align 3D camera trajectories when the fundamental ratios are not able to match the noisy trajectories. Experimental results show that our method can accurately synchronize sequences even when the scenes are totally different and have dense depths. An application on 3D object transfer is also demonstrated.     

A two‐stage sampling for robust feature matching

For any visual feature‐based SLAM (simultaneous localization and mapping) solutions, to estimate the relative camera motion between two images, it is necessary to find “correct” correspondence between features extracted from those images. Given a set of feature correspondents, one can use a n‐point algorithm with robust estimation method, to produce the best estimate to the relative camera pose. The accuracy of a motion estimate is heavily dependent on the accuracy of the feature correspondence. Such a dependency is even more significant when features are extracted from the images of the scenes with drastic changes in viewpoints and illuminations and presence of occlusions. To make a feature matching robust to such challenging scenes, we propose a new feature matching method that incrementally chooses a five pairs of matched features for a full DoF (degree of freedom) camera motion estimation. In particular, at the first stage, we use our 2‐point algorithm to estimate a camera motion and, at the second stage, use this estimated motion to choose three more matched features. In addition, we use, instead of the epipolar constraint, a planar constraint for more accurate outlier rejection. With this set of five matching features, we estimate a full DoF camera motion with scale ambiguity. Through the experiments with three, real‐world data sets, our method demonstrates its effectiveness and robustness by successfully matching features (1) from the images of a night market where presence of frequent occlusions and varying illuminations, (2) from the images of a night market taken by a handheld camera and by the Google street view, and (3) from the images of a same location taken daytime and nighttime.     

Navigation Tools for Viewing Augmented CAD Models

The first step in the development of any modern physical product is the construction of a CAD model. This model will be used during the product's complete life cycle: prototyping, fabrication, maintenance, and upgrading. During construction, a discrepancy can occur between the model and the object. To maintain and upgrade the object, the model must represent the reality. Keeping the model up to date requires verifying and sometimes updating it. A proposed scalable solution augments CAD software with pictures of the object. This approach aligns still images to the model, allowing visualization of the model and the object at the same time. This creates a mixed view. The virtual camera that renders the model in a mixed view is restricted by the still image because the alignment between the image and the model must be maintained. A tool helps users navigate in this view by transposing the zoom and pan from 2D user interfaces. Other tools allow intuitive navigation within a set of mixed views. This article is part of a special issue on 3D user interfaces.