Image Registration in a Coarse Three-Dimensional Virtual Environment

In recent years, the availability of off‐the‐shelf geometric data for an urban environment has increased. During rendering, ground level images are mapped onto the façades of the buildings to improve the visual quality of the scene. This paper focuses on a technique that enables ground level images to be automatically integrated into an existing coarse three‐dimensional environment. The approach utilises the planar nature of architectural scenes to enable the automatic extraction of a building façade from an image and its registration into the virtual environment.     

一种遥感影像的自动配准方法

图像配准技术是图像融合、图像镶嵌以及影像三维重建的基础．提出了一种基于SUSAN(Smallest Univalue Segment Assimilating Nucleus)算子的图像配准方法．利用SUSAN算子提取两幅图像的角点，通过粗匹配和细匹配两个步骤得到匹配角点对．根据这些角点对对图像配准．试验表明该方法能有效的实现影像自动配准．     

Mesh Topological Optimization for Improving Piecewise-Linear Image Registration

This paper presents a mutual-information based optimization algorithm for improving piecewise-linear (PWL) image registration. PWL-registration techniques, which are well-suited for registering images of the same scene with relative local distortions, divide the images in conjugate triangular patches that are individually mapped through affine transformations. For this process to be accurate, each pair of corresponding image triangles must be the projections of a planar surface in space; otherwise, the registration incurs in errors that appear in the resultant registered image as local distortions (distorted shapes, broken lines, etc.). Given an initial triangular mesh onto the images, we propose an optimization algorithm that, by swapping edges, modifies the mesh topology looking for an improvement in the registration. For detecting the edges to be swapped we employ a cost function based on the mutual information (MI), a metric for registration consistency more robust to image radiometric differences than other well-known metrics such as normalized cross correlation (NCC). The proposed method has been successfully tested with different sets of test images, both synthetic and real, acquired from different angles and lighting conditions.     

基于FCN和互信息的医学图像配准技术研究

针对传统配准方法在进行三维多模态图像配准时存在收敛速度较慢、容易陷入极值等问题,提出一种基于全卷积神经网络（Fully Convolutional Networks,FCN）和互信息的配准方法。利用FCN模型提取二维图像深层特征并进行粗配准;将得到的配准结果作为互信息算法的初始搜索点,从而使搜索范围缩小至全局最优解附近;利用互信息算法对参数进一步微调优化,得到最优三维配准结果。实验结果表明,在进行CT-MR图像配准时,所提方法不仅可以大幅度提升配准速度,还能有效避免局部收敛的情况,具有更高的准确性。     

Three-dimensional image mosaicking using multiple projection planes for 3-D visualization of roadside standing buildings.

A novel image-mosaicking technique suitable for 3-D visualization of roadside buildings on websites or mobile systems is proposed. Our method was tested on a roadside building scene taken using a side-looking video camera employing a continuous set of vertical-textured planar faces. A vertical plane approximation of the scene geometry for each frame was calculated using sparsely distributed feature points that were assigned 3-D data through bundle adjustments. These vertical planes were concatenated to create an approximate model on which the images could be backprojected as textures and blended together. Additionally, our proposed method includes an expanded crossed-slits projection around far-range areas to reduce the "ghost effect," a phenomenon in which a particular object appears repeatedly in a created image mosaic. The final step was to produce seamless image mosaics using Dijkstra's algorithm to find the optimum seam line to blend overlapping images. We used our algorithm to create efficient image mosaics in 3-D space from a sequence of real images.     

Wavelet-based image registration technique for high-resolution remote sensing images

Image registration is the process of geometrically aligning one image to another image of the same scene taken from different viewpoints at different times or by different sensors. It is an important image processing procedure in remote sensing and has been studied by remote sensing image processing professionals for several decades. Nevertheless, it is still difficult to find an accurate, robust, and automatic image registration method, and most existing image registration methods are designed for a particular application. High-resolution remote sensing images have made it more convenient for professionals to study the Earth; however, they also create new challenges when traditional processing methods are used. In terms of image registration, a number of problems exist in the registration of high-resolution images: (1) the increased relief displacements, introduced by increasing the spatial resolution and lowering the altitude of the sensors, cause obvious geometric distortion in local areas where elevation variation exists; (2) precisely locating control points in high-resolution images is not as simple as in moderate-resolution images; (3) a large number of control points are required for a precise registration, which is a tedious and time-consuming process; and (4) high data volume often affects the processing speed in the image registration. Thus, the demand for an image registration approach that can reduce the above problems is growing. This study proposes a new image registration technique, which is based on the combination of feature-based matching (FBM) and area-based matching (ABM). A wavelet-based feature extraction technique and a normalized cross-correlation matching and relaxation-based image matching techniques are employed in this new method. Two pairs of data sets, one pair of IKONOS panchromatic images from different times and the other pair of images consisting of an IKONOS panchromatic image and a QuickBird multispectral image, are used to evaluate the proposed image registration algorithm. The experimental results show that the proposed algorithm can select sufficient control points semi-automatically to reduce the local distortions caused by local height variation, resulting in improved image registration results.     

基于遗传算法的深度图像配准方法研究

深度图像配准主要应用于物体三维建模、历史建筑修复重建、虚拟博物馆、利用虚拟现实界面教学,以及复杂结构分析等广泛领域.遗传算法多用于深度图像粗配准,但通过加强其局部搜索能力,也能实现细配准.系统论述了遗传算法在深度图像图像配准的应用,并通过实验加以具体说明.     

Hand-held 3D scanning based on coarse and fine registration of multiple range images

A hand-held 3D scanning technique is proposed to reconstruct 3D models of real objects. A sequence of range images captured from a hand-held stereo camera is automatically registered to a reference coordinate system. The automated scanning process consists of two states, coarse and fine registration. At the beginning, scanning process starts at the fine registration state. A fast and accurate registration refinement technique is used to align range images in a pair-wise manner. If the refinement technique fails, the process changes to the coarse registration state. A feature-based coarse registration technique is proposed to find correspondences between the last successful frame and the current frame. If the coarse registration successes, the process returns to the fine registration state again. A fast point-to-plane refinement technique is employed to do shape-based registration. After the shape-based alignment, a texture-based refinement technique matches texture features to enhance visual appearance of the reconstructed models. Through a graphic and video display, a human operator adjusts the pose of the camera to change the view of the next acquisition. Experimental results show that 3D models of real objects are reconstructed from sequences of range images.     

宽基线视差图像的拼接算法

针对两幅视差图像的拼接问题,提出了一种新算法,即利用Hessian仿射不变检测算子检测出特征区域,利用SIFT特征描述算子提取特征区域特征矢量,根据特征矢量的欧几里德距离来建立图像间的稀疏对应关系;由这些对应点稀疏地确定场景中的一些点,以这些点为顶点建立场景的三角面片近似,再据此将重叠区域重投影生成推扫式成像的中间部分图像。将中间部分推扫式成像图像和原左图像的左半部分以及原右图像的右半部分一起拼接生成大图像。利用实际图像进行的拼接实验表明该算法是一个有效的视差图像拼接算法。     

3D Reconstruction of Indoor Scenes via Image Registration

With the development of computer vision technologies, 3D reconstruction has become a hotspot. At present, 3D reconstruction relies heavily on expensive equipment and has poor real-time performance. In this paper, we aim at solving the problem of 3D reconstruction of an indoor scene with large vertical span. In this paper, we propose a novel approach for 3D reconstruction of indoor scenes with only a Kinect. Firstly, this method uses a Kinect sensor to get color images and depth images of an indoor scene. Secondly, the combination of scale-invariant feature transform and random sample consensus algorithm is used to determine the transformation matrix of adjacent frames, which can be seen as the initial value of iterative closest point (ICP). Thirdly, we establish the relative coordinate relation between pair-wise frames which are the initial point cloud data by using ICP. Finally, we achieve the 3D visual reconstruction model of indoor scene by the top-down image registration of point cloud data. This approach not only mitigates the sensor perspective restriction and achieves the indoor scene reconstruction of large vertical span, but also develops the fast algorithm of indoor scene reconstruction with large amount of cloud data. The experimental results show that the proposed algorithm has better accuracy, better reconstruction effect, and less running time for point cloud registration. In addition, the proposed method has great potential applied to 3D simultaneous location and mapping.     

二维点轮廓与矢量轮廓配准研究

在平面类零件的光学测量中,二维点轮廓与矢量轮廓的配准是关键算法,配准精度 直接影响测量精度。针对平面类零件的配准问题,提出了基于形状特征函数的粗配准算法和二维 矢量最近点迭代(ICP)精配准算法。利用角度距离图法将矢量图形的几何信息转化为独立于坐标系 的连续函数,进而实现粗配准算法。基于平面上点与曲线的最近距离算法计算配准目标函数,给 出了不同于传统的ICP 算法的直接求解目标函数的解析方法,有效提高了算法效率。利用实例验 证分析了该算法的高效性和可靠性。     

一种快速的三维扫描数据自动配准方法

研究了两幅和多幅深度图像的自动配准问题.在配准两幅深度图像时,结合二维纹理图像配准深度图像,具体过程是:首先,从扫描数据中提取纹理图像,特别地,针对不包含纹理图像的扫描数据提出了一种根据深度图像直接生成纹理图像的方法;然后,基于SIFT(scale-invariant feature transform)特征提取纹理图像中的兴趣像素,并通过预过滤和交叉检验兴趣像素等方法从中找出匹配像素对的候选集;之后,使用RANSAC(random sample consensus)算法,根据三维几何信息的约束找出候选集中正确的匹配像素对和相对应的匹配顶点对,并根据这些匹配顶点对计算出两幅深度图像间的刚体置换矩阵;最后,使用改进的ICP(iterative closest point)算法优化这一结果.在配准多幅深度图像时,提出了一种快速构建模型图的方法,可以避免对任意两幅深度图像作配准,提高了配准速度.该方法已成功应用于多种文物的三维逼真建模.     

基于边缘最优映射的红外和可见光图像自动配准算法

针对同一场景的红外和可见光图像间一致特征难以提取和匹配的难题, 提出了一种在多尺度空间中基于边缘最优映射的自动配准算法. 在由粗至细的尺度空间中, 算法分别采用仿射模型和投影模型作为参考图像和待配准图像间的空间变换模型. 在每个尺度层上, 首先基于相位一致性方法提取两幅图像的边缘结构, 并在相应的空间变换模型下将在待配准图像中提取的二值边缘映射到参考图像的边缘强度图上; 接着采用并行遗传算法寻找一组全局最优的模型参数, 使两幅图像间的结构相似度最大. 在各层的寻优结束之后, 使用Powell算法对全局寻优后的模型参数进行局部精化. 实验结果表明, 该算法能够充分利用图像间的视觉相似结构, 有效地实现红外和可见光图像的自动配准.     

姿态估计算法在古建筑室内环境中的应用研究

摄像机姿态估计是影响三维注册成功与否的关键技术,目前在基于基本矩阵的估计中最流行的是八点算法,但八点算法针对平面场景出现明显的退化,因此在针对古建筑室内环境的注册应用中,为了扩大场景的适用范围,利用计算机视觉技术,对基于五点算法和八点算法的两种算法进行研究。以盒子结构为古建筑的室内环境结构进行模拟,结果表明,五点算法较八点算法恢复的三维模型有更高的精确性。     

结合纹理信息的深度像匹配

利用图像的相关性在不同深度像对应的纹理图中自动选取特征点对;然后根据Hausdorff距离判断对应点对的有效性,并利用这些对应点对获得相应的深度点对,从而计算出2个深度像之间的初始位置变换关系;最后结合一种改进的带纹理的ICP算法实现深度像的精确配准.实验结果证明:该算法不仅适用于自由曲面的深度像匹配,而且适用于规则对称物体的匹配.     

A fast and efficient image registration algorithm using outlier rejection technique based on subimage

Image registration is a process of overlaying two or more images of the same scene taken at different times, from different viewpoints, and by different sensors. It geometrically aligns two images, the reference and sensed image. In this paper, a fast and efficient image registration algorithm is proposed for IDS (Intruder Detection System). To reduce a calculation time, outlier rejection method based on uniformity, entropy and subimage is used. An edge tapering method is applied to alleviate a boundary effect of a subimage. And it is shown that the proposed algorithm improves the accuracy and calculation time effectively.     

Extracting objects from range and radiance images

In this paper, we present a pipeline and several key techniques necessary for editing a real scene captured with both cameras and laser range scanners. We develop automatic algorithms to segment the geometry from range images into distinct surfaces, register texture from radiance images with the geometry, and synthesize compact high-quality texture maps. The result is an object-level representation of the scene which can be rendered with modifications to structure via traditional rendering methods. The segmentation algorithm for geometry operates directly on the point cloud from multiple registered 3D range images instead of a reconstructed mesh. It is a top-down algorithm which recursively partitions a point set into two subsets using a pairwise similarity measure. The result is a binary tree with individual surfaces as leaves. Our image registration technique performs a very efficient search to automatically find the camera poses for arbitrary position and orientation relative to the geometry. Thus, we can take photographs from any location without precalibration between the scanner and the camera. The algorithms have been applied to large-scale real data. We demonstrate our ability to edit a captured scene by moving, inserting, and deleting objects     

基于Fourier-Mellin变换的图像配准方法及应用拓展

从两个方面拓展了基于Fourier—Mellin变换的图像配准方法的应用范围．首先是全景图像的拼接．不同于传统的方法,该方法不需要准确控制相机的运动,小需要知道相机的焦距等内部参数．也不需要检测图像特征,在配准精度要求不是很高的情况下,直接生成的全景图像可以满足很多实际应用的需要;同时,实验也表明,该方法应用于弱透视图像的配准．也具有很好的配准效果．另一个拓展是图像曲线的匹配．传统的曲线匹配方法一般通过曲线特征点（如角点、曲率极值点等）之间的对应求得曲线间的变换参数．一种新的思想是先将图像曲线转化为二值图像,然后应用Fourier—Mellin变换对这些二值图像进行配准,从而达到对两条曲线的匹配．大量实验表明,该方法对射影畸变不是十分显著且摄像机为一般运动下获得的图像之间的配准问题（如手持数码相机获取的图像之间的配准问题）均能取得比较好的配准效果．     

基于GPU的快速三维医学图像刚性配准技术*

自动三维配准将多个图像数据映射到同一坐标系中,在医学影像分析中有广泛的应用。但现有主流三维刚性配准算法(如FLIRT)速度较慢,2563大小数据的刚性配准需要300 s左右,不能满足快速临床应用的需求。为此提出了一种基于CUDA(compute unified device architecture)架构的快速三维配准技术,利用GPU(gra-phic processing unit)并行计算实现配准中的坐标变换、线性插值和相似性测度计算。临床三维医学图像上的实验表明,该技术在保持配准精度的前提下将速度提     

一种基于结构特征边缘的多传感器图像配准方法

图像配准是多传感器图像融合等处理的前提. 本文以包含人造目标的合成孔径雷达(Synthetic aperture radar, SAR)图像和可见光图像为处理对象, 提出了一种基于结构特征边缘的多传感器图像配准方法. 该方法提取人造目标在两类图像中表现的共性特征---结构特征边缘, 并基于边缘匹配构造虚拟角点, 采用基于特征一致的粗配准方法和基于虚拟角点的精配准方法, 对待配准图像实现由粗到精的自动配准. 实验结果表明, 本文方法能够取得较高的配准精度.