A fast and efficient image registration algorithm using outlier rejection technique based on subimage

Image registration is a process of overlaying two or more images of the same scene taken at different times, from different viewpoints, and by different sensors. It geometrically aligns two images, the reference and sensed image. In this paper, a fast and efficient image registration algorithm is proposed for IDS (Intruder Detection System). To reduce a calculation time, outlier rejection method based on uniformity, entropy and subimage is used. An edge tapering method is applied to alleviate a boundary effect of a subimage. And it is shown that the proposed algorithm improves the accuracy and calculation time effectively.     

一种基于角点特征的图像自动配准方法

图像配准是图像处理和计算机视觉中的重要环节。提出了一种基于角点特征的图像自动配准方法来处理具有相似变换的图像配准问题。角点特征由改进的Harris算子提取,然后将提取的角点组成虚拟三角形,利用在相似变换下参考图像和待配准图像中对应的虚拟三角形相似的原理,找到最相似的两个虚拟三角形,以它们对应的顶点作为控制点,求出变换模型参数,从而配准两幅图像。该方法只要求两幅图像中提取的角点特征包含3个以上的对应角点,就能配准两幅图像。它的另一个优点是理论上对两幅图像之间发生的平移、旋转和尺度变化没有限制。实验结果表明:这种图像自动配准算法是正确和有效的。     

Fingerprint image mosaicking by recursive ridge mapping.

To obtain a large fingerprint image from several small partial images, mosaicking of fingerprint images has been recently researched. However, existing approaches cannot provide accurate transformations for mosaics when it comes to aligning images because of the plastic distortion that may occur due to the nonuniform contact between a finger and a sensor or the deficiency of the correspondences in the images. In this paper, we propose a new scheme for mosaicking fingerprint images, which iteratively matches ridges to overcome the deficiency of the correspondences and compensates for the amount of plastic distortion between two partial images by using a thin-plate spline model. The proposed method also effectively eliminates erroneous correspondences and decides how well the transformation is estimated by calculating the registration error with a normalized distance map. The proposed method consists of three phases: feature extraction, transform estimation, and mosaicking. Transform is initially estimated with matched minutia and the ridges attached to them. Unpaired ridges in the overlapping area between two images are iteratively matched by minimizing the registration error, which consists of the ridge matching error and the inverse consistency error. During the estimation, erroneous correspondences are eliminated by considering the geometric relationship between the correspondences and checking if the registration error is minimized or not. In our experiments, the proposed method was compared with three existing methods in terms of registration accuracy, image quality, minutia extraction rate, processing time, reject to fuse rate, and verification performance. The average registration error of the proposed method was less than three pixels, and the maximum error was not more than seven pixels. In a verification test, the equal error rate was reduced from 10% to 2.7% when five images were combined by our proposed method. The proposed method was superior to other compared methods in terms of registration accuracy, image quality, minutia extraction rate, and verification.     

结合模型限制和灰度信息的图像配准算法

由于噪声和成像条件的不同,准确得到两幅图像中提取的点特征之间的对应性是基于点特征的图像配准方法的一个难点.为此,文中提出了一种新的基于点特征的图像配准算法.该方法结合图像之间的拓扑关系和点特征之间的相似性,并利用变换模型限制求解点特征之间的对应性,然后根据对应的点特征求解变换模型参数,配准两幅图像.实验结果表明,所提出的方法对传感器相近的图像之间的配准是正确有效的.     

纸币清分系统中的纸币污损检测

针对纸币上常见的笔划及撕裂, 提出了一种基于均匀性特征的污损检测方法. 首先利用均匀性特征判定待检纸币上可能存在污损的区域, 然后进行图像配准, 确定这些区域在参考图像上的对应位置, 并逐像素进行比较, 最终判定待检图像的污损状况.     

基于NCC的存在旋转的图像匹配方法

图像匹配在导航制导、医学等领域具有十分重要的意义。由于实时图和参考图拍摄的时间不一样,容易存在旋转等现象,给图像的匹配带来很大难度。传统的归一化互相关(NCC)匹配算法是一种简单有效的匹配算法,但不适合存在旋转这种情况。在NCC匹配方法的基础上,利用参考图的多个角度的旋转达到匹配的目的,从而找出准确的匹配位置,并利用所得控制点和坐标转换模型找出参考图与实时图之间的相对位置关系,包括旋转角度与相对位移。仿真实验表明:此方法可较好地解决存在旋转的图像匹配问题。     

基于引导滤波和差分图像的多聚焦图像融合方法

针对传统的多聚焦图像的空间域融合容易出现边缘模糊的问题,提出了一种基于引导滤波(GF)和差分图像的多聚焦图像融合方法.首先,将源图像进行不同水平的GF,并对滤波后图像进行差分,从而获得聚焦特征图像;随后,利用聚焦特征图像的梯度能量(EOG)信息获得初始决策图,对初始决策图进行空间一致性检查以及形态学操作以消除因EOG相...     

基于多传感器图像融合技术的鲁棒景象匹配算法

将多个传感器获取的具有不同大小、不同分辨力和不同信噪比的实时图基于Kalm an滤波的方法进行融合,以提高实时图的性能;搜索融合后的实时图在基准图中的位置达到目标定位之目的,即进行景象匹配。在景象匹配过程中,选用归一化互相关系数作为相似性度量。多组实验与分析表明:所介绍的基于多传感器图像融合技术的景象匹配算法可以有效地解决实时图存在部分遮挡、灰度与对比度变化以及复杂噪声干扰等影响下的景象匹配问题。     

A multi-resolution area-based technique for automatic multi-modal image registration

To allow remotely sensed datasets to be used for data fusion, either to gain additional insight into the scene or for change detection, reliable spatial referencing is required. With modern remote sensing systems, reliable registration can be gained by applying an orbital model for spaceborne data or through the use of global positioning (GPS) and inertial navigation (INS) systems in the case of airborne data. Whilst, individually, these datasets appear well registered when compared to a second dataset from another source (e.g., optical to LiDAR or optical to radar) the resulting images may still be several pixels out of alignment. Manual registration techniques are often slow and labour intensive and although an improvement in registration is gained, there can still be some misalignment of the datasets. This paper outlines an approach for automatic image-to-image registration where a topologically regular grid of tie points was imposed within the overlapping region of the images. To ensure topological consistency, tie points were stored within a network structure inspired from Kohonen’s self-organising networks [24]. The network was used to constrain the motion of the tie points in a manner similar to Kohonen’s original method. Using multiple resolutions, through an image pyramid, the network structure was formed at each resolution level where connections between the resolution levels allowed tie point movements to be propagated within and to all levels. Experiments were carried out using a range of manually registered multi-modal remotely sensed datasets where known linear and non-linear transformations were introduced against which our algorithm’s performance was tested. For single modality tests with no introduced transformation a mean error of 0.011 pixels was identified increasing to 3.46 pixels using multi-modal image data. Following the introduction of a series of translations a mean error of 4.98 pixels was achieve across all image pairs while a mean error of 7.12 pixels was identified for a series of non-linear transformations. Experiments using optical reflectance and height data were also conducted to compare the manually and automatically produced results where it was found the automatic results out performed the manual results. Some limitations of the network data structure were identified when dealing with very large errors but overall the algorithm produced results similar to, and in some cases an improvement over, that of a manual operator. We have also positively compared our method to methods from two other software packages: ITK and ITT ENVI.     

基于图像配准的零件轮廓修正方法

针对智能机床视觉系统提取待加工零件边缘轮廓时易受到背景干扰,导致其提取出的零件轮廓中包含异常区域的问题,提出一种基于图像配准的高精度零件轮廓修正方法。首先,从零件工程图与真实图像当中提取出零件模板特征点集与待匹配特征点集;其次,对仿射变换模型中的参数进行分解分析,并利用两图特征点集中的面积特征与边缘结构特征构建准则函数;然后,使用改进的遗传算法搜索两图像全局最高相似度所对应的仿射变换参数,在图像配准之后,再通过计算最优迁移后的模板轮廓点集与待匹配轮廓点集的分段Hausdorff距离来检测并替换待匹配轮廓中的异常轮廓段。实验结果表明,该方法能精确、稳定地检测出待匹配轮廓点集中的异常轮廓段,配准精度比联合特征均方和（SSJF）方法高出50%,修正后轮廓交接点处的距离不超过3像素值。     

一种基于联合表示的图像分类方法

在图像分类识别中,对于同一目标的不同图像,其训练样本和测试样本在同一位置的像素强度通常不同,这不利于提取目标图像的显著特征。这里给出一种基于稀疏表示的联合表示的图像分类方法,此方法首先利用相邻列之间的关系得到原始图像对应的虚拟图像,利用虚拟图像提高图像中中等强度像素的作用,降低过大或过小强度像素对图像分类的影响;然后用同一个目标的原始图像和虚拟图像一起表示目标,得到目标图像的联合表示;最后利用联合表示方法对目标分类。针对不同目标图像库的实验研究表明,给出的联合方法优于利用单一图像进行分类的方法,而且本方法能联合不同的表示方法来提高图像分类正确率。     

Feature matching based on unsupervised manifold alignment

Feature-based methods for image registration frequently encounter the correspondence problem. In this paper, we formulate feature-based image registration as a manifold alignment problem, and present a novel matching method for finding the correspondences among different images containing the same object. Different from the semi-supervised manifold alignment, our methods map the data sets to the underlying common manifold without using correspondence information. An iterative multiplicative updating algorithm is proposed to optimize the objective, and its convergence is guaranteed theoretically. The proposed approach has been tested for matching accuracy, and robustness to outliers. Its performance on synthetic and real images is compared with the state-of-the-art reference algorithms.     

基于改进的Zernike矩的局部描述符与图割离散优化的非刚性多模态脑部图像配准

针对脑部图像中存在噪声和强度失真时，基于结构信息的方法不能同时准确提取图像强度信息和边缘、纹理特征，并且连续优化计算复杂度相对较高的问题，根据图像的结构信息，提出了基于改进Zernike距的局部描述符（IZMLD）和图割（GC）离散优化的非刚性多模态脑部图像配准方法。首先，将图像配准问题看成是马尔可夫随机场（MRF）的离散标签问题，并且构造能量函数，两个能量项分别由位移矢量场的像素相似性和平滑性组成。其次，采用变形矢量场的一阶导数作为平滑项，用来惩罚相邻像素间有较大变化的位移标签；用基于IZMLD计算的相似性测度作为数据项，用来表示像素相似性。然后，在局部邻域中用图像块的Zernike矩来分别计算参考图像和浮动图像的自相似性并构造有效的局部描述符，把描述符之间的绝对误差和（SAD）作为相似性测度。最后，将整个能量函数离散化，并且使用GC的扩展优化算法求最小值。实验结果表明，与基于结构表示的熵图像的误差平方和（ESSD）、模态独立邻域描述符（MIND）和随机二阶熵图像（SSOEI）的配准方法相比，所提算法目标配准误差的均值分别下降了18.78%、10.26%和8.89%，并且比连续优化算法缩短了约20 s的配准时间。所提算法实现了在图像存在噪声和强度失真时的高效精确配准。     

Multisensor image registration via implicit similarity

This paper presents an approach to the registration of significantly dissimilar images, acquired by sensors of different modalities. A robust matching criterion is derived by aligning the locations of gradient maxima. The alignment is achieved by iteratively maximizing the magnitudes of the intensity gradients of a set of pixels in one of the images, where the set is initialized by the gradient maxima locations of the second image. No explicit similarity measure that uses the intensities of both images is used. The computation utilizes the full spatial information of the first image and the accuracy and robustness of the registration depend only on it. False matchings are detected and adaptively weighted using a directional similarity measure. By embedding the scheme in a "coarse to fine" formulation, we were able to estimate affine and projective global motions, even when the images were characterized by complex space varying intensity transformations. The scheme is especially suitable when one of the images is of considerably better quality than the other (noise, blur, etc.). We demonstrate these properties via experiments on real multisensor image sets.     

Fraction images in multitemporal change detection

The concept of mixed pixels allows the interpretation of remote sensing digital image data at sub-pixel level. Fraction-image data, obtained using the notion of mixed pixels, offer a potentially powerful method to detect changes in land-cover over a given period of time. This study proposes a new approach to detect land-cover changes, using two sets of fraction-image data obtained from sets of multispectral image data acquired at two different dates, over the same area. Changes based on the selected pixel components are then used to generate the fraction-change image data, including both positive (increase) and negative (decrease) changes in each component. The proposed analysis is then performed in the fraction-change space in two different ways: (1) by implementing unsupervised classification methods and (2) by comparing the fraction-change images among themselves. The proposed methodology is tested on two sets of Landsat Thematic Mapper (TM) multispectral image data obtained at two different dates and covering a test area mapped in previous works. Results obtained by the proposed methodology are presented and discussed.     

一种改进的基于深度学习的遥感影像拼接方法

针对遥感影像拼接的两个主要过程：图像配准和点变换,分别进行了深入研究。对遥感影像拼接中的特征点匹配问题,提出了一种利用分层卷积特征进行图像配准的方法。该方法利用卷积神经网络（Convolutional Neural Networks,CNN）自适应地提取特征点的分层卷积特征,通过相关滤波器（Correlation Filter,CF）对不同深度的卷积特征逐层进行相关性分析,进而综合计算特征点的位置。然后对传统的点变换方法进行简化,提出十字点集变换方法。根据配准的特征点计算变换参数,实现遥感影像的拼接。实验结果表明,该方法与传统的基于SIFT（Scale Invariant Feature Transform）的拼接方法相比,精度较高且具有较好的鲁棒性。     

Automated accurate registration method between UAV image and Google satellite map

Because Unmanned Aerial Vehicle (UAV) image exhibits low positioning accuracy, the accurate registration of the image is required. Since the viewpoint direction, capturing time and shoot height are considerably different between the UAV image and google satellite map, the existing methods cannot match two images accurately. For the registration between the UAV image and google satellite map, a full-automated image registration method was proposed based on deep convolution feature. Such method consists of five steps: automatically reference images downloading, uniform key point extraction, deep convolution features computation, accurately feature matching and image registration. The reference image was downloaded from google map service according to the approximate location and region of the UAV image. The deep convolution feature was extracted using the pre-trained VGG16 model. Finally, many experiments were performed to verify the efficiency of the proposed method, and the results demonstrate that the proposed method is more effective and robust than the existing method.

     

基于P样条和局部互信息的非刚性医学图像配准*

为了克服互信息仅考虑两幅图像相应像素的灰度信息,忽略了图像本身的内在空间信息,以及B样条变换模型存在形变场奇异点的缺陷,提出一种基于P样条和局部互信息的非刚性医学图像配准方法。该方法以局部互信息为相似性测度,采用P样条变换模型模拟待配准图像的几何形变,然后使用三次插值算法对图像像素进行赋值,结合对大规模参数优化效率高的LBFGS算法对配准参数进行优化。实验结果表明,该方法较传统的互信息和B样条变换模型都有效地提高了配准的精度。