基于视觉特征的多传感器图像配准

多传感器图像配准在空间图像处理中有非常重要的应用价值,但同时也面临着多源空间数据各异性困难。考虑到图像配准过程中的多分辨率视觉特征,采用基于小波的多分辨率图像分解来指导从粗到细的配准过程,利用扩展的轮廓跟踪算法提取满足视觉特征的轮廓,在轮廓链码曲率函数的基础上实现基于傅里叶变换的多分辨率形状特征匹配。与已有的基于特征的图像配准算法进行实验比较,实验结果表明该方法对于从多传感器得到的异质图像具有良好的配准效果。     

基于干线对的红外与可见光最优图像配准算法

提出了一种基于干线对的红外与可见光图像配准算法.该算法分4步:首先分别从基准图像和待配准图像中提取干线对,即对图像中满足特定条件的直线进行配对;然后按照一些准则寻找这两幅图像中的干线对所有可能的匹配情况,并组成一个集合;接着从该集合中寻找这样一个子集,在保证每个干线对最多出现在它的一个元素中的前提下,使得该子集所有元素的相似性测度之和最大且由它确定的配准误差最小,该文采用分支定限法解决了这一优化问题;最后由最优子集中的所有元素得到同名像点集,运用仿射变换模型,实现图像的配准.大量实验表明,文中提出的方法对红外与可见光遥感图像之间的配准是有效的.     

Matching conjugate points between multi-resolution satellite images using geometric and radiometric properties

Remotely sensed images are the main source for a variety of mapping and change-detection applications. Images from different satellites are employed in several of these applications. However, each type of these images has a different resolution and orientation. Hence, they need to be co-registered before any meaningful use. The first step in the registration process is to find conjugate points between the images. This paper presents a modified method of the Scott and Longuet-Higgins approach to find conjugate points between different remotely sensed images. In such an algorithm, initially, corner points are automatically extracted in two images, and for each pair of points, a cost value is computed. The cost of corresponding any two points is computed using two-dimensional transformation models and pixel intensities. The cost values are then used to fill a cost matrix, and its singular value decomposition is used to find corresponding points. The algorithm is tested on three pairs of satellite images with different resolutions and orientations. The results show that the approach presented here succeeded in finding 93% of conjugate points between different pairs of satellite images using only the image coordinates through the eight-parameter transformation model. Moreover, the results show that including the image intensities in the matching procedure does change the results significantly.     

使用特征点与曲线配准医学图像

针对单一特征引导医学图像配准的准确度有限性,提出一种使用多种特征的图像配准方法.特征提取采用半自动化方式,使操作者能够精确地获得图像特征.对提取的曲线对采用非均匀三次B样条建立模型,使曲线对具有相同的参数区间;非均匀的曲线离散机制保证了离散后的点集在尽可能忠实于原曲线,同时又满足图像配准的要求;通过不断地改善曲线间差异最大的区域并持续添加的约束条件,迭代地求解变换函数.实验结果表明:该算法结合了基于特征点与曲线2种配准算法的优点,既保证了基于点配准的精确性,又兼有基于曲线配准的鲁棒性,是一种有效的医学图像配准方法.     

基于边缘最优映射的红外和可见光图像自动配准算法

针对同一场景的红外和可见光图像间一致特征难以提取和匹配的难题, 提出了一种在多尺度空间中基于边缘最优映射的自动配准算法. 在由粗至细的尺度空间中, 算法分别采用仿射模型和投影模型作为参考图像和待配准图像间的空间变换模型. 在每个尺度层上, 首先基于相位一致性方法提取两幅图像的边缘结构, 并在相应的空间变换模型下将在待配准图像中提取的二值边缘映射到参考图像的边缘强度图上; 接着采用并行遗传算法寻找一组全局最优的模型参数, 使两幅图像间的结构相似度最大. 在各层的寻优结束之后, 使用Powell算法对全局寻优后的模型参数进行局部精化. 实验结果表明, 该算法能够充分利用图像间的视觉相似结构, 有效地实现红外和可见光图像的自动配准.     

基于SIFT特征的眼底图像自动拼接

针对眼底图像对比度低、不同视场的图像间存在几何畸变等特点,提出一种基于SIFT特征的眼底图像自动拼接算法。该算法分别提取待拼接眼底图像的SIFT特征点,并用向量进行描述,确定两幅图像特征点的匹配关系,使用MLESAC算法去除误匹配点对,提出对特征点对提纯的距离-斜率相似测度方法,计算匹配点之间的透视变换矩阵,最后进行图像配准和拼接。对实际眼底照相机获取的多幅图像拼接结果表明,该算法具有很好的鲁棒性和稳健性,可以实现眼底图像的高精度自动拼接。     

基于弦高点和遗传算法的仿射配准

针对复杂场景中目标由于成像畸变、部分遮挡和局部缺失难于识别的难题, 提出了一种新的特征点——弦高点, 将其和遗传算法相结合用于图像的仿射配准. 算法首先给出了弦高点的定义, 并证明了其仿射不变性; 然后,应用遗传算法搜索模型和目标轮廓上两对对应点, 以弦高点作为第三对对应点, 求解最优的仿射变换矩阵; 最后,对遗传算法搜索的结果再进行线性搜索, 提高配准的精度. 本文利用 LTS Hausdorff距离(Least trimmed square Hausdorff distance, LTS-HD) 进行度量, 能有效克服部分遮挡或局部缺失的影响. 由于采用遗传算法, 并只需搜索两对对应点, 配准的速度得到提高. 理论分析和实验结果均表明, 该算法能有效地进行仿射配准, 并能处理部分遮挡或局部缺失.     

基于P样条和局部互信息的非刚性医学图像配准*

为了克服互信息仅考虑两幅图像相应像素的灰度信息,忽略了图像本身的内在空间信息,以及B样条变换模型存在形变场奇异点的缺陷,提出一种基于P样条和局部互信息的非刚性医学图像配准方法。该方法以局部互信息为相似性测度,采用P样条变换模型模拟待配准图像的几何形变,然后使用三次插值算法对图像像素进行赋值,结合对大规模参数优化效率高的LBFGS算法对配准参数进行优化。实验结果表明,该方法较传统的互信息和B样条变换模型都有效地提高了配准的精度。     

结合SIFT和Delaunay三角网的遥感图像配准算法

针对高分辨率遥感图像中提取的特征点数目过大且易存在误匹配点的问题,提出了一种粗配准和精配准相结合的高分辨率遥感图像配准算法.首先对图像降采样处理后,提取大尺度空间下的SIFT特征点,求得仿射变换模型完成图像粗配准;然后对图像进行分块,利用SIFT方法对每幅子块图像提取特征点,并找到对应子块图像之间的匹配点对;之后利用特征点构建Delaunay三角网,计算每对子块图像之间的三角形相似度,构成相似矩阵,从中挑选相似度大的三角形对以构成精确匹配点对;最后利用得到的精确匹配点对实现最终的图像配准.该算法能够减少提取的特征点数且剔除更多的错误匹配点,从而进一步提高精确匹配点率.实验结果表明了算法的有效性.     

结合SURF特征和RANSAC算法的图像配准方法

提出了一种基于SURF特征和RANSAC算法的图像配准方法。首先通过SURF算法对图像进行特征点检测,将欧式距离作为相似性测度进行特征点粗匹配,并通过RANSAC算法剔除误匹配点对;然后利用正确的匹配点对求解仿射变换模型从而实现图像的精确配准。实验结果表明了该方法的精确性和有效性。     

针对大视差图像拼接的显性子平面配准

目的 针对图像拼接中大视差图像难以配准的问题,提出一种显性子平面自动配准算法。方法 假设大视差图像包含多个显性子平面且每个平面内所含特征点密集分布。对该假设进行了验证性实验。所提算法以特征点分布为依据,通过聚类算法实现子平面分割,进而对子平面进行局部配准。首先,使用层次聚类算法对已匹配的特征点聚类,通过一种本文设计的拼接误差确定分组数目,并以各组特征点的聚类中心为新的聚类中心对重叠区域再聚类,分割出目标图像的显性子平面。然后,求解每个显性子平面的投影参数,并采用就近原则分配非重叠区域的单应性矩阵。结果 采用公共数据集对本文算法进行测试,并与Auto-Stitching、微软Image Composite Editor两种软件及全局投影拼接方法（Baseline）、尽可能投影算法（APAP）进行对比,采用均方根误差作为配准精度的客观评判标准。实验结果表明,该算法在拼接大视差图像时,能有效地配准局部区域,解决软件和传统方法由误配准引起的鬼影、错位等问题。其均方根误差比Baseline方法平均减小55%左右。与APAP算法相比,均方根误差平均相差10%左右,但可视化配准效果相同且无需调节复杂参数,可实现自动配准。结论 提出的显性子平面自动配准算法,通过分割图像所含子平面进而实现局部配准。该方法具有较高的配准精度,在大视差图像配准方面,优于部分软件及算法,可应用于图像拼接中大视差图像的自动配准。     

基于SIFT算法的红外图像拼接方法改进

针对红外图像拼接误匹配点过多、耗时过长等问题, 对基于SIFT算法的红外图像拼接方法进行改进. 首先利用高斯差分金字塔建立尺度空间, 然后利用FAST算法对高斯差分金字塔图像进行特征点提取, 提高了算法运行效率, 随后以特征向量的欧式距离作为特征点的相似性度量, 从而找到初始匹配点对, 并利用结合了方向一致性判断的Ransac算法剔除错误匹配点对, 最后用加权平衡算法实现图像的快速融合. 通过红外人物图像拼接实验, 证明改进后的算法在旋转、缩放、光照等情况下更稳定、效率更高, 有较大的理论和应用价值.     

基于图像配准的数字减影图像增强研究

提出了一种基于图像配准的数字减影图像增强算法,通过选择合适的控制点和相似尺度,并采用快速样条插值算法以及鲍威尔优化搜索方法,用块匹配方法对造影图像和掩膜图像配准,配准后的减影图像质量良好,并且该算法具有较快的计算速度。     

一种基于角点特征的图像自动配准方法

图像配准是图像处理和计算机视觉中的重要环节。提出了一种基于角点特征的图像自动配准方法来处理具有相似变换的图像配准问题。角点特征由改进的Harris算子提取,然后将提取的角点组成虚拟三角形,利用在相似变换下参考图像和待配准图像中对应的虚拟三角形相似的原理,找到最相似的两个虚拟三角形,以它们对应的顶点作为控制点,求出变换模型参数,从而配准两幅图像。该方法只要求两幅图像中提取的角点特征包含3个以上的对应角点,就能配准两幅图像。它的另一个优点是理论上对两幅图像之间发生的平移、旋转和尺度变化没有限制。实验结果表明:这种图像自动配准算法是正确和有效的。     

A feature-based, robust, hierarchical algorithm for registeringpairs of images of the curved human retina

This paper describes a robust hierarchical algorithm for fully-automatic registration of a pair of images of the curved human retina photographed by a fundus microscope. Accurate registration is essential for mosaic synthesis, change detection, and design of computer-aided instrumentation. Central to the algorithm is a 12-parameter interimage transformation derived by modeling the retina as a rigid quadratic surface with unknown parameters. The parameters are estimated by matching vascular landmarks by recursively tracing the blood vessel structure. The parameter estimation technique, which could be generalized to other applications, is a hierarchy of models and methods, making the algorithm robust to unmatchable image features and mismatches between features caused by large interframe motions. Experiments involving 3,000 image pairs from 16 different healthy eyes were performed. Final registration errors less than a pixel are routinely achieved. The speed, accuracy, and ability to handle small overlaps compare favorably with retinal image registration techniques published in the literature     

快速数字影像重建的2维/3维医学图像配准

目的 针对2D/3D医学图像配准过程中数字影像重建技术(DRR)生成图像和相似性程度测量两个步骤计算量大、耗时较长这一问题,提出了一种基于Bresenham直线生成算法改进的模式强度与梯度相结合的混合配准算法.方法 首先利用Bresenham直线生成算法原理改进传统光线投射算法(Ray-Casting),完成DRR图像的生成;其次模式强度与梯度相结合并引入多分辨率策略来降低相似性测度的计算复杂度;最终利用改进的鲍威尔优化算法对参数进行优化,完成整个配准过程.结果 实验结果表明,改进的混合配准算法与基于相关系数、互信息和模式强度的配准算法相比,配准效率大幅提升.模拟配准实验和临床配准实验完成时间分别为76.2 s和64.9 s,比传统配准算法效率提升3~6倍.结论 提出的算法在保证配准精度和高鲁棒性的前提下,大幅度地提高了2D/3D医学图像配准算法的运算速度,可以满足临床上精确引导手术进行的实时性要求.     

Wavelet-based image registration technique for high-resolution remote sensing images

Image registration is the process of geometrically aligning one image to another image of the same scene taken from different viewpoints at different times or by different sensors. It is an important image processing procedure in remote sensing and has been studied by remote sensing image processing professionals for several decades. Nevertheless, it is still difficult to find an accurate, robust, and automatic image registration method, and most existing image registration methods are designed for a particular application. High-resolution remote sensing images have made it more convenient for professionals to study the Earth; however, they also create new challenges when traditional processing methods are used. In terms of image registration, a number of problems exist in the registration of high-resolution images: (1) the increased relief displacements, introduced by increasing the spatial resolution and lowering the altitude of the sensors, cause obvious geometric distortion in local areas where elevation variation exists; (2) precisely locating control points in high-resolution images is not as simple as in moderate-resolution images; (3) a large number of control points are required for a precise registration, which is a tedious and time-consuming process; and (4) high data volume often affects the processing speed in the image registration. Thus, the demand for an image registration approach that can reduce the above problems is growing. This study proposes a new image registration technique, which is based on the combination of feature-based matching (FBM) and area-based matching (ABM). A wavelet-based feature extraction technique and a normalized cross-correlation matching and relaxation-based image matching techniques are employed in this new method. Two pairs of data sets, one pair of IKONOS panchromatic images from different times and the other pair of images consisting of an IKONOS panchromatic image and a QuickBird multispectral image, are used to evaluate the proposed image registration algorithm. The experimental results show that the proposed algorithm can select sufficient control points semi-automatically to reduce the local distortions caused by local height variation, resulting in improved image registration results.     

基于仿射变换模型的图象特征点集配准方法研究

图象配准是计算机视觉中目标识别的一种基本方法,其目的是在待识别图象中寻找与模型图象的最佳匹配.目前,对于图象间的变换为相似变换的情形已有闭合公式.本文则分别运用最小二乘和矩阵伪逆两种方法,对图象间的变换为仿射变换的情形进行了研究,并给出了简单的闭合公式.实验表明这种方法精确、稳定、受噪声影响小.     

基于Hausdorff距离图象配准方法研究

图象配准是图象融合的一个重要步骤，为此提出了一种自动图象配准算法，该算法从两幅待配准的图象中分别抽取特征点，然后选用Hausdorff距离对两特征点集进行匹配，得到点集间的仿射变换，从而实现图象的自动配准，此算法以特征点而不是物体边缘计算仿射变换，大大降低了计算Hausdorff距离的运算量；同时，基于Hausdorff距离的图象匹配只需要点集之间的对应，而无须点与点的对应，因而可以使用于存在较大物体形变的情况，即完成两幅差异较大图象的配准，实验结果证明了算法的有效性。     

Registration of challenging image pairs: initialization, estimation, and decision

Our goal is an automated 2D-image-pair registration algorithm capable of aligning images taken of a wide variety of natural and man-made scenes as well as many medical images. The algorithm should handle low overlap, substantial orientation and scale differences, large illumination variations, and physical changes in the scene. An important component of this is the ability to automatically reject pairs that have no overlap or have too many differences to be aligned well.We propose a complete algorithm, including techniques for initialization, for estimating transformation parameters, and for automatically deciding if an estimate is correct. Keypoints extracted and matched between images are used to generate initial similarity transform estimates, each accurate over a small region. These initial estimates are rank-ordered and tested individually in succession. Each estimate is refined using the Dual-Bootstrap ICP algorithm, driven by matching of multiscale features. A three-part decision criteria, combining measurements of alignment accuracy, stability in the estimate, and consistency in the constraints, determines whether the refined transformation estimate is accepted as correct. Experimental results on a data set of 22 challenging image pairs show that the algorithm effectively aligns 19 of the 22 pairs and rejects 99.8% of the misalignments that occur when all possible pairs are tried. The algorithm substantially out-performs algorithms based on keypoint matching alone.