同心拼图中深度的计算

提出一种新的基于图像绘制的方法：多同心拼图法。该方法将摄像机限制在同一平面绕不同中心的同心圆上旋转,产生多个同心拼图。新的图像由已获得的图像插值产生。多同心拼图法是对Shum提出的单同心拼图法的一种有效改进,其主要特点是能消除单同心拼图法中存在的深度畸变现象。多同心拼图法不需要三维重建过程,具有实现方便、计算简单、能实时产生具有真实感的场景图的优点,在虚拟现实和动画生成方面具有比较重要的应用价值。     

多视点平行拼图

提出了一种新的多视点拼图,称之为平行拼图,平行拼图不仅可以应用到基于图像的绘制技术中,而且可以广泛地运用于基于图像的三维重建。该文设计了从真实照片中得到高分辨率平行拼图的算法,建立了从平行拼图得到高精度绘制输出的数学模型,讨论了用照片建立平行拼图的精度上限,并且给出了良好的实验结果。     

基于圆柱面映射的快速图像拼接算法

针对现有基于圆柱面映射的全景图像拼接算法无法实现自动估计焦距的问题,为满足实时性要求,提出了一种基于预测的快速特征点匹配算法,在基于纯旋转运动的自动焦距估计算法基础上,提出了一种基于单应矩阵的焦距修正算法。该算法首先从待拼接图像中提取Harris角点,然后提取方向梯度直方图(Histogram of Oriented Gradient, HOG)描述子进行特征点匹配,基于前一帧图像获得的图像映射关系采用一种基于预测的快速特征点匹配算法,然后使用简化的基于纯旋转运动的焦距估计算法估计出焦距初值,并采用基于单应矩阵的焦距修正算法得到更精确的焦距值,最后将平面图像投影至圆柱平面,使用加权平均融合算法进行拼接,合成全景图像。采用多个测试序列图像对算法进行测试,特征点匹配速度较传统方法提高了10倍以上,自动焦距估计算法能够准确估计摄像机焦距,且耗时仅50毫秒左右。实验结果表明,提出的算法能够快速地合成高质量的全景图像,拼接后的图像畸变小,具有较高的实用价值。     

图像局部区域匹配驱动的导航式拼图方法

为了改善传统拼图拼接过程费时低效、影响拼图趣味性的问题,提出了一种图像局部区域匹配驱动的导航式拼图方法.首先,使用Canny边缘检测算法自动从输入的原始拼图中检测并分割出所有拼图模块.其次,采用D2分布函数和统计直方图,自动构造每个拼图模块的量化描述符.同时,使用属性邻接图描述原始拼图中所有拼图模块之间的拓扑邻接关系.之后,拼接过程中用户若需要帮助,根据用户动态传入(未拼接完成)的当前拼图,采用上述2步提取和描述当前拼图中所有的拼图模块,并基于描述符相似度计算、KM (Kuhn-Munkres)算法和属性邻接图拓扑关系一致性,在当前拼图和原始拼图之间建立拼图模块对应关系.最后,根据对应关系和原始拼图对应的属性邻接图,自动确定并提示用户当前拼图中下一可行的候选模块.开发了相应的原型系统,针对多个常见的拼图开展实验结果表明,所提方法对拼接过程帮助直观、高效,且未降低拼图的趣味性;与主流的电子拼图方法相比,无需实时跟踪,无需事先配备拼图数据库或训练库,可运行于具有拍摄功能的智能设备,适用性更加广泛.     

旋转鲁棒的图像复制粘贴伪造快速取证检测

现有文献对具有旋转等几何变换的复制粘贴篡改操作检测能力有限.为此,提出基于径向矩参数估计与奇异值分解的图像复制粘贴快速取证算法.通过构造本身具有旋转不变性的圆形结构,采用高斯金字塔分解用以降低图像尺寸,利用图像块奇异值分解构造七维特征向量,块匹配字典排序法以减少特征向量的搜索匹配空间,并采用径向矩参数估计旋转参数,用主旋转角度计替代主向量转移方法去除误匹配块.实验结果证明,圆形结构可解决图像因旋转而造成的像素错位现象,基于径向矩的旋转参数估计能提高算法的检测精度,减少误匹配块.而由奇异值组成的特征向量对图像的后处理操作JPEG压缩、加性噪声等具有较强的鲁棒性.     

基于三维模型的人脸姿态估计方法

提出一种三维人脸姿态估计方法。该方法通过估计三维平面人脸模型到图像平面的单应矩阵来获得人脸相对于摄像机坐标系的旋转矩阵,并利用M-估计优化方法迭代求精。其主要特点是：实施简单,不需要对透视摄像机参数预先进行标定,能够在较大范围内较精确地估计人脸姿态。对模拟数据及真实人脸图像的实验均验证了该方法的有效性。     

摄像机内参数自标定——理论与算法

讨论如何通过摄像机的旋转运动标定其内参数.当摄像机绕其坐标轴旋转时,运用 代数方法给出了计算内参数的公式.该公式在2D投影变换接近理论值P时是非常实用的. 在摄像机绕未知轴旋转时,根据相应的2D投影变换,运用矩阵特征向量理论给出了内参数的 通解公式.通过摄像机绕两个不同未知轴的旋转,摄像机内参数能被唯一地确定.这些结果为 摄像机自标定算法提供了理论基础,同时也给出了实用性算法.模拟实验和真实图像实验的 结果表明本文所给的算法具有一定实用价值.     

摄像机内参数自标定——理论与算法1)

讨论如何通过摄像机的旋转运动标定其内参数.当摄像机绕其坐标轴旋转时,运用代数方法给出了计算内参数的公式.该公式在2D投影变换接近理论值P时是非常实用的.在摄像机绕未知轴旋转时,根据相应的2D投影变换,运用矩阵特征向量理论给出了内参数的通解公式.通过摄像机绕两个不同未知轴的旋转,摄像机内参数能被唯一地确定.这些结果为摄像机自标定算法提供了理论基础,同时也给出了实用性算法。模拟实验和真实图像实验的结果表明本文所给的算法具有一定实用价值.     

改进的平面模板两步法标定摄像机

最近，张正友提出用平面模板两步法来标定摄像机。该方法能高精度地标定摄像机，且简便易行，可以说是两步法标定的代表，但其算法模型仅考虑了镜头径向畸变，其对切向畸变较大的场合，如鱼眼镜头成像，则不适用。为此，通过改进其摄像机模型，提出了一种改进的两步法，该方法先用图像中心附近点求取初值，由于图像中心附近点畸变很小，故求取的初值能很好地逼近准确值，然后采用一种基于内部映射牛顿法的子空间置信域法通过求精来得到所有参数。仿真实验和真实实验的结果表明，该方法的标定精度要优于张正友的方法，鲁棒性也更好。     

透视插补一致性拼图

对于使用8参数平面单应矩阵（homography）的全景拼图方法,当图像序列形成回路的时候,必须克服单应矩阵序列的累积误差以保证拼图首尾相一致。通常的调整优化方法计算量非常大,而且不能一定保证单应矩阵的一致性。该文提出一个简单的一致性拼图方法,它不要求单应矩阵序列的一致性。此方法主要利用了未标定图像透视插补技术,适用于图像序列拼图,并具有计算简单、易于实现的特点。     

一种改进的柱面全景视图生成方法

研究了相机存在绕光轴转动的情况下柱面全景图的生成，首先对柱面图像进行傅立叶变换，根据图像的傅立叶谱来估算出图像间的初始平移和旋转运动参数，再利用Levenberg-Marquardt非线性最小化方法逐步求精各运动参数，最后根据计算出的运动参数进行图像拼合获得柱面全景视图，实验结果表明该算法可以获得比较理想的拼接效果．     

基于对数极坐标映射的图像拼接方法

图像拼接在基于图像的绘制、视频检索以及景物匹配等领域有着广泛的应用，为了获取大画面宽视场的场景表示，针对存在旋转及缩放变化的图像，提出了一种基于对数极坐标映射的图像拼接方法，该方法先将图像从笛卡儿坐标空间转换到对数极坐标空间，使得笛卡儿坐标空间中图像的旋转和缩放转换为对数极坐标空间中图像的二维平移，这样可直接利用相位相关法来估算出图像间的旋转角度和缩放因子，然后以此作为初值，再采用非线性最小化优化算法进一步求精图像间的运动参数来实现图像的配准，最后通过图像融合来实现图像的拼接。实验结果表明，该方法是有效的。     

Graph based construction of textured large field of view mosaics for bladder cancer diagnosis

Large field-of-view panoramic images greatly facilitate bladder cancer diagnosis and follow-up. Such 2D mosaics can be obtained by registering the images of a video-sequence acquired during cystoscopic examinations. The scientific challenge in the registration process lies in the strong inter- and intra-patient texture variability of the images, from which primitives cannot be robustly extracted. State-of-the-art registration methods are not at the same time robust and accurate, especially for image pairs with a small amount of overlap (less than 90%) or strong perspective transformations. Moreover, no previous contribution to cystoscopy mosaicing presents panoramic images created from multiple overlapping sequences (e.g. “zigzags” or loop trajectories). We show how such overlapping sections can be automatically detected and present a novel registration algorithm that robustly superimposes non-consecutive image pairs, which are related by stronger perspective transformations and share less overlap than consecutive images (less than 50%). Globally coherent panoramic images are constructed using a non-linear optimization and a novel contrast-enhancing stitching method. Results on both phantom and patient data are obtained using constant algorithm parameters, which demonstrate the robustness of the proposed method. While the methods presented in this contribution are specifically designed for cystoscopy mosaicing, they can also be applied to more general mosaicing problems. We demonstrate this on a traditional stitching application, where a set of pictures of a building are stitched into a seamless, globally coherent panoramic image.     

基于最小路由代价树的大规模显微图像拼接方法

为了对大规模显微图像进行高质量的拼接,首先提出拼接图的概念及获得高质量全景图像的3个原则,然后采用分块-空间聚类算法配准相邻图像,同时评估配准质量,并计算拼接图的边的权值;最后在此基础上,提出了一种基于最小路由代价生成树的图像拼接方法,该方法通过计算拼接图的最小路由代价生成树来确定所有图像的全局位置,并用来生成全景图像。实验结果表明,该方法可获得高质量的全景图像。     

Minimal Aspect Distortion (MAD) Mosaicing of Long Scenes

Long scenes can be imaged by mosaicing multiple images from cameras scanning the scene. We address the case of a video camera scanning a scene while moving in a long path, e.g. scanning a city street from a driving car, or scanning a terrain from a low flying aircraft. A robust approach to this task is presented, which is applied successfully to sequences having thousands of frames even when using a hand-held camera. Examples are given on a few challenging sequences. The proposed system consists of two components: (i) Motion and depth computation. (ii) Mosaic rendering. In the first part a “direct” method is presented for computing motion and dense depth. Robustness of motion computation has been increased by limiting the motion model for the scanning camera. An iterative graph-cuts approach, with planar labels and a flexible similarity measure, allows the computation of a dense depth for the entire sequence. In the second part a new minimal aspect distortion (MAD) mosaicing uses depth to minimize the geometrical distortions of long panoramic images. In addition to MAD mosaicing, interactive visualization using X-Slits is also demonstrated. This research was supported by the Israel Science Foundation. Video examples and high resolution images can be viewed in .     

A modified medical image registration

Medical image registration is commonly used in clinical diagnosis, treatment, quality assurance, evaluation of curative efficacy and so on. In this paper, the edges of the original reference and floating images are detected by the B-spline gradient operator and then the binarization images are acquired. By computing the binarization image moments, the centroids are obtained. Also, according to the binarization image coordinates, the rotation angles of the reference and floating images are computed respectively, on the foundation of which the initial values for registering the images are produced. When searching the optimal geometric transformation parameters, the modified peak signal-to-noise ratio (MPSNR) is viewed as the similarity metric between the reference and floating images. At the same time, the simplex method is chosen as multi-parameter optimization one. The experimental results show that, this proposed method has a fairly simple implementation, a low computational load, a fast registration and good registration accuracy. It also can effectively avoid trapping in the local optimum and is adapted to both mono-modality and multi-modality image registrations. Also, the improved iterative closest point algorithm based on acquiring the initial values for registration from the least square method (LICP) is introduced. The experiments reveal that the measure acquiring the initial values for registration from image moments and the least square method (LSM) is feasible and resultful strategy.     

大场景的视频全景图拼接

为了解决大场景全景图拼接过程中的误差累积问题,提高图像拼接的一致性,提出了一个新的全景图拼接算法。把全局图像配准看作是一个统计估计问题,运用增广的卡尔曼滤波对图像的全局变换参数进行递归地增广和估计。实验结果表明,得到的变换参数是全局一致的,生成的全景图不存在拼接裂缝。拼接算法考虑了各种不确定性,适用于噪声大场景的全景图拼接。     

Initialization method for self-calibration using 2-views

Recently, 3D structure recovery through self-calibration of camera has been actively researched. Traditional calibration algorithm requires known 3D coordinates of the control points while self-calibration only requires the corresponding points of images, thus it has more flexibility in real application. In general, self-calibration algorithm results in the nonlinear optimization problem using constraints from the intrinsic parameters of the camera. Thus, it requires initial value for the nonlinear minimization. Traditional approaches get the initial values assuming they have the same intrinsic parameters while they are dealing with the situation where the intrinsic parameters of the camera may change. In this paper, we propose new initialization method using the minimum 2 images. Proposed method is based on the assumption that the least violation of the camera's intrinsic parameter gives more stable initial value. Synthetic and real experiment shows this result.     

Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment

This paper presents a complete system for constructing panoramic image mosaics from sequences of images. Our mosaic representation associates a transformation matrix with each input image, rather than explicitly projecting all of the images onto a common surface (e.g., a cylinder). In particular, to construct a full view panorama, we introduce a rotational mosaic representation that associates a rotation matrix (and optionally a focal length) with each input image. A patch-based alignment algorithm is developed to quickly align two images given motion models. Techniques for estimating and refining camera focal lengths are also presented.In order to reduce accumulated registration errors, we apply global alignment (block adjustment) to the whole sequence of images, which results in an optimally registered image mosaic. To compensate for small amounts of motion parallax introduced by translations of the camera and other unmodeled distortions, we use a local alignment (deghosting) technique which warps each image based on the results of pairwise local image registrations. By combining both global and local alignment, we significantly improve the quality of our image mosaics, thereby enabling the creation of full view panoramic mosaics with hand-held cameras.We also present an inverse texture mapping algorithm for efficiently extracting environment maps from our panoramic image mosaics. By mapping the mosaic onto an arbitrary texture-mapped polyhedron surrounding the origin, we can explore the virtual environment using standard 3D graphics viewers and hardware without requiring special-purpose players.An erratum to this article can be found at