利用多帧图像分布特性的图像重构算法研究

研究图像恢复高分辨率图像的问题。由于图像存在锐化和冗余信息而影响了矢量效果,针对以往用反卷积或者单幅图像进行图像恢复重构方法结果不够理想的缺陷,提出了一种利用多幅图像进行图像重构的方法。算法核心思想是利用多幅相关图像进行训练,从而得到某些观测的分布特性,从而对图像进行恢复。首先,定义了一个基于图像小块的马尔科夫随机场分布模型,并由此定义了隐含节点到观测之间的势能函数和隐含节点之间的势能函数;然后通过选用一组训练图像,计算隐含节点到观测之间的混合高斯分布模型,并利用相邻节点所对应的小块之间相邻边界的相关度来计算势能函数所对应的值。最后利用置信传播的方法计算整幅图像上最优的恢复结果。仿真结果显示提出的方法较传统的反卷积方法和插值方法具有更优的恢复结果,能很好的逼近原始的真实图像。     

基于频谱参数估计和神经网络的运动模糊图像恢复

提出了一种运动模糊图像恢复模型，运动模糊图像经傅立叶变换后在频域有频谱零点进行参数估计，通过霍变换初步求得运动模糊图像的点扩展函数，当估计出运动模糊图像的点扩展函数的参数后，用神经网络方法进行恢复。这种恢复模型可以对任意角度的匀速运动模糊图像的恢复取得恢复效果。该方法具有操作简单和全局搜索收敛的优点，实验证明这是一种比较好的运动模糊图像恢复方法。     

融合[L2]和KL保真项的图像恢复算法

为了有效抑制高斯-泊松混合噪声,针对调和模型不能有效保存图像的边缘细节信息和Kullback-Leibler散度作为保真项（KL保真项）的全变差图像恢复模型对光滑的区域部分去噪会产生“阶梯效应”的不足,提出一种针对高斯-泊松混合噪声去噪的图像恢复变分模型。该模型利用增广拉格朗日算法进行数值实现,将调和模型和全变分模型按照比例进行融合,结合两种模型的优点,增强模型的去噪性能;Kullback-Leibler散度作为保真项和[L2]保真项按照比例进行混合,能有效去除高斯-泊松混合噪声的同时,保护图像的边缘细节;使用多幅含不同混合噪声的图像进行对比实验,采用峰值信噪比、结构相似度指标评定图像的恢复效果。实验结果表明,该模型的峰值信噪比和结构相似度大于使用Kullback-Leibler散度作为保真项的全变差图像恢复（TV-KL）模型、改进MS模型（MRT）,以及保真项混合模型（MFT）这三个模型,并且计算的CPU时间更短,去噪效果得到明显改善。所提模型具有更好的去噪性能,有效地保持了图像细节和纹理特征方面的信息,获得了更理想的视觉效果,不仅能提高了图像质量,而且在客观上得到了有效的证实,可以应用于X射线图像去噪。     

基于边缘最优映射的红外和可见光图像自动配准算法

针对同一场景的红外和可见光图像间一致特征难以提取和匹配的难题, 提出了一种在多尺度空间中基于边缘最优映射的自动配准算法. 在由粗至细的尺度空间中, 算法分别采用仿射模型和投影模型作为参考图像和待配准图像间的空间变换模型. 在每个尺度层上, 首先基于相位一致性方法提取两幅图像的边缘结构, 并在相应的空间变换模型下将在待配准图像中提取的二值边缘映射到参考图像的边缘强度图上; 接着采用并行遗传算法寻找一组全局最优的模型参数, 使两幅图像间的结构相似度最大. 在各层的寻优结束之后, 使用Powell算法对全局寻优后的模型参数进行局部精化. 实验结果表明, 该算法能够充分利用图像间的视觉相似结构, 有效地实现红外和可见光图像的自动配准.     

图像抖动核函数估计与图像恢复

抖动模糊是摄影中常见的问题,为此提出了一个鲁棒快速的核函数估计和图像恢复方法。给定一幅因相机抖动而模糊的图像,该方法首先建立金字塔,然后自顶向下、迭代地估计运动模糊核函数,同时对图像进行恢复。使用混合高斯模型对核函数建模,使用自然图像的边缘大尾巴分布对图像进行约束。通过冲击滤波器预测图像的强边缘,对图像的边缘与核函数进行约束,从而更好地估计核函数。并通过迟滞阈值方法和核函数重新定位的方法,降低核函数的噪声,提高核函数估计的鲁棒性能。在求解核函数能量方程时,采用共轭梯度法,利用图像的一阶和二阶偏导数降低系统方程的条件数,加快收敛速度。最后,在一个国际公开的包含32组运动模糊图像的数据集上验证了该方法。实验结果表明,该方法所恢复的图像,其边缘和纹理清晰,能够很好地避免噪声和振铃走样问题。     

运动模糊图像的恢复方法研究

分析了运动模糊图像的退化模型和恢复过程，改进了一种运动模糊图像的恢复方法。先通过图像系统辨识方法求解PSF函数，进而在频域和时域完成运动模糊图像的恢复，并就运动模糊图像进行逆滤波恢复、维纳滤波恢复和时域反卷积恢复进行了理论说明，比较了各自的优缺点。最后给出了几种恢复效果的对比实验结果。     

基于手持相机的文档图像拼接算法

为了把手持相机拍摄的多幅文档图像拼接成一幅大的图像,提出了一种基于全局对准模型的文档图像拼接算法。该算法首先通过估计文档图像的消隐点坐标来校正透视失真,使相邻图像的几何关系可以用仿射变换表示;然后采用随机采样方法调整特征点之间的距离,使其尽可能均匀地分布在整个重叠区域内;接着利用所有重叠图像对的局部对准约束通过建立文档图像拼接的全局对准模型来有效地消除误差积累;最后利用二值函数对图像进行剪切,以减小重叠区内的对准误差。实验结果表明,该方法无需事先标定摄像机的内外参数和限制相机的位置,不仅具有较高的对准精度,且可有效地拼接手持相机拍摄的各种文档图像。     

匀速直线运动模糊图像的递推恢复方法

运动模糊图像恢复是敖字图像处理中的一项重要的技术。本文分析了运动模糊图像的退化模型与匀速直线运动模糊图像的递推恢复方法,并采用VisualC＋＋作为开发工具,编程实现了运动模糊图像的恢复。     

基于三维模型的Android手机端人脸姿态实时估计系统

针对人脸姿态估计对系统性能要求高、在手机上运行无法满足实时性要求等问题,实现了一种Android手机端的人脸姿态实时估计系统。首先,由摄像头获得一幅正面和一幅偏移一定角度的人脸图像,利用从运动中构建结构(SfM)算法建立简单三维人脸模型;然后,提取实时人脸图像中与三维人脸模型相互对应的特征点,基于缩放正投影位姿估计(POSIT)算法估计人脸姿态角度;最后将三维人脸模型通过开放图形开发库(OpenGL)实时显示在手机屏幕上。实验结果表明,实时视频中检测人脸姿态并显示的速度可以达到20 frame/s,接近计算机端的基于仿射对应的三维人脸姿态估计算法,而且针对大量图片序列的检测可以达到50 frame/s,能够满足Android手机端的性能和检测人脸姿态的实时性要求。     

基于遗传算法的直线光流刚体运动重建

建立一种新的基于直线光流场从单目图像序列恢复刚体运动和结构的模型,推导出直线光流场与刚体的运动参数之间的关系,用2个二阶线性微分方程表达这种关系,并提出一种求解刚体运动参数的遗传算法,只需要获得图像平面的2条直线光流即可求解刚体的旋转参数,并用合成图像测试了该算法的有效性。     

Lines in one orthographic and two perspective views

We introduce a linear algorithm to recover the Euclidean motion between an orthographic and two perspective cameras from straight line correspondences filling the gap in the analysis of motion estimation from line correspondences for various projection models. The general relationship between lines in three views is described by the trifocal tensor. Euclidean structure from motion for three perspective views is a special case in which the relationship is defined by a collection of three matrices. Here, we describe the case of two calibrated perspective views and an orthographic view. Similar to the other cases, our linear algorithm requires 13 or more line correspondences to recover 27 coefficients of the trifocal tensor.     

Generalised Epipolar Constraints

In this paper we will discuss structure and motion problems for curved surfaces. These will be studied using the silhouettes or apparent contours in the images. The problem of determining camera motion from the apparent contours of curved three-dimensional surfaces, is studied. It will be shown how special points, called epipolar tangency points or frontier points, can be used to solve this problem. A generalised epipolar constraint is introduced, which applies to points, curves, as well as to apparent contours of surfaces. The theory is developed for both continuous and discrete motion, known and unknown orientation, calibrated and uncalibrated, perspective, weak perspective and orthographic cameras. Results of an iterative scheme to recover the epipolar line structure from real image sequences using only the outlines of curved surfaces, is presented. A statistical evaluation is performed to estimate the stability of the solution. It is also shown how the motion of the camera from a sequence of images can be obtained from the relative motion between image pairs.     

Shape-from-Shading Under Perspective Projection

Shape-from-Shading (SfS) is a fundamental problem in Computer Vision. A very common assumption in this field is that image projection is orthographic. This paper re-examines the basis of SfS, the image irradiance equation, under a perspective projection assumption. The resultant equation does not depend on the depth function directly, but rather, on its natural logarithm. As such, it is invariant to scale changes of the depth function. A reconstruction method based on the perspective formula is then suggested; it is a modification of the Fast Marching method of Kimmel and Sethian. Following that, a comparison of the orthographic Fast Marching, perspective Fast Marching and the perspective algorithm of Prados and Faugeras on synthetic images is presented. The two perspective methods show better reconstruction results than the orthographic. The algorithm of Prados and Faugeras equates with the perspective Fast Marching. Following that, a comparison of the orthographic and perspective versions of the Fast Marching method on endoscopic images is introduced. The perspective algorithm outperformed the orthographic one. These findings suggest that the more realistic set of assumptions of perspective SfS improves reconstruction significantly with respect to orthographic SfS. The findings also provide evidence that perspective SfS can be used for real-life applications in fields such as endoscopy.This research has been supported in part by Tel-Aviv University fund, the Adams Super-Center for Brain Studies, the Israeli Ministry of Science, the ISF Center for Excellence in Applied Geometry, the Minerva Center for geometry, and the A.M.N. fund.     

Tracking nonrigid motion and structure from 2D satellite cloudimages without correspondences

Tracking both structure and motion of nonrigid objects from monocular images is an important problem in vision. In this paper, a hierarchical method which integrates local analysis (that recovers small details) and global analysis (that appropriately limits possible nonrigid behaviors) is developed to recover dense depth values and nonrigid motion from a sequence of 2D satellite cloud images without any prior knowledge of point correspondences. This problem is challenging not only due to the absence of correspondence information but also due to the lack of depth cues in the 2D cloud images (scaled orthographic projection). In our method, the cloud images are segmented into several small regions and local analysis is performed for each region. A recursive algorithm is proposed to integrate local analysis with appropriate global fluid model constraints, based on which a structure and motion analysis system, SMAS, is developed. We believe that this is the first reported system in estimating dense structure and nonrigid motion under scaled orthographic views using fluid model constraints. Experiments on cloud image sequences captured by meteorological satellites (GOES-8 and GOES-9) have been performed using our system, along with their validation and analyses. Both structure and 3D motion correspondences are estimated to subpixel accuracy. Our results are very encouraging and have many potential applications in earth and space sciences, especially in cloud models for weather prediction     

Structure recovery with multiple cameras from scaled orthographicand perspective views

This paper presents a novel framework for Euclidean structure recovery utilizing a scaled orthographic view and perspective views simultaneously. A scaled orthographic view is introduced in order to automatically obtain camera parameters such as camera positions, orientation, and focal length. Scaled orthographic properties enable all camera parameters to be calculated implicitly and perspective properties enable a Euclidean structure to be recovered. The method can recover a Euclidean structure with at least seven point correspondences across a scaled orthographic view and perspective views. Experimental results for both computed and natural images verify that the method recovers structure with sufficient accuracy to demonstrate potential utility. The proposed method can be applied to an interface for 3D modeling, recognition and tracking     

A paraperspective factorization method for shape and motionrecovery

The factorization method, first developed by Tomasi and Kanade (1992), recovers both the shape of an object and its motion from a sequence of images, using many images and tracking many feature points to obtain highly redundant feature position information. The method robustly processes the feature trajectory information using singular value decomposition (SVD), taking advantage of the linear algebraic properties of orthographic projection. However, an orthographic formulation limits the range of motions the method can accommodate. Paraperspective projection, first introduced by Ohta et al. (1981), is a projection model that closely approximates perspective projection by modeling several effects not modeled under orthographic projection, while retaining linear algebraic properties. Our paraperspective factorization method can be applied to a much wider range of motion scenarios, including image sequences containing motion toward the camera and aerial image sequences of terrain taken from a low-altitude airplane     

Shape ambiguities in structure from motion

This paper examines the fundamental ambiguities and uncertainties inherent in recovering structure from motion. By examining the eigenvectors associated with null or small eigenvalues of the Hessian matrix, we can quantify the exact nature of these ambiguities and predict how they affect the accuracy of the reconstructed shape. Our results for orthographic cameras show that the bas-relief ambiguity is significant even with many images, unless a large amount of rotation is present. Similar results for perspective cameras suggest that three or more frames and a large amount of rotation are required for metrically accurate reconstruction     

Motion and structure from orthographic projections

S. Ullman's classical (1979) results on motion/structure from orthographic views are revisited. Specifically, two results are presented: (1) two orthographic views allow an uncountably infinite number of solutions to motion/structure of a rigid body, and (2) a linear algorithm for solving motion/structure from four point correspondences over three views     

Omnidirectional video

Omnidirectional video enables direct surround immersive viewing of a scene by warping the original image into the correct perspective given a viewing direction. However, novel views from viewpoints off the camera path can only be obtained if we solve the three-dimensional motion and calibration problem. In this paper we address the case of a parabolic catadioptric camera – a paraboloidal mirror in front of an orthographic lens – and we introduce a new representation, called the circle space, for points and lines in such images. In this circle space, we formulate an epipolar constraint involving a 4×4 fundamental matrix. We prove that the intrinsic parameters can be inferred in closed form from the two-dimensional subspace of the new fundamental matrix from two views if they are constant or from three views if they vary. Three-dimensional motion and structure can then be estimated from the decomposition of the fundamental matrix.     

Recursive estimation of motion, structure, and focal length

Presents a formulation for recursive recovery of motion, pointwise structure, and focal length from feature correspondences tracked through an image sequence. In addition to adding focal length to the state vector, several representational improvements are made over earlier structure from motion formulations, yielding a stable and accurate estimation framework which applies uniformly to both true perspective and orthographic projection. Results on synthetic and real imagery illustrate the performance of the estimator