基于相位相关法的全局运动估计算法

提出了一种基于鲁捧统计和相位相关法相结合的全局运动估计算法;由于相位相关法利用图像的功率谱信息,减少了对图像内容的依赖,具有一定的抗噪能力,因此该算法将块匹配法与相位相关相结合来计算图像间的运动矢量场,不仅减少了运算量而且能得到更加准确的矢量场;为了提高模型参数估计精度和运算效率,运用多分辨率鲁棒统计的方法来计算运动估计模型参数;航拍视频图像配准与独立运动检测的仿真结果均验证了算法的有效性。     

基于平面拟合恢复运动矢量的错误隐藏算法

针对压缩视频码流在无线信道传输过程中由于运动矢量失配导致重构图像质量的问题,提出了一种基于平面拟合恢复运动矢量的错误隐藏算法。首先,根据H.264视频标准具有多参考帧且相邻宏块间的相关性的特点,通过把与受损宏块直接相邻的每个分块的运动矢量定义为一个点,采用平面拟合方法表征小范围内相邻运动矢量的变化趋势,对受损宏块运动矢量进行重建,然后利用改进的边界匹配函数,选取最优运动矢量对受损图像进行恢复。实验结果表明,该算法不仅避免了AIC算法产生的块效应,而且在不同的RTP丢包概率下,该算法比AIC算法得到的峰值信噪比有0.3~2.5 dB的提升。     

基于运动补偿和自适应双闭值的镜头分割

镜头分割是视频检索的结构化基础.提出一种高效的镜头分割算法,首先针对视频中的图像帧序列间存在一定的运动,对视频中的图像帧采用运动矢量场自适应搜索技术进行分块运动矢量估计,然后进行运动补偿,接着在此基础上计算两帧间的像素值不变点数,并基于滑动窗口获取局部自适应的双阈值,最后基于自适应双阈值间的比较检测切变和渐变.实验结果证实,该算法不仅能够有效地检测出镜头的切变和渐变,而且对运动具有较强的鲁棒性.     

矿井车载视频图像稳像算法研究

针对矿井车载摄像系统拍摄的视频因含有前景运动目标及高噪声造成的全局运动矢量估计误匹配率高、实时性较差等问题,提出了一种基于ORB特征匹配与改进粒子滤波的矿井车载视频图像稳像算法。在运动矢量估计阶段,采用ORB算法提取图像特征点;采用基于图像块的连续3帧间差分法,联合时空一致性准则快速剔除前景运动区域的特征点;结合前景标记区域,对特征点位置进行初次筛选,对保留下来的背景特征点进行配准;利用仿射变换模型实现帧间运动矢量的估计。在运动滤波阶段,采用基于估计窗的实时粒子滤波算法滤除抖动分量,获得补偿参数。实验结果表明,该算法有效避免了前景运动目标对稳像精度的影响,且具有较快的处理速度。     

一种面向H.264/AVC的快速块匹配搜索算法

基于块匹配的运动估计在视频编码中占有很重要的地位.针对H.264/AVC的特点,提出一种快速块匹配搜索算法.该算法充分利用宏块编码模式间的关联特性和运动矢量的统计特征,极大地提高了算法的搜索速度.与经典的搜索算法菱形搜索(DS)、十字-菱形搜索(CDS)和运动矢量场自适应搜索算法(MVFAST)相比,快速搜索算法在保持了与它们相当的搜索精度的同时,搜索速度分别提高了240.5%、149.9%和30.7%.     

基于并行处理的快速运动估计算法

运动估计是视频编码的一项关键技术。该文针对传统搜索算法串行处理的缺点,提出了一种基于并行处理的快速运动估计算法。该算法利用序列图像的相邻块运动矢量的高度相关性和运动矢量的中心偏移特性,在搜索过程中根据图像的内容(运动类型)进行并行处理,加速了块匹配的快速搜索策略。实验结果表明,该算法在速度和准确性方面都有了很大的提高。     

一种基于块匹配的自适应快速运动估计算法

块匹配运动估计算法是实时视频编解码技术的研究重点.为降低视频编码中运动估计的计算复杂度,考虑到现实序列运动矢量的分布存在方向性,文章提出了基于块匹配的自适应快速运动估计算法.该算法在运动估计的初始阶段,利用相邻宏块间的空间相关性来预测初始搜索点的位置,使搜索起点更接近理想的最优匹配点;在搜索过程中引入具有方向特征的非对称十字形搜索模型,加快了搜索速度.实验结果表明该算法具有很好的性能.     

基于数学形态学的视频帧间压缩算法研究与实现

常用视频压缩算法DCT存在方块效应和飞蚊噪声,在低速率传输下更为明显,难以满足视频传输中带宽窄、质量高的要求。基于数学形态学的视频图像帧间编码技术,是运用帧间运动补偿的编码算法,该算法通过复合形态变换,用结构元素对宏块中的不规则小块进行开、闭运算,选取并滤出不规则小块,再对不规则小块的大小和运动矢量进行运动估计编码,采用绝对差分和找出匹配块,实现帧间预测。通过仿真可达到比较精细的补偿,提高了编码效率,在相同压缩比下可提高视频质量,弥补了DCT算法在图像传输中的不足,改善了图像传输效果,降低了运算复杂度,对网络视频图像的编解码及传输具有一定的实用意义。     

一种基于搜索策略的新算法

基于块匹配的运动估计是降低视频序列图像冗余度的一项关键技术,本文在简单描述块匹配运动估计原理的基础上,就运动搜索策略对提高运动估计算法的效率方面作了重点论述,并根据运动矢量概率分布特性提出了一种基于混合模板搜索的新算法,模拟实验表明,新算法在图像质量和搜索速度方面有较好的优势.     

一种基于H.264的帧间错误掩盖算法

H.264采用混合编码算法.视频流的传输错误将会导致解码错误在时间和空间上扩散,直接影响重构图像的质量.本文充分结合H.264的编码特性,利用宏块的空间或时间相关性来确定丢失宏块的类型,根据相邻块的运动矢量建立一个描述小区域内运动矢量变化趋势的多项式模型,更精确的恢复出丢失宏块的运动矢量,提高重构图像的质量.仿真结果表明:该算法优于以往的边界匹配算法,在同等宏块丢失率下,恢复的视频序列Y分量的PSNR值能提高0.75～1.5dB.     

基于对数极坐标映射的图像拼接方法

图像拼接在基于图像的绘制、视频检索以及景物匹配等领域有着广泛的应用，为了获取大画面宽视场的场景表示，针对存在旋转及缩放变化的图像，提出了一种基于对数极坐标映射的图像拼接方法，该方法先将图像从笛卡儿坐标空间转换到对数极坐标空间，使得笛卡儿坐标空间中图像的旋转和缩放转换为对数极坐标空间中图像的二维平移，这样可直接利用相位相关法来估算出图像间的旋转角度和缩放因子，然后以此作为初值，再采用非线性最小化优化算法进一步求精图像间的运动参数来实现图像的配准，最后通过图像融合来实现图像的拼接。实验结果表明，该方法是有效的。     

Video motion stitching using trajectory and position similarities

Stitching motions in multiple videos into a single video scene is a challenging task in current video fusion and mosaicing research and film production. In this paper, we present a novel method of video motion stitching based on the similarities of trajectory and position of foreground objects. First, multiple video sequences are registered in a common reference frame, whereby we estimate the static and dynamic backgrounds, with the former responsible for distinguishing the foreground from the background and the static region from the dynamic region, and the latter functioning in mosaicing the warped input video sequences into a panoramic video. Accordingly, the motion similarity is calculated by reference to trajectory and position similarity, whereby the corresponding motion parts are extracted from multiple video sequences. Finally, using the corresponding motion parts, the foregrounds of different videos and dynamic backgrounds are fused into a single video scene through Poisson editing, with the motions involved being stitched together. Our major contributions are a framework of multiple video mosaicing based on motion similarity and a method of calculating motion similarity from the trajectory similarity and the position similarity. Experiments on everyday videos show that the agreement of trajectory and position similarities with the real motion similarity plays a decisive role in determining whether two motions can be stitched. We acquire satisfactory results for motion stitching and video mosaicing.     

Minimal Aspect Distortion (MAD) Mosaicing of Long Scenes

Long scenes can be imaged by mosaicing multiple images from cameras scanning the scene. We address the case of a video camera scanning a scene while moving in a long path, e.g. scanning a city street from a driving car, or scanning a terrain from a low flying aircraft. A robust approach to this task is presented, which is applied successfully to sequences having thousands of frames even when using a hand-held camera. Examples are given on a few challenging sequences. The proposed system consists of two components: (i) Motion and depth computation. (ii) Mosaic rendering. In the first part a “direct” method is presented for computing motion and dense depth. Robustness of motion computation has been increased by limiting the motion model for the scanning camera. An iterative graph-cuts approach, with planar labels and a flexible similarity measure, allows the computation of a dense depth for the entire sequence. In the second part a new minimal aspect distortion (MAD) mosaicing uses depth to minimize the geometrical distortions of long panoramic images. In addition to MAD mosaicing, interactive visualization using X-Slits is also demonstrated. This research was supported by the Israel Science Foundation. Video examples and high resolution images can be viewed in .     

大场景的视频全景图拼接

为了解决大场景全景图拼接过程中的误差累积问题,提高图像拼接的一致性,提出了一个新的全景图拼接算法。把全局图像配准看作是一个统计估计问题,运用增广的卡尔曼滤波对图像的全局变换参数进行递归地增广和估计。实验结果表明,得到的变换参数是全局一致的,生成的全景图不存在拼接裂缝。拼接算法考虑了各种不确定性,适用于噪声大场景的全景图拼接。     

Collusion,MPEG4 compression and frame dropping resistant video watermarking

We present in this article a new video watermarking which resists collusion, MPEG4 compression and frame dropping attacks. This scheme is based on video mosaicing. For that, we are going to start by describing the mosaicing technique in order to illustrate the contribution of this technique in video watermarking. In fact, mosaicing allows to select an interesting area where the mark should be embedded. The idea is to insert the same mark into the same pixels which represent the same physical point. This is exactly the information which can be provided by a mosaic image at least for the located points in the scene background. Next, we present extensive experimental simulations which prove the watermark imperceptibility and robustness against several video attacks.     

基于WiFi的分布式监视场景拼接系统

随着数字化信息技术的不断发展,监视系统已经成为各行业领域中的重要应用.随着WiFi等无线技术的发展,实现了视频数据的无线传输,因其特有的便捷性将传统的有线监视系统取而代之.图像拼接是目前图像处理的一项热门技术,将两幅或者多幅具有重叠区域的图像拼接成一幅无缝隙高分辨率的图像.本论文结合WiFi无线技术和图像拼接技术的优势,提出了基于WiFi的分布式监视场景拼接系统,多个客户端采集的图像通过WiFi无线网络传输到服务器,服务器对传输过来的图像采用SIFT算法和RANSAC算法完成拼接,最终实现了宽场景监视.实验结果表明该系统可以有效地实现监视场景拼接.     

一种动态场景下基于时空信息的视频对象提取算法

在实际应用中,许多视频序列具有运动背景,使得从其中提取视频对象变得复杂,为此提出了一种基于运动估计和图形金字塔的动态场景下的视频对象提取算法。该算法首先引入了相位相关法求取运动向量,因避免了视频序列中光照变化的影响,故可提高效率和稳健性;接着再根据参数模型进行全局运动估计来得到最终运动模板;然后利用图形金字塔算法对当前模板内图像区域进行空间分割,最终提取出语义视频对象。与现有算法相比,对于从具有动态场景的视频流中提取运动对象的情况,由于使用该算法能有效地避开精准背景补偿,因而不仅节省了计算量,而且提取出来的语义对象精度较高。实验表明,无论是对动态场景中刚性还是非刚性运动物体的分割,该算法都具有较好的效果。     

一种新的H.264视频场景切换检测算法

H.264/AVC QCIF视频场景切换检测是视频应用中一个极具挑战性的研究课题,只利用宏块信息很难得到满意的检测效果,为此提出了一种采用动态阈值和AC相似度的H.264/AVC视频场景切换检测算法,考虑编码预测模式和DCT系数等信息,提出基于编码比特数的动态阈值和基于AC能量的AC图像相似性两个判决准则,据此进行视频场景切换检测。实验结果表明,在高速运动及场景切换频繁的视频上场景切换检测率得到提高,性能也优于现有的算法。     

Mosaicing on adaptive manifolds

Image mosaicing is commonly used to increase the visual field of view by pasting together many images or video frames. Existing mosaicing methods are based on projecting all images onto a predetermined single manifold: A plane is commonly used for a camera translating sideways, a cylinder is used for a panning camera, and a sphere is used for a camera which is both panning and tilting. While different mosaicing methods should therefore be used for different types of camera motion, more general types of camera motion, such as forward motion, are practically impossible for traditional mosaicing. A new methodology to allow image mosaicing in more general cases of camera motion is presented. Mosaicing is performed by projecting thin strips from the images onto manifolds which are adapted to the camera motion. While the limitations of existing mosaicing techniques are a result of using predetermined manifolds, the use of more general manifolds overcomes these limitations.     

Generalized parallel-perspective stereo mosaics from airborne video

In this paper, we present a new method for automatically and efficiently generating stereoscopic mosaics by seamless registration of images collected by a video camera mounted on an airborne platform. Using a parallel-perspective representation, a pair of geometrically registered stereo mosaics can be precisely constructed under quite general motion. A novel parallel ray interpolation for stereo mosaicing (PRISM) approach is proposed to make stereo mosaics seamless in the presence of obvious motion parallax and for rather arbitrary scenes. Parallel-perspective stereo mosaics generated with the PRISM method have better depth resolution than perspective stereo due to the adaptive baseline geometry. Moreover, unlike previous results showing that parallel-perspective stereo has a constant depth error, we conclude that the depth estimation error of stereo mosaics is in fact a linear function of the absolute depths of a scene. Experimental results on long video sequences are given.