基于模板匹配的视频对象分割

视频对象分割是MPEG-4标准关键技术.本文结合模板匹配和基于运动估值和补偿的对象跟踪方法,提出了一种可以从复杂场景中分割出MPEG-4视频对象的新方法.在使用运动估值和补偿得到分割掩膜后,以初始帧对象颜色为模板,在当前帧的轮廓边界区域通过模板匹配检测对象,使轮廓精确化.本文方法在一定范围内有效解决了遮挡问题,并能够以初始帧跟踪任意长序列中的对象.     

一种基于内容的快速视频运动对象分割算法

自从MPEG-4和MPEG-7标准公布以来。基于内容的视频编码与基于对象形状的检索成为视频领域新的发展趋势，而准确地从背景中分割出视频对象是实现上述功能的前提条件。对视频运动对象分割算法进行了研究，该算法结合对称差分和自适应阚值选取，获得变化检测模板，并最终分割出视频运动对象。实验结果表明该算法对运动对象敏感，能实时准确地分割出视频运动对象。但对象的关节运动以及背景的全局运动都将导致分割精度的降低，这也是今后研究的重点。     

利用浮点图像对视频对象进行自动分割

本文提出了一种自动的运动对象分割算法，利用浮点图像的轮廓进行区域分割，然后根据帧间运动信息进行区域合并，分割出视频序列中的运动物体。     

一种时空联合的视频对象的自动分割算法

随着新的视频压缩标准MPEG-4的出现，如何从视频序列中分割出具有语义意义的运动对象显得极其重要。本提出了一种自动的运动对象分割算法，利用浮点图像的轮廓进行区域分割，然后根据帧间运动信息进行区域合并，分割出视频序列中的运动物体。     

一种从视频压缩码流中精确提取运动对象的快速算法

针对目前大部分视频对象分割方法相当复杂而且计算量大的问题,提出了一种在压缩域粗分割,在空域精细分割的方法。该方法利用压缩域中运动向量进行聚类,得到运动对象的初始分割。将分割模板通过运动参数映射到参考帧I帧,,解码初始分割区域进行Canny边缘俭测和边缘跟踪,即可得到精确的对象轮廓。该方法使得处理的数据量保持最小,节约了处理时间并得到了像素级精度的分割对象。     

一种基于灰度连续区域分割的视频对象分割方法

针对目前许多分割方法中分割边界不精确、计算复杂和缓存帧多等问题，提出了一种结合空间区域分割和运动象素检测的自动分割方法：先将当前视频帧分割为不同的灰度连续区域，再利用二次帧差确定视频图像中的运动象素，然后按一定的规则确定哪些灰度连续区域属于运动区域，从而有效地从静止的复杂背景中分割出运动对象区域。实验结果表明这种分割方法计算简单、分割边界比较精确。     

基于目标匹配的视频对象跟踪算法

视频对象分割算法的性能好坏将直接影响MPEG-4编码产品的质量。连续两次差分后自适应处理，对差分图像取交集获得运动对象的边界，形态学处理后获得二值分割掩模进而提取运动目标。基于改进的Hausdorff距离度量法对后续帧中视频对象进行跟踪。实验结果证明，该方法能够从背景不变的图像序列中较好的提取出运动对象，具有较强的鲁棒性。     

网格运动分析与形态学滤波相结合的视频对象分割

提出了一种基于二维网格运动分析与改进形态学滤波空域自动分割策略相结合的视频对象时空分割算法。该算法首先利用高阶统计方法对视频图像的二维网格表示进行运动分析，快速得到前景对象区域，通过后处理有效获得前景对象运动检测掩膜。然后，用一种结合交变序列重建滤波算法和自适应阈值判别算法的改进分水岭分割策略有效获得前景对象的精确边缘。最后，用区域基时空融合算法将时域分割结果和空域分割结果结合起来提取出边缘精细的视频对象。实验结果表明，本算法综合了多种算法的优点，主客观分割效果理想。     

基于多帧边缘差异的视频运动对象的分割与跟踪算法

从视频场景中分割和跟踪感兴趣的视频对象对于MPEG-4等基于对象的视频编码来说是关键性的技术之一。针对目前大部分视频对象分割和追踪算法相当复杂但仍不能有效地去除背景噪声的问题,该文提出用于分割和跟踪视频运动对象的一种基于多帧边缘差异的算法。该算法利用一组帧的边缘差异来提取运动对象区域,通过聚类方法去除背景像素点,利用形态学算子得到对象分割模板,同时通过建立前帧感兴趣对象与当前帧运动对象的帧间向量跟踪当前帧的感兴趣视频对象。不同标准视频测试序列的测试结果表明,该算法能够实现对感兴趣的视频运动对象更为精确、快速和有效地分割和跟踪。     

自适应遗传视频运动对象分割算法

为了快速准确地分割视频运动对象,提出一种新的自适应遗传视频运动对象分割算法.该算法通过完善进化机制,引进自适应初代个体、自适应选择算子、自适应调整交叉率和变异率以及终止判决等,有效解决了遗传算法收敛速度幔和群体过早成熟的问题.实验结果表明,新算法不但缩短了分割时间,而且取得了良好的分割效果.     

一种基于帧内图像分区的视频对象自动分割算法

视频运动对象的自动分割是实现新一代对象基视频编码标准MPEG-4的重要技术,本文提出了一种基于帧内图像分区的运动对象自动分割算法.首先以时域运动信息为依据利用高斯检验方法得到二值运动掩模图像,并建立MRF随机场模型进一步检验,然后提出了一种结合非线性变换的改进分水岭算法进行帧内图像分区,以划定对象区域与背景区域的界线,最后对时域分割和帧内分区结果进行比重运算,得到最终运动对象.针对MPEG-4标准测试序列和自采集手指视频序列的实验结果说明了算法的有效性.     

A layered coding system for very low bit rate video coding

Known coding techniques for transmitting moving images at very low bit rates are explained by the source models on which these coding techniques are based. It is shown that with motion-compensated hybrid coding, object-based analysis-synthesis coding, knowledge-based coding and semantic coding, there is a consistent development of source models. In consequence these coding techniques can be combined in a layered coding system. From experimental results obtained for object-based analysis-synthesis, coding estimates for the coding efficiency of such a layered coding system are derived using head and shoulder video telephone test sequences. It is shown that an additional compression factor of about 3 can be expected with such a complex layered coding system, when compared to block-based hybrid coding.     

Adaptive coding of moving objects for very low bit rates

This paper describes an object-based video coding system with new ideas in both the motion analysis and source encoding procedures. The moving objects in a video are extracted by means of a joint motion estimation and segmentation algorithm based on the Markov random field (MRF) model. The two important features of the presented technique are the temporal linking of the objects, and the guidance of the motion segmentation with spatial color information. This facilitates several aspects of an object-based coder. First, a new temporal updating scheme greatly reduces the bit rate to code the object boundaries without resorting to crude lossy approximations. Next, the uncovered regions can be extracted and encoded in an efficient manner by observing their revealed contents. The objects are classified adaptively as P objects or I objects and encoded accordingly. Subband/wavelet coding is applied in encoding the object interiors. Simulations at very low bit rates yielded comparable performance in terms of reconstructed PSNR to the H.263 coder. The object-based coder produced visually more pleasing video with less blurriness and devoid of block artifacts, thus confirming the advantages of object-based coding at very low bit-rates     

Motion-based region growing segmentation of image sequences

This paper proposes a motion-based region growing segmentation scheme for the object-based video coding, which segments an image into homogeneous regions characterized by a coherent motion. It adopts a block matching algorithm to estimate motion vectors and uses morphological tools such as open-close by reconstruction and the region-growing version of the watershed algorithm for spatial segmentation to improve the temporal segmentation. In order to determine the reliable motion vectors, this paper also proposes a change detection algorithm and a multi-candidate pro- screening motion estimation method. Preliminary simulation results demonstrate that the proposed scheme is feasible. The main advantage of the scheme is its low computational load.     

视频对象分割技术与应用

随着MPEG-4基于内容的功能的提出,视频对象分割技术成为视频处理领域的研究热点,视频对象分割就是从视频序列中分割出在语义上有意义的对象,介绍视频对象分割所涉及的关键技术,详细讨论基于时空联合的分割算法,并且探讨视频对象分割技术在视频会议、交通流视频监测等领域的应用。     

2-D mesh-based video object segmentation and tracking with occlusion resolution

This paper integrates fully automatic video object segmentation and tracking including detection and assignment of uncovered regions in a 2-D mesh-based framework. Particular contributions of this work are (i) a novel video object segmentation method that is posed as a constrained maximum contrast path search problem along the edges of a 2-D triangular mesh, and (ii) a 2-D mesh-based uncovered region detection method along the object boundary as well as within the object. At the first frame, an optimal number of feature points are selected as nodes of a 2-D content-based mesh. These points are classified as moving (foreground) and stationary nodes based on multi-frame node motion analysis, yielding a coarse estimate of the foreground object boundary. Color differences across triangles near the coarse boundary are employed for a maximum contrast path search along the edges of the 2-D mesh to refine the boundary of the video object. Next, we propagate the refined boundary to the subsequent frame by using motion vectors of the node points to form the coarse boundary at the next frame. We detect occluded regions by using motion-compensated frame differences and range filtered edge maps. The boundaries of detected uncovered regions are then refined by using the search procedure. These regions are either appended to the foreground object or tracked as new objects. The segmentation procedure is re-initialized when unreliable motion vectors exceed a certain number. The proposed scheme is demonstrated on several video sequences.     

MPEG-4视频对象分割技术

随着MPEG-4,MPEG-7的研究发展,其基于内容的编码和面向对象的存取和操纵技术日益得到人们的重视。基于对象的视频图像分割是实现MPEG-4基于内容的编码和交互功能的关键。视频图像分割方法分为自动分割法和半自动分割法两种。结合视频分割的发展趋势,深入介绍了基于对象的视频分割的主要技术及国内外的最新研究算法,包括数学形态学算法以及活动轮廓模型(蛇模型)在该领域的应用,并分析了当前视频分割技术尚存在的问题和研究前景。     

Hybrid model-and-object-based real-time conversational video coding

Bandwidth-constrained real-time conversational video communications (such as mobile teleconferencing) require video codecs with good rate-distortion characteristics at low bit-rates and modest computational complexity. While target-specific object-based and model-based coding methods have been proposed for low bit-rate conversational video coding, difficulties in generalization and high computational complexity hinder their practical utilization. In this paper, we propose a low bit-rate coding method for typical conversational video by combining two-dimensional model-based coding of face regions and object-based coding of non-face head-shoulder regions, achieving high-quality face reconstruction and low overall bit-rate with real-time encoding capability. Experiments on typical conversational test sequences confirm that, compared to other conversational video codecs, our model-and-object-based coding method offers superior rate-distortion performance at low bit-rates.     

Robust, object-based high-resolution image reconstruction fromlow-resolution video

We propose a robust, object-based approach to high-resolution image reconstruction from video using the projections onto convex sets (POCS) framework. The proposed method employs a validity map and/or a segmentation map. The validity map disables projections based on observations with inaccurate motion information for robust reconstruction in the presence of motion estimation errors; while the segmentation map enables object-based processing where more accurate motion models can be utilized to improve the quality of the reconstructed image. Procedures for the computation of the validity map and segmentation map are presented. Experimental results demonstrate the improvement in image quality that can be achieved by the proposed methods.