一种应用形态学滤波的视频对象时空分割算法

从视频图像中提取视频对象是基于内容的视频编码中的一项关键技术。本文提出了一种基于帧间运动信息和形态学滤波的视频对象时空分割算法。该算法首先利用分块高阶统计算法和基于最大类间方差的阈值算法得到目标的运动区域检测模板。然后,用基于交变序列重建滤波的分水岭算法得到前景对象的精确边缘。最后,用区域基时空融合方法将运动检测和形态学分割结果结合起来提取出视频对象。实验结果表明,本文算法能避免区域合并有效提取出具有精确边缘的视频对象,主客观分割效果理想。     

基于模糊聚类的视频对象分割

提出了一种基于模糊聚类的视频对象分割方法.首先通过对连续三帧视频图像进行二次差分来得到二次差分图像;然后估计噪声的特征参数滤除背景噪声,提取出视频对象的运动区域;再利用改进的FCM聚类算法对二次帧差图像中的视频对象运动区域进行空域分割,对空域分割结果进行形态学处理,得到视频对象掩模;最终获得较为理想的视频对象.实验结果表明,该算法能够较为准确地分割出视频对象,并且在空间准确度上占优.     

基于改进分水岭算法的立体视频对象分割

提出了一种结合视差和边缘信息进行立体视频对象的分割方法。针对传统分水岭算法过分割的问题,提出了改进的算法。采用基于自适应权值的立体匹配方法获得可靠的视差图,并利用改进分水岭算法进行视差图分割,获得初始的视频对象区域,随后对初始视频对象进行边缘检测,通过提取其轮廓获得准确的对象,最后提出基于区域的对象跟踪方法,完成后续帧视频对象的分割。实验结果表明,本文提出的方法可以获得良好的分割结果。     

基于变化检测和帧差累积的视频对象分割方法

针对目前许多视频对象分割方法中分割边界不精 确、遮挡和不规则运动问题解决效果 不好等问题,提出一种新的视频 对象分割算法。利用人眼的视觉特点,即对运动(时间梯度)和边缘(空间梯度)都特别敏 感,把帧间运动变化检测(时域 定区间帧差累积)和图像的边缘检测结合起来,首先利用t显著 性检验检测对称帧的帧间变化,再对检测出的初始运动变化 区域进行时域定区间帧差累积计算,并进一步整合形成记忆掩膜(MT);然后应用改进的Kirs ch边 缘检测算子较为精确地检测当 前帧中所有的边缘信息,减少MT膜中的残留噪声,并通过时空滤波获得语义视频对 象平面;最终选择性的应用填充及 形态学处理操作,实现视频对象的分割。实验结果验证了本文算法的有效性和准确性。     

一种基于内容的视频对象分割算法

提出了一种基于内容的视频对象分割算法。该算法先对分块的图像进行运动估计，利用运动矢量初步分割运动前景和背景，对于产生的背景噪声使用改进的中值滤波算法滤除，并用形态学的方法恢复出运动物体。实验结果表明：该算法能够较好地从视频序列中分割运动前景和背景，比较适合于在基于内容的视频编码标准MPEG-4中使用。     

基于时空信息融合的视频对象分割系统

提出了一种有效的时空融合视频分割系统.首先利用基于梯度的分水岭算法对图像进行分割,并利用基于时空联合的区域合并方法克服过分割现象,然后结合改进的帧差掩模对目标进行提取.试验结果表明,由于该系统充分利用了图像的颜色信息,能较完整地分割出对象,并且对象边缘更加准确.     

基于时域定区间记忆补偿的视频对象分割算法

提出了一种新的基于时域定区间记忆补偿的视频对象分割算法。首先,使用对称帧帧差累计法及帧差图像的四阶矩检测出初始运动变化区域;然后,对检测出的初始运动变化区域通过时域定区间记忆补偿法进行补偿,并进一步整合形成全局运动记忆母板,在空域使用Sobel边缘检测算子较为精确地检测得到当前帧中所有边缘;最后,进行时空融合,从而提取出完整精细的运动对象轮廓并通过填充得到运动对象模板。实验证明了本文算法的正确性和快速性。     

3D视频目标分割与快速跟踪

提出一种面向3D视频的目标分割与快速跟踪算法,主要分为空域分割和时域与视域跟踪两个主要步骤。空域分割采用基于改进C-V模型的方法。首先基于帧差法提取运动区域作为目标的初始轮廓,以减少迭代次数加快收敛速度。然后在传统的C-V模型中加入图像边缘信息以加强C-V模型对模糊边缘的处理能力,提高分割结果的主管视觉效果。时域和视域的目标跟踪采用基于改进生物地理优化的快速跟踪方法。实验结果表明所提分割与跟踪算法快速、高效。     

一种新的基于时空信息的视频分割

提出了一种新的基于时空信息的视频分割算法．即先将原始图像标记成不同的区域,然后以帧间差分得到的对象运动信息作为评判准则,将这些区域分别归类于前景对象和背景．达到对象分割的目的。特别是在区域标记的过程中,采用了一种新的基于分水岭的区域标识技术。通过对标准图像序列的实验结果可以看到,利用该算法能够较精确地分割出视频对象。     

视频对象分割研究的发展

讨论了视频对象分割技术的发展及研究现状，介绍了时域分割、空域分割以及时空联合分割等技术，提出了一种基于累积帧差的视频对象分割算法。     

VIDEO OBJECT SEGMENTATION BY 2-D MESH-BASED MOTION ANALYSIS

Video object extraction is a key technology in content-based video coding.A novel video object extracting algorithm by two Dimensional (2-D) mesh-based motion analysis is proposed in this paper.Firstly,a 2-D mesh fitting the original frame image is obtained via feature detection algorithm. Then,higher order statistics motion analysis is applied on the 2-D mesh representation to get an initial motion detection mask.After post-processing,the final segmenting mask is quickly obtained.And hence the video object is effectively extracted.Experimental results show that the proposed algorithm combines the merits of mesh-based segmenting algorithms and pixel-based segmenting algorithms,and hereby achieves satisfactory subjective and objective performance while dramatically increasing the segmenting speed.     

2-D mesh-based video object segmentation and tracking with occlusion resolution

This paper integrates fully automatic video object segmentation and tracking including detection and assignment of uncovered regions in a 2-D mesh-based framework. Particular contributions of this work are (i) a novel video object segmentation method that is posed as a constrained maximum contrast path search problem along the edges of a 2-D triangular mesh, and (ii) a 2-D mesh-based uncovered region detection method along the object boundary as well as within the object. At the first frame, an optimal number of feature points are selected as nodes of a 2-D content-based mesh. These points are classified as moving (foreground) and stationary nodes based on multi-frame node motion analysis, yielding a coarse estimate of the foreground object boundary. Color differences across triangles near the coarse boundary are employed for a maximum contrast path search along the edges of the 2-D mesh to refine the boundary of the video object. Next, we propagate the refined boundary to the subsequent frame by using motion vectors of the node points to form the coarse boundary at the next frame. We detect occluded regions by using motion-compensated frame differences and range filtered edge maps. The boundaries of detected uncovered regions are then refined by using the search procedure. These regions are either appended to the foreground object or tracked as new objects. The segmentation procedure is re-initialized when unreliable motion vectors exceed a certain number. The proposed scheme is demonstrated on several video sequences.     

Dynamic programming framework for automatic video object segmentation and vision-assisted video pre-processing

A generic definition of video objects, which is a group of pixels with temporal motion coherence, is considered. The generic video object (GVO) is the superset of the conventional video objects considered in the object segmentation literature. Because of its motion coherence, the GVO can be easily recognised by the human visual system. However, due to its arbitrary spatial distribution, the GVO cannot be easily detected by the existing algorithms which often assume the spatial homogeneousness of the video objects. The concept of extended optical flow is introduced and a dynamic programming framework for the GVO detection and segmentation is developed, whose solution is given by the Viterbi algorithm. Using this dynamic programming formulation, the proposed object detection algorithm is able to discover the motion path of the GVO automatically and refine its spatial region of support progressively. In addition to object segmentation, the proposed algorithm can also be applied to video pre-processing, removing the so-called 'video mask' noise in digital videos. Experimental results show that this type of vision-assisted video pre-processing significantly improves the compression efficiency.     

Two-dimensional mesh-based mosaic representation for manipulationof video objects with occlusion

We present a two-dimensional (2-D) mesh-based mosaic representation, consisting of an object mesh and a mosaic mesh for each frame and a final mosaic image, for video objects with mildly deformable motion in the presence of self and/or object-to-object (external) occlusion. Unlike classical mosaic representations where successive frames are registered using global motion models, we map the uncovered regions in the successive frames onto the mosaic reference frame using local affine models, i.e., those of the neighboring mesh patches. The proposed method to compute this mosaic representation is tightly coupled with an occlusion adaptive 2-D mesh tracking procedure, which consist of propagating the object mesh frame to frame, and updating of both object and mosaic meshes to optimize texture mapping from the mosaic to each instance of the object. The proposed representation has been applied to video object rendering and editing, including self transfiguration, synthetic transfiguration, and 2-D augmented reality in the presence of self and/or external occlusion. We also provide an algorithm to determine the minimum number of still views needed to reconstruct a replacement mosaic which is needed for synthetic transfiguration. Experimental results are provided to demonstrate both the 2-D mesh-based mosaic synthesis and two different video object editing applications on real video sequences.     

目标基视频编码中的运动目标提取与跟踪新算法

自动、快速的视频目标提取与跟踪是目标基视频编码中的一项关键技术.本文提出一种运动目标提取与跟踪新算法.首先,根据多帧运动信息和高阶统计检测方法得到二值运动掩模图像,然后提出一种改进分水岭算法对运动区域及其周围部分进行分割.将二者所得结果进行投影运算,得到最终运动目标.最后提出一种运动目标跟踪新算法,能对目标进行有效的跟踪.实验结果说明了本文算法的有效性.     

一种基于区域Gibbs势能函数的视频运动对象分割算法

提出了一种基于时空联合分析框架的视频对象分割算法,通过改进的分水岭变换对视频图像进行帧内空间区域划分,并根据帧间运动信息和区域的空间特性得到初步的分割掩模;然后建立基于区域的马尔可夫随机场分布模型,并定义对应的Gibbs势能函数,通过迭代条件模式(ICM)方法求解得到最小化能量,从而获得稳定的分割标记场,准确地提取视频对象。实验结果表明,提出的分割算法性能优于欧洲COST211研究组所得到的分割结果。     

动态背景下融合运动线索和颜色信息的视频目标分割算法

针对现有动态背景下目标分割算法存在的局限性,提出了一种融合运动线索和颜色信息的视频序列目标分割算法。首先,设计了一种新的运动轨迹分类方法,利用背景运动的低秩特性,结合累积确认的策略,可以获得准确的运动轨迹分类结果;然后,通过过分割算法获取视频序列的超像素集合,并计算超像素之间颜色信息的相似度;最后,以超像素为节点建立马尔可夫随机场模型,将运动轨迹分类信息以及超像素之间颜色信息统一建模在马尔可夫随机场的能量函数中,并通过能量函数最小化获得每个超像素的最优分类。在多组公开发布的视频序列中进行测试与对比,结果表明,本文方法可以准确分割出动态背景下的运动目标,并且较传统方法具有更高的分割准确率。     

Estimation of depth fields suitable for video compression based on3-D structure and motion of objects

Intensity prediction along motion trajectories removes temporal redundancy considerably in video compression algorithms. In three-dimensional (3-D) object-based video coding, both 3-D motion and depth values are required for temporal prediction. The required 3-D motion parameters for each object are found by the correspondence-based E-matrix method. The estimation of the correspondences-two-dimensional (2-D) motion field-between the frames and segmentation of the scene into objects are achieved simultaneously by minimizing a Gibbs energy. The depth field is estimated by jointly minimizing a defined distortion and bit-rate criterion using the 3-D motion parameters. The resulting depth field is efficient in the rate-distortion sense. Bit-rate values corresponding to the lossless encoding of the resultant depth fields are obtained using predictive coding; prediction errors are encoded by a Lempel-Ziv algorithm. The results are satisfactory for real-life video scenes.     

Background removal of multiview images by learning shape priors.

Image-based rendering has been successfully used to display 3-D objects for many applications. A well-known example is the object movie, which is an image-based 3-D object composed of a collection of 2-D images taken from many different viewpoints of a 3-D object. In order to integrate image-based 3-D objects into a chosen scene (e.g., a panorama), one has to meet a hard challenge--to efficiently and effectively remove the background from the foreground object. This problem is referred to as multiview images (MVIs) segmentation. Another task requires MVI segmentation is image-based 3-D reconstruction using multiview images. In this paper, we propose a new method for segmenting MVI, which integrates some useful algorithms, including the well-known graph-cut image segmentation and volumetric graph-cut. The main idea is to incorporate the shape prior into the image segmentation process. The shape prior introduced into every image of the MVI is extracted from the 3-D model reconstructed by using the volumetric graph cuts algorithm. Here, the constraint obtained from the discrete medial axis is adopted to improve the reconstruction algorithm. The proposed MVI segmentation process requires only a small amount of user intervention, which is to select a subset of acceptable segmentations of the MVI after the initial segmentation process. According to our experiments, the proposed method can provide not only good MVI segmentation, but also provide acceptable 3-D reconstructed models for certain less-demanding applications.