自适应融合颜色和深度信息的人体轮廓跟踪

采用活动轮廓对人体目标建模,提出一 种新的水平集框架下自适应融合RGB-D图像的颜色和深度信息的人体轮廓跟踪方法. 设计了一种基于超像素的局部自适应权重计算方法,自动确定深度信息在水平集演化中的重要性. 基于深度信息的活动轮廓驱动外力包括由边缘生成的梯度向量流和由目标/背景深度模型生成的置信图,基于颜色信息的驱动外力由目标/背景颜色模型生成的置信图,这三种外力通过局部自适应权重融合,驱动活动轮廓向目标的边界演化.为了得到更加精确的目标轮廓和防止误差漂移,基于本文观察到的人体表面在深度图像中的两个特性,提出两个简单但有效的算法对水平集方法得到的结果进行精化调整. 最后,通过实验验证了本文算法的优越性.     

Video object tracking based on improved gradient vector flow snake and intra-frame centroids tracking method

Accurately tracking the video object in video sequence is a crucial stage for video object processing which has wide applications in different fields. In this paper, a novel video object tracking algorithm based on the improved gradient vector flow (GVF) snake model and intra-frame centroids tracking algorithm is proposed. Unlike traditional gradient vector flow snake, the improved gradient vector flow snake adopts anisotropic diffusion and a four directions edge operator to solve the blurry boundary and edge shifting problem. Then the improved gradient vector flow snake is employed to extract the object contour in each frame of the video sequence. To set the initial contour of the gradient vector flow snake automatically, we design an intra-frame centroids tracking algorithm. Splitting the original video sequence into segments, for each segment, the initial contours of first two frames are set by change detection based on t-distribution significance test. Then, utilizing the redundancy between the consecutive frames, the subsequent frames’ initial contours are obtained by intra-frame motion vectors. Experimental results with several test video sequences indicate the validity and accuracy of the video object tracking.     

结合统计和梯度信息的高效活动轮廓模型

提出一种由统计和梯度信息驱动的活动轮廓模型。该模型有效利用梯度信息使演化轮廓线快速精确地定位到物体的边缘;同时,由局部统计信息和全局统计信息构造符号压力函数,减少噪声对轮廓线演化的影响。另外,模型利用局部统计信息能够有效处理灰度分布不均的图像,全局信息的利用避免了演化轮廓线陷入局部最小,因此,该模型可以任意设置初始轮廓线。最后通过高斯卷积核对水平集函数规则化,避免了传统模型中计算代价高昂的重新初始化和规则化。实验结果表明,提出的模型不仅能够在任意初始轮廓下精确有效地分割灰度分布均匀的图像和不均匀的图像,而且对噪声具有较好的鲁棒性。     

一种基于主动轮廓模型的医学图像序列分割算法

介绍了一种结合live wire算法和活动轮廓模型的医学图像序列的分割方法.通过把live wire算法和图像分割中一般的区域增长方法结合,对传统live wire算法进行了改进,并用改进后的算法对医学图像序列中的单张或多张切片进行交互式地准确分割.然后计算机利用活动轮廓模型自动分割相邻的未分割切片.还通过在活动轮廓模型的边缘点中引入记录已分割物体边缘附近局部区域特征的灰度模型,把已分割切片中的物体与背景的局部区域特征带入相邻的未分割切片中,并用由灰度模型定义的区域相似性代替活动轮廓模型中的外能来引导边缘轮廓收敛到物体的实际边缘.最后介绍了一种基于live wire算法思想的简单的分割结果交互式修复方法.实验结果表明该算法仅需少量用户交互就能快速准确地从医学图像序列中分割出感兴趣的物体,在医学图像分析中具有实用价值.     

Using Prior Shapes in Geometric Active Contours in a Variational Framework

In this paper, we report an active contour algorithm that is capable of using prior shapes. The energy functional of the contour is modified so that the energy depends on the image gradient as well as the prior shape. The model provides the segmentation and the transformation that maps the segmented contour to the prior shape. The active contour is able to find boundaries that are similar in shape to the prior, even when the entire boundary is not visible in the image (i.e., when the boundary has gaps). A level set formulation of the active contour is presented. The existence of the solution to the energy minimization is also established.We also report experimental results of the use of this contour on 2d synthetic images, ultrasound images and fMRI images. Classical active contours cannot be used in many of these images.     

基于改进活动轮廓的视频对象自动分割及跟踪算法

为了能够从视频序列图像中准确地提取出运动视频对象,提出了一种基于改进活动轮廓的视频对象自动分割及跟踪方法。该方法首先采用连续帧间差的4次统计量假设检验来确定视频对象的运动区域,并使用形态滤波消除残余噪声和空洞;然后根据3帧序列图像得到的前后运动区域的相与运算来有效地解决运动视频对象前后帧的遮挡问题,以获得视频对象模板,当提取出视频对象模板的边缘轮廓后,再用梯度向量流场作为外力的改进活动轮廓算法来获得视频对象的精确轮廓;最后以此视频对象的轮廓为基础进行运动补偿,以得到下一帧图像的初始曲线,再使用改进的活动轮廓算法对下一帧图像进行分割,即可实现视频对象的跟踪。该方法不仅能够消除差分图像中的显露背景,得到运动视频对象精确的轮廓,并且可进行多目标的分割与跟踪。     

基于LBF方法的测地线活动轮廓模型

经典的测地线活动轮廓模型分割含有弱边界的目标时,难以得到真实边界。为解决这一问题,文中将结合局部二元拟合(LBF)方法和测地线活动轮廓模型的优点,提出一种基于LBF方法的测地线活动轮廓模型。首先,将LBF方法的能量泛函进行归一化处理,取代测地线活动轮廓模型的边缘停止函数。其次,构建梯度下降流,促使轮廓曲线运动到目标边界上。最后,对5组含有弱边界的图像进行仿真实验。实验结果表明,文中模型能准确分割含有弱边界的目标,具有抗噪性,同时对初始曲线的位置不敏感,优于其它常见改进的测地线活动轮廓模型。     

基于自适应活动轮廓模型的实时手势跟踪

在基于视觉的手势分析与识别中，一个关键环节是手势跟踪。本文提出了基于颜色信息的自适应活动轮廓模型，并与均值漂移算法相互融合，实现图像序列的实时手势跟踪。跟踪算法分为两步进行，首先应用均值漂移算法实现手部区域的定位，然后基于自适应活动轮廓模型提取手部轮廓。在跟踪过程中，轮廓提取为下一帧的区域定位更新搜索窗口，提高了搜索效率，使目标跟踪达到实时性要求。同时，本文根据跟踪区域模板与目标模板的相似性度量Bhattacaryya系数给出了在跟踪目标被遮挡时的处理方法，有效地解决了这一难题。实验结果证明了在无遮挡和遮挡两种情况下算法均能实现准确、实时的手势跟踪。     

Object tracking using deformable templates

We propose a method for object tracking using prototype-based deformable template models. To track an object in an image sequence, we use a criterion which combines two terms: the frame-to-frame deviations of the object shape and the fidelity of the modeled shape to the input image. The deformable template model utilizes the prior shape information which is extracted from the previous frames along with a systematic shape deformation scheme to model the object shape in a new frame. The following image information is used in the tracking process: 1) edge and gradient information: the object boundary consists of pixels with large image gradient, 2) region consistency: the same object region possesses consistent color and texture throughout the sequence, and 3) interframe motion: the boundary of a moving object is characterized by large interframe motion. The tracking proceeds by optimizing an objective function which combines both the shape deformation and the fidelity of the modeled shape to the current image (in terms of gradient, texture, and interframe motion). The inherent structure in the deformable template, together with region, motion, and image gradient cues, makes the proposed algorithm relatively insensitive to the adverse effects of weak image features and moderate amounts of occlusion     

An active contour model for object tracking using the previous contour

An active contour model is proposed for object tracking using prior information. Conventional algorithms have many problems when applied in object tracking. The proposed active contour algorithm, a model using an edge of an adapted color feature, not only modifies the internal energy function of the conventional algorithm to extend the search range and reduce the computational burden, but also modifies the external energy function to reduce the edge candidates of the object. The algorithm searches normally and uses dynamic programming to solve the energy minimization problem. The main drawbacks of a conventional snake algorithm, i.e., shrinking, a limited search range, sensitivity to outliers, are improved with the proposed algorithm. We illustrate the effectiveness of our scheme using some tracking examples. This work was presented, in part, at the Seventh International Symposium on Artificial Life and Robotics, Oita, Japan, January 16–18, 2002     

一种基于图割与GVF Snake的凹型目标快速提取算法

将图割理论与GVF Snake模型有机结合,提出了一种凹型目标的快速提取算法。首先用图割算法对初始轮廓线迭代变形,使其在快速提取非凹型段目标边界的同时将轮廓线有效地置于梯度矢量流力场的“有效逼近域”内,然后用GVF Snake算法继续对轮廓线迭代变形,提取凹型段目标边界。实验表明,该算法能快速、准确提取凹型目标。     

先验形状力场参数活动轮廓模型及其医学图像分割

先验形状参数活动轮廓模型是一种抗噪声干扰稳定的图像分割方法．它具有对弱边缘、凹区域进行分割的能力，同时有较大的边缘捕捉范围．通过引入一种非距离性的先验形状力场，构建一种新的能反映先验形状的参数活动轮廓模型．新的先验形状活动轮廓模型避免了曲线之间距离的计算，减少了模型的复杂性．新的方法可以较好地解决传统型参数活动轮廓模型的一些本质缺陷.实验对带噪声且为弱边缘的医学CT图像和超声图像进行分割能得到理想的边缘轮廓.     

Velocity-Guided Tracking of Deformable Contours in Three Dimensional Space

This paper presents a 3D active contour model for boundary detection and tracking of non-rigid objects, which applies stereo vision and motion analysis to the class of energy-minimizing deformable contour models, known as snakes. The proposed contour evolves in three-dimensional space in reaction to a 3D potential function, which is derived by projecting the contour onto the 2D stereo images. The potential function is augmented by a kinetic term, which is related to the velocity field along the contour. This term is used to guide the inter-image contour displacement. The incorporation of inter-frame velocity estimates in the tracking algorithm is especially important for contours which evolve in 3D space, where the added freedom of motion can easily result in loss of tracking. The proposed scheme incorporates local velocity information seamlessly in the snake model, with little computational overhead, and does not require exogenous computation of the optical flow or related quantities in each image. The resulting algorithm is shown to provide good tracking performance with only one iteration per frame, which provides a considerable advantage for real time operation.     

Contour segmentation in 2D ultrasound medical images with particle filtering

Object segmentation in medical images is an actively investigated research area. Segmentation techniques are a valuable tool in medical diagnostics for cancer tumours and cysts, for planning surgery operations and other medical treatment. In this paper, a Monte Carlo algorithm for extracting lesion contours in ultrasound medical images is proposed. An efficient multiple model particle filter for progressive contour growing (tracking) from a starting point is developed, accounting for convex, non-circular forms of delineated contour areas. The driving idea of the proposed particle filter consists in the incorporation of different image intensity inside and outside the contour into the filter likelihood function. The filter employs image intensity gradients as measurements and requires information about four manually selected points: a seed point, a starting point, arbitrarily selected on the contour, and two additional points, bounding the measurement formation area around the contour. The filter performance is studied by segmenting contours from a number of real and simulated ultrasound medical images. Accurate contour segmentation is achieved with the proposed approach in ultrasound images with a high level of speckle noise.     

Active contour model for simultaneous MR image segmentation and denoising

In this paper, a new region-based active contour model is proposed for magnetic resonance image segmentation and denoising based on the global minimization framework and level set evolution. A new region fitting energy based on Nadaraya–Watson estimator and local image information is defined to enforce the curve evolution. By this improved region fitting term, the images with noise and intensity un-uniformity can be segmented and denoised. Inspired by the Perona–Malik diffusion equation, an edge-preserving regularization term is defined through the duality formulation to penalize the length of region boundaries. By this new regularization term, the edge information is utilized to improve the contour?s ability of capturing the edge and remaining smooth during the evolution. The energy functional of the proposed model is minimized by an efficient dual algorithm avoiding the inefficiency of the gradient descent method. Experiments on medical images demonstrate the proposed model provides a hybrid way to perform image segmentation and image denoising simultaneously.     

基层层次光流的半自动时空视频分割技术

在新一代MPEG-4视频编码标准中，为了支持面向对象编码和实现基于内容的应用，视频的半自动分割成为关键技术之一，为此提出了一种基于层次光流的半自动时空视频分割算法。该算法由空域分割和时域分割组成。在空域分割中，提出的基于点的图形用户界面（PBGUI），在用户的协助下，能够精确地定义需要分割的视频对象（VO）。时域分割根据空域分割的结果采用层次光流算法对视频对象进行边界和整体跟踪。实验结果表明，利用该算法，能够精确地分割出视频对象。     

基于层次光流的半自动时空视频分割技术

在新一代 MPEG- 4视频编码标准中 ,为了支持面向对象编码和实现基于内容的应用 ,视频的半自动分割成为关键技术之一 ,为此提出了一种基于层次光流的半自动时空视频分割算法 .该算法由空域分割和时域分割组成 .在空域分割中 ,提出的基于点的图形用户界面 (PBGU I) ,在用户的协助下 ,能够精确地定义需要分割的视频对象 (VO) .时域分割根据空域分割的结果采用层次光流算法对视频对象进行边界和整体跟踪 .实验结果表明 ,利用该算法 ,能够较精确地分割出视频对象 .     

基于改进几何活动轮廓模型的图像分割算法

针对传统几何活动轮廓（GAC）模型易出现边界泄露的缺陷,提出一个基于改进GAC模型的图像变速分割算法。该算法结合了图像边缘梯度信息和边缘角点坐标信息,通过改变演化曲线在角点及弱边界处的常量速度,避免活动轮廓曲线继续演化进入目标边界内,造成边界泄露和角点丢失现象,影响目标轮廓提取的准确性。实验结果表明：该算法可使演化曲线更加准确地停在目标边缘,并且在一定程度上减少了边界泄露问题。     

Active contour model combining region and edge information

A novel active contour model is proposed by combining region and edge information. Its level set formulation consists of the edge-related term, the region-based term and the regularization term. The edge-related term is derived from the image gradient, and facilitates the contours evolving into object boundaries. The region-based term is constructed using both local and global statistical information, and related to the direction and velocity of the contour propagation. The last term ensures stable evolution of the contours. Finally, a Gaussian convolution is used to regularize the level set function. In addition, a new quantitative metric named modified root mean squared error is defined, which can be used to evaluate the final contour more accurately. Experimental results show that the proposed method is efficient and robust, and can segment homogenous images and inhomogenous images with the initial contour being set freely.     

基于多特征的目标轮廓跟踪*

文章中以核密度方法分别建立了图像颜色与纹理特征的概率密度模型,并用贝叶斯模型估计后验概率作为像素能量。构造的新曲线区域能量泛函分别统计内部能量与外部能量之和,以最小能量曲线对应跟踪目标的曲线。通过计算梯度下降流推进曲线演化,减少曲线能量直至收敛到目标曲线。实验结果证明所提算法能在连续视频帧中准确地提取刚体以及非刚体目标的外部轮廓。