基于运动特征的颜色粒子滤波器

传统颜色粒子滤波器不能对跟踪状态进行自我判断,粒子容易失效,导致目标跟偏甚至跟丢。针对该问题,设计一种基于运动特征的颜色粒子滤波器。在分析目标运动特征的基础上,改进系统运动模型,建立自适应背景颜色尺度;在跟踪过程中通过最优估计速度和加速度来判断粒子滤波器的跟踪状态,建立相应的捕获机制以跟踪目标。实验结果证明,改进的颜色粒子滤波器能对与背景相似的运动目标进行有效准确的跟踪。     

基于混合粒子滤波和稀疏表示的目标跟踪算法

针对图像序列中的运动目标在跟踪过程中易受到光照等复杂环境、外观变化及部分遮挡影响的问题,提出基于全局信息和局部信息的混合粒子滤波算法.将目标的局部二元模式纹理特征引入粒子滤波算法,通过稀疏编码目标子块,充分利用目标的局部空间信息,并结合全局信息以确定当前帧中目标的位置.在跟踪过程中实时更新模板,这在一定程度上提高算法的鲁棒性.实验表明在目标处于复杂环境中算法能达到较理想的跟踪效果.     

A color-based particle filter for multiple object tracking in an outdoor environment

Tracking multiple objects is more challenging than tracking a single object. Some problems arise in multiple-object tracking that do not exist in single-object tracking, such as object occlusion, the appearance of a new object and the disappearance of an existing object, updating the occluded object, etc. In this article, we present an approach to handling multiple-object tracking in the presence of occlusions, background clutter, and changing appearance. The occlusion is handled by considering the predicted trajectories of the objects based on a dynamic model and likelihood measures. We also propose target-model-update conditions, ensuring the proper tracking of multiple objects. The proposed method is implemented in a probabilistic framework such as a particle filter in conjunction with a color feature. The particle filter has proven very successful for nonlinear and non-Gaussian estimation problems. It approximates a posterior probability density of the state, such as the object’s position, by using samples or particles, where each state is denoted as the hypothetical state of the tracked object and its weight. The observation likelihood of the objects is modeled based on a color histogram. The sample weight is measured based on the Bhattacharya coefficient, which measures the similarity between each sample’s histogram and a specified target model. The algorithm can successfully track multiple objects in the presence of occlusion and noise. Experimental results show the effectiveness of our method in tracking multiple objects.     

A local-motion-based probabilistic model for visual tracking

Color-based tracking is prone to failure in situations where visually similar targets are moving in a close proximity or occlude each other. To deal with the ambiguities in the visual information, we propose an additional color-independent visual model based on the target's local motion. This model is calculated from the optical flow induced by the target in consecutive images. By modifying a color-based particle filter to account for the target's local motion, the combined color/local-motion-based tracker is constructed. We compare the combined tracker to a purely color-based tracker on a challenging dataset from hand tracking, surveillance and sports. The experiments show that the proposed local-motion model largely resolves situations when the target is occluded by, or moves in front of, a visually similar object.     

基于粒子滤波和在线训练支持向量机的目标跟踪新方法

序列图像中运动目标跟踪的有效性和鲁棒性是一个非常富有挑战性的课题。为提高在运动背景条件下视觉目标跟踪的性能,克服复杂环境对跟踪算法准确性的影响,提出了一种基于粒子滤波和在线训练支持向量机的目标跟踪新方法。从目标的特征描述和提取着手,引入了积分直方图快速提取特征的方法,加快粒子滤波器运行速度,满足一定的实时性要求。同时,分析了运动背景条件下具有代表性的跟踪算法的本质和特性,结合目标识别创新性地提出在线训练支持向量机的方法,通过在线识别信息和跟踪信息的融合保证算法具备较强的鲁棒性。实验结果表明,该算法能有效的解决动态背景条件下遮挡、光照变化和运动模糊等复杂情况下,对目标进行准确、有效、近乎实时的跟踪。     

基于自适应特征融合的粒子滤波目标跟踪算法

提出了一种基于自适应特征融合的粒子滤波跟踪算法,用于解决传统的粒子滤波跟踪方法在复杂背景下容易跟踪失败的问题。该算法选取颜色特征和边缘特征来描述目标,并通过粒子滤波进行特征融合,根据可靠性因子调整各特征的权值系数;在跟踪过程中,随着目标自身形变,自适应更新目标模板。实验结果表明,在复杂背景下以及受到遮挡时,本算法能够准确稳健地跟踪目标。     

基于统计模型的遗传粒子滤波器人体运动跟踪*

提出了一种基于统计模型的遗传粒子滤波器人体运动跟踪算法。引入局域二值模式(LBP)算子提取纹理特征,利用颜色直方图与纹理直方图相似度的加权和表示目标相似度,以有效解决自遮挡对跟踪的影响。利用该统计模型精确表示运动人体轮廓,目标形状可由一可变形状参数确定;采用遗传粒子滤波器作为跟踪算法以提高粒子滤波器的鲁棒性和精度。通过预测更新可变形状参数,再利用统计模型中目标形状与形状可变参数的关系得到图像序列各帧中人体轮廓,有效降低了计算量,从而达到快速而准确的跟踪目的。最后用上述方法进行了实验,验证了该方法的实用性和有效性。     

字典学习联合粒子滤波鲁棒跟踪

针对运动目标鲁棒跟踪问题,提出一种基于离线字典学习的视频目标跟踪鲁棒算法。采用字典编码方式提取目标的局部区域描述符,随后通过训练分类器将跟踪问题转化为背景和前景分类问题,最终通过粒子滤波对物体位置进行估计实现跟踪。该算法能够有效解决由于光照变化、背景复杂、快速运动、遮挡产生的跟踪困难。经过不同图像序列的实验对比表明,与现有方法相比,本文算法的鲁棒性较高。     

基于IMM多传感器顺序粒子滤波跟踪机动目标算法

针对交互式多模型粒子滤波在跟踪机动目标时精度受限问题,提出一种基于交互式多模型(IMM)的多传感器顺序粒子滤波算法。采用IMM机制实现目标运动模式的确认;在合理利用单传感器量测和多传感器量测中冗余和互补信息的基础上,引入顺序重抽样方法改善粒子分布,并将改善后的粒子应用于IMM粒子滤波算法框架。仿真实验结果表明:新算法能够估计出强机动目标状态,且精度明显优于标准IMM粒子滤波算法。     

Robust object tracking via integration of particle filtering with deep detection

We propose a video object tracker (IDPF-RP) which is built upon the variable-rate color particle filtering with two innovations: (i) A deep region proposal network guided candidate BB selection scheme based on the dynamic prediction model of particle filtering is proposed to accurately generate the qualified object BBs. The introduced region proposal alignment scheme significantly improves the localization accuracy of tracking. (ii) A decision level fusion scheme that integrates the particle filter tracker and a deep detector resulting in an improved object tracking accuracy is formulated. This enables us to adaptively update the target model that improves robustness to appearance changes arising from high motion and occlusion. Performance evaluation reported on challenging VOT2018/2017/2016 and OTB-50 data sets demonstrates that IDPF-RP outperforms state-of-the-art trackers especially under size, appearance and illumination changes. Our tracker achieves comparable mean accuracy on VOT2018 while it respectively provides about 8%, 15%, and 30% higher success rates on VOT2016, VOT2017 and OTB-50 when IoU threshold is 0.5.     

Robust tracking with adaptive appearance learning and occlusion detection

It is still challenging to design a robust and efficient tracking algorithm in complex scenes. We propose a new object tracking algorithm with adaptive appearance learning and occlusion detection in an efficient self-tuning particle filter framework. The appearance of an object is modeled with a set of weighted and ordered submanifolds, which can guarantee the adaptability when there is fast illumination or pose change. To overcome the occlusion problem, we use the reconstruction error data of the appearance model to extract occlusion region by graph cuts. And the tracking result is improved with feedback of occlusion detection. The motion model is also integrated with adaptability to overcome the abrupt motion problem. To improve the efficiency of particle filter, the number of samples is tuned with respect to the scene conditions. Experimental results demonstrate that our algorithm can achieve great robustness, high accuracy and good efficiency in challenging scenes.     

基于字典学习的粒子滤波鲁棒跟踪算法

字典学习广泛应用于图像去噪、图像分类等领域,但是将离线字典训练如何应用于视频目标跟踪的研究较少。本文采用一种字典编码方法提取目标的局部区域描述符,通过训练分类器将跟踪问题转化为背景和前景二值分类问题,并通过粒子滤波对物体位置进行估计实现跟踪。不同图像序列的实验结果表明,与现有的方法相比本文的算法具有较好的鲁棒性。     

Visual Tracking Based on Adaptive Mean Shift Multiple Appearance Models

To overcome the tracking issues caused by the complex environment namely, illumination variation and background clutters, tracking algorithm was proposed based on multi-cues fusion to construct a robust appearance model, indeed the global motion is estimated using the H∞ filter based on the nearly constant velocity motion model, then the traditional Mean Shift (MS) estimate the local state associated with each sub appearance model, finally the weights of the sub appearance models are adjusted and combined to estimate the final state. The proposed method is tested on public videos that present different environment issues. Experiences and comparisons conducted show the robustness of our methods in challenging tracking conditions.     

基于SIFT 特征和粒子滤波的目标跟踪方法

现有的基于外观的目标跟踪算法,在光照变化和遮挡的情况下,不能准确跟踪目标．针对这个问题,考 虑到尺度不变特征（SIFT 特征）对于光照变换、尺度变换以及仿射变换的不变性,提出了一种利用SIFT 特征建立 目标模型,结合粒子滤波实现目标跟踪的新方法．在跟踪过程中,根据目标模型和候选目标中SIFT 特征点在时间 窗内的匹配情况,自适应更新目标模型的特征点,使模型能够适应目标外观变化．仿真结果证明了方法在不同环境 下的健壮性．     

Incremental Tensor Subspace Learning and Its Applications to Foreground Segmentation and Tracking

Appearance modeling is very important for background modeling and object tracking. Subspace learning-based algorithms have been used to model the appearances of objects or scenes. Current vector subspace-based algorithms cannot effectively represent spatial correlations between pixel values. Current tensor subspace-based algorithms construct an offline representation of image ensembles, and current online tensor subspace learning algorithms cannot be applied to background modeling and object tracking. In this paper, we propose an online tensor subspace learning algorithm which models appearance changes by incrementally learning a tensor subspace representation through adaptively updating the sample mean and an eigenbasis for each unfolding matrix of the tensor. The proposed incremental tensor subspace learning algorithm is applied to foreground segmentation and object tracking for grayscale and color image sequences. The new background models capture the intrinsic spatiotemporal characteristics of scenes. The new tracking algorithm captures the appearance characteristics of an object during tracking and uses a particle filter to estimate the optimal object state. Experimental evaluations against state-of-the-art algorithms demonstrate the promise and effectiveness of the proposed incremental tensor subspace learning algorithm, and its applications to foreground segmentation and object tracking.     

融合目标特征和空间信息的粒子滤波跟踪

传统的基于颜色直方图的粒子滤波跟踪算法不能很好地利用跟踪对象的空间结构信息,因此在邻域颜色相似或目标模型微小变化时,不能取得良好的跟踪效果。提出一种融合目标特征和目标空间位置信息的粒子滤波跟踪算法,该算法鉴于目标空间位置包含跟踪对象一定的结构信息,可以和目标特征互为补充,利用定义的融合目标特征和目标空间位置的度量函数来进行跟踪对象相似度度量,以提高跟踪算法的稳健性和精确性。同时针对粒子滤波计算粒子相似度时可并行的特点,运用OpenMP共享存储并行计算进行粒子滤波跟踪的加速。实验表明,基于融合目标特征和空间信息的粒子滤波跟踪算法能得到更鲁棒的跟踪效果,可以有效地提高目标跟踪的速度。     

改进协方差矩阵的智能车视觉目标跟踪方法

智能车辆视觉目标具有非线性、噪声分布非高斯性的典型特点，现有算法难以实时估计目标的状态。针对识别物体复杂且多变，很难用完全的特征来描述待识别目标及其背景的不断变化，提出了一种用于融合颜色特征及SURF（Speed-Up Robust Features）特征的协方差矩阵来改进粒子滤波算法，从而提升视觉目标跟踪的实时性，满足智能车辆的要求。首先，对采集的图像进行预处理来获取感兴趣区域。接着，通过融合颜色特征及SURF特征构造范围感兴趣区域（Region Of Interest，ROI）的目标特征协方差矩阵，建立目标状态预测模型及状态观测模型，用于改进粒子滤波算法粒子重采样过程，实现对目标的精确跟踪。最后，将该方法与Mean-shift算法和颜色属性（CN）算法进行对比。实验结果表明，在智能车视觉跟踪过程中对光环境瞬时变化、目标物体存在短时遮挡以及目标物体姿态改变时，该算法在满足智能车辆对实时性要求的前提下，有效提升算法的精确度及鲁棒性。     

基于重要性加权的结构稀疏跟踪方法

针对视觉跟踪中描述目标能力的有限性和局部稀疏表示模型的有效性,提出了一种基于重要性加权的结构稀疏跟踪方法.该方法采用结构稀疏表示对目标表观建模,根据在表达目标表观时所起的作用,对每个局部图像进行加权处理;在粒子滤波框架下,应用最大后验概率对目标的状态进行估计;通过带有遮挡检测机制的模板更新策略对目标模板进行在线的更新以避免跟踪漂移.实验表明,该方法有效地减弱了目标表观变化对模型的影响,对于视频序列中的遮挡、光照变化和目标姿态改变等有稳健的跟踪效果.     

Tracking objects with generic calibrated sensors: An algorithm based on color and 3D shape features

We present a color and shape based 3D tracking system suited to a large class of vision sensors. The method is applicable, in principle, to any known calibrated projection model. The tracking architecture is based on particle filtering methods where each particle represents the 3D state of the object, rather than its state in the image, therefore overcoming the nonlinearity caused by the projection model. This allows the use of realistic 3D motion models and easy incorporation of self-motion measurements. All nonlinearities are concentrated in the observation model so that each particle projects a few tens of special points onto the image, on (and around) the 3D object’s surface. The likelihood of each state is then evaluated by comparing the color distributions inside and outside the object’s occluding contour. Since only pixel access operations are required, the method does not require the use of image processing routines like edge/feature extraction, color segmentation or 3D reconstruction, which can be sensitive to motion blur and optical distortions typical in applications of omnidirectional sensors to robotics. We show tracking applications considering different objects (balls, boxes), several projection models (catadioptric, dioptric, perspective) and several challenging scenarios (clutter, occlusion, illumination changes, motion and optical blur). We compare our methodology against a state-of-the-art alternative, both in realistic tracking sequences and with ground truth generated data.     

加权多特征外观表示的实时目标追踪

目的 目标跟踪是计算机视觉领域重点研究方向之一,在智能交通、人机交互等方面有着广泛应用。尽管目前基于相关滤波的方法由于其高效、鲁棒在该领域取得了显著进展,但特征的选择和表示一直是追踪过程中建立目标外观时的首要考虑因素。为了提高外观模型的鲁棒性,越来越多的跟踪器中引入梯度特征、颜色特征或其他组合特征代替原始灰度单一特征,但是该类方法没有结合特征本身考虑不同特征在模型中所占的比重。方法 本文重点研究特征的选取以及融合方式,通过引入权重向量对特征进行融合,设计了基于加权多特征外观模型的追踪器。根据特征的计算方式,构造了一项二元一次方程,将权重向量的求解转化为确定特征的比例系数,结合特征本身的维度信息,得到方程的有限组整数解集,最后通过实验确定最终的比例系数,并将其归一化得到权重向量,进而构建一种新的加权混合特征模型对目标外观建模。结果 采用OTB-100中的100个视频序列,将本文算法与其他7种主流算法,包括5种相关滤波类方法,以精确度、平均中心误差、实时性为评价指标进行了对比实验分析。在保证实时性的同时,本文算法在Basketball、DragonBaby、Panda、Lemming等多个数据集上均表现出了更好的追踪结果。在100个视频集上的平均结果与基于多特征融合的尺度自适应跟踪器相比,精确度提高了1.2%。结论 本文基于相关滤波的追踪框架在进行目标的外观描述时引入权重向量,进而提出了加权多特征融合追踪器,使得在复杂动态场景下追踪长度更长,提高了算法的鲁棒性。