Robust Visual Tracking with SIFT Features and Fragments Based on Particle Swarm Optimization

We propose a novel approach for visual tracking based on a particle swarm optimization (PSO) framework using SIFT feature points correspondence and multiple fragments in a candidate target region to cope with the problems of partial occlusions, illumination changes, and large motion changes of the tracked target. Firstly, optimal search in the successive frame tracking process is performed by the PSO algorithm, which guides all particles towards the global optima state based on a fitness function. Then, the SIFT feature information is integrated into the iterative results of PSO to acquire a more accurate tracking state. Secondly, we present an effective appearance model updating criterion, which evaluates which fragments in appearance model need updating at each frame. However, the fragments with occluded parts or low quality measure values are not updated. The method for updating appearance model is introduced to improve the tracking performance. Compared with state-of-the-art algorithms, the proposed method can still stably track the target during the course of long-term partial occlusions using superior fragments of tracked target. The experiment results demonstrate the effectiveness of our algorithm in complex environments where the target object undergoes partial occlusions and large changes in pose and illumination.     

基于多尺度Gabor滤波器组的不变特征点提取新方法

 针对复杂背景的光学遥感图像数据,提出一种基于尺度空间理论和多尺度Gabor滤波器组的目标局部不变特征提取方法.该方法优点有二:一是利用Gabor滤波器的带通特性和多通道特性可从目标图像中提取更符合视觉特性、更具物理直观性的特征点,增强了不变特征提取方法在照度变化、噪声和背景干扰下的稳健性;二是基于尺度空间理论设计的多尺度Gabor滤波器组,可使提取的特征点具有尺度不变性,增强了对遥感图像复杂几何畸变的适应性.     

基于ICA分布模型的粒子滤波跟踪算法

为了在复杂背景、部分遮挡和光照变化等因素干扰的情况下鲁棒地跟踪视频序列中感兴趣的运动目标,提出了一种改进的粒子滤波跟踪算法。该算法针对颜色信息在目标表述中存在的不足,首先对观测模型进行改进,提出了一种基于ICA特征分布的目标模型,将基于核函数的目标特征描述转换到ICA特征空间,由于光照变化引起灰度变化经ICA后仍是同一分量,因此能有效的适应光照变化,不仅考虑并充分利用了空间信息。有效的解决了光照变化及背景颜色相近造成的目标丢失现象,提高了目标跟踪算法的鲁棒性。同时,考虑到粒子的退化现象,将均值平移算法嵌入到粒子滤波的跟踪框架中,待各粒子经过系统传播后,利用均值平移算法使粒子向其领域局部极大值处移动,使得粒子集中在测量模型的局部区域内,只需少量的粒子就覆盖了尽可能的目标分布,很好地克服了粒子滤波器的退化现象并有效缩短了计算时间,提高了目标跟踪算法的准确性和系统的实时性。实验表明,该算法不仅能在复杂背景下准确的跟踪目标,而且在光线变化和部分遮挡情况下也能保证不丢失目标。      

Robust visual tracking via CAMShift and structural local sparse appearance model

This paper addresses issues in visual tracking where videos contain object intersections, pose changes, occlusions, illumination changes, motion blur, and similar color distributed background. We apply the structural local sparse representation method to analyze the background region around the target. After that, we reduce the probability of prominent features in the background and add new information to the target model. In addition, a weighted search method is proposed to search the best candidate target region. To a certain extent, the weighted search method solves the local optimization problem. The proposed scheme, designed to track single human through complex scenarios from videos, has been tested on some video sequences. Several existing tracking methods are applied to the same videos and the corresponding results are compared. Experimental results show that the proposed tracking scheme demonstrates a very promising performance in terms of robustness to occlusions, appearance changes, and similar color distributed background.     

Real-time background subtraction-based video surveillance of people by integrating local texture patterns

This paper presents a real-time surveillance system for detecting and tracking people, which takes full advantage of local texture patterns, under a stationary monocular camera. A novel center-symmetric scale invariant local ternary pattern feature is put forward to combine with pattern kernel density estimation for building a pixel-level-based background model. The background model is then used to detect moving foreground objects on every newly captured frame. A variant of a fast human detector that utilizes local texture patterns is adopted to look for human objects from the foreground regions, and it is assisted by a head detector, which is proposed to find in advance the candidate locations of human, to reduce computational costs. Each human object is given a unique identity and is represented by a spatio-color-texture object model. The real-time performance of tracking is achieved by a fast mean-shift algorithm coupled with several efficient occlusion-handling techniques. Experiments on challenging video sequences show that the proposed surveillance system can run in real-time and is quite robust in segmenting and tracking people in complex environments that include appearance changes, abrupt motion, occlusions, illumination variations and clutter.     

Spatio-temporal crowd density model in a human detection and tracking framework

Recently significant progress has been made in the field of person detection and tracking. However, crowded scenes remain particularly challenging and can deeply affect the results due to overlapping detections and dynamic occlusions. In this paper, we present a method to enhance human detection and tracking in crowded scenes. It is based on introducing additional information about crowds and integrating it into the state-of-the-art detector. This additional information cue consists of modeling time-varying dynamics of the crowd density using local features as an observation of a probabilistic function. It also involves a feature tracking step which allows excluding feature points attached to the background. This process is favorable for the later density estimation since the influence of features irrelevant to the underlying crowd density is removed. Our proposed approach applies a scene-adaptive dynamic parametrization using this crowd density measure. It also includes a self-adaptive learning of the human aspect ratio and perceived height in order to reduce false positive detections. The resulting improved detections are subsequently used to boost the efficiency of the tracking in a tracking-by-detection framework. Our proposed approach for person detection is evaluated on videos from different datasets, and the results demonstrate the advantages of incorporating crowd density and geometrical constraints into the detection process. Also, its impact on tracking results have been experimentally validated showing good results.     

基于在线半监督boosting的协同训练目标跟踪算法

基于自训练的判别式目标跟踪算法使用分类器的预测结果更新分类器自身,容易累积分类错误,从而导致漂移问题。为了克服自训练跟踪算法的不足,该文提出一种基于在线半监督boosting的协同训练目标跟踪算法(简称Co-SemiBoost),其采用一种新的在线协同训练框架,利用未标记样本协同训练两个特征视图中的分类器,同时结合先验模型和在线分类器迭代预测未标记样本的类标记和权重。该算法能够有效提高分类器的判别能力,鲁棒地处理遮挡、光照变化等问题,从而较好地适应目标外观的变化。在若干个视频序列的实验结果表明,该算法具有良好的跟踪性能。     

多目标跟踪中特征融合算子的选择技术研究

在基于信息融合的视频多目标跟踪过程中,特征融合算子的选择是关键.传统的基于特征融合的视频目标跟踪是将两个或两个以上特征作为测量特征通过某一融合机制进行融合权重.在一个高度非线性和难以建立模型的情形下,多目标之间的遮挡现象影响视频特性测量.为了解决该问题,提出了一种动态的选择融合算子的方法,以得到最好的跟踪性能.实验结果表明,动态地选择融合操作,可以提高互相遮挡的多目标跟踪性能.     

基于颜色属性直方图的尺度目标跟踪算法研究

利用目标颜色信息的跟踪算法,容易受到环境光照、尺度变化、相似背景等因素的干扰,导致跟踪任务失败。为了克服以上问题,该文提出一种基于颜色属性空间的鲁棒尺度目标跟踪算法。该算法首先将原始的RGB颜色空间映射到颜色属性(Color Names, CN)空间,减少目标颜色在跟踪过程中受环境变化影响。然后采用一种背景加权约束的颜色属性直方图,来抑制相似背景的干扰。最后,为了解决目标尺度变化带来的影响,先用梯度上升法粗略估计尺度,再用约束项精确求解尺度,并利用反向一致性检验,进一步提高尺度估计的准确性。该文选取了5段典型视频进行实验,并与相关算法进行比较。结果表明所提算法能够消除环境光照、阴影、相似背景和尺度变化等因素所带来的影响,在中心位置误差和跟踪成功率性能指标上,优于其它算法。     

基于稀疏表示多子模板的鲁棒目标跟踪算法

目标跟踪技术是一项富有挑战性的研究课题,在红外成像搜索、红外精确制导、智能监控、运动识别等领域有着广泛的应用。文中提出了一种基于稀疏表示多子模板的鲁棒目标跟踪算法。首先,提出一种基于自适应辨别信息的子模板选择方法,最大限度地捕捉目标的结构信息,提高模板子块的整体描述;针对直方图对光照敏感的缺点,引入了稀疏表示理论对子模板进行描述,提高模板子块的表达能力和适应能力;其次通过构造表决图的形式对目标位置进行表决和融合决策;最后设计了一种动态的子模板更新策略,来有效地应对目标外观模型的变化。在大量测试图像序列中的仿真实验表明,文中所提算法可以有效应对形变、光照变化、部分遮挡、完全遮挡以及虚假目标干扰和背景干扰,具有较高的鲁棒性。     

Facial Recognition Using Multisensor Images Based on Localized Kernel Eigen Spaces

A feature selection technique along with an information fusion procedure for improving the recognition accuracy of a visual and thermal image-based facial recognition system is presented in this paper. A novel modular kernel eigenspaces approach is developed and implemented on the phase congruency feature maps extracted from the visual and thermal images individually. Smaller sub-regions from a predefined neighborhood within the phase congruency images of the training samples are merged to obtain a large set of features. These features are then projected into higher dimensional spaces using kernel methods. The proposed localized nonlinear feature selection procedure helps to overcome the bottlenecks of illumination variations, partial occlusions, expression variations and variations due to temperature changes that affect the visual and thermal face recognition techniques. AR and Equinox databases are used for experimentation and evaluation of the proposed technique. The proposed feature selection procedure has greatly improved the recognition accuracy for both the visual and thermal images when compared to conventional techniques. Also, a decision level fusion methodology is presented which along with the feature selection procedure has outperformed various other face recognition techniques in terms of recognition accuracy.      

采用频闪成像技术的柔性气动外形运动物体SIFT特征跟踪(英文)

近年来,有关微型飞行器的结构动力学、材料气动弹性以及飞行控制方面的研究受到了高度的重视。为了提高飞行器的空气动力学检测能力,提出了一种基于频闪成像技术的柔性气动外形物体跟踪方法。利用尺度不变特征转换(SIFT)算法提取出的特征对于图像的尺度变换、旋转以及光照变化和局部图像变形等具有的不变特性,提出了一种利用感兴趣区域中SIFT特征对柔性气动外形运动物体进行探测与跟踪的方法。该方法在获取物体的状态、位置以及空间转换关系等方面表现出良好的性能,并且为同一场景中同一物体在不同位置之间的相互匹配提供了可靠保证。实验表明:在该实验系统中,基于频闪成像技术、利用SIFT特征作为柔性气动外形物体探测的方法具有一定的可行性。     

一种新的快速局部不变特征算法

针对传统局部不变特征算子主方向提取不准确和匹配阶段过于耗时的问题,提出一种基于RI-LBP 算子和混合spill 树的快速局部不变特征算法。首先提出一种FAST-Difference 算法,提取出模板图像和待匹配图像的稳定特征点,然后使用旋转不变的RI-LBP 描述符计算特征向量,最后对特征向量集使用混合spill 树进行匹配并使用RANSAC 算法剔除误匹配点。RI-LBP 算子自身的旋转不变性能够在一定程度上克服特征点主方向确定不准确的缺点,使特征描述符的提取更加稳定,并生成更简单的53 维局部不变特征描述符。混合spill 树相对于kd-tree 省略了回溯过程,对于高维数据拥有更好的匹配效率。实验证明:该算法与SURF 算法描述能力相近,旋转和光照条件下比SURF 性能更优,并且匹配速度更快。     

一种对光照变化鲁棒的均值漂移跟踪方法

颜色作为一个有效的视觉特征,被广泛的用于基于表面模型的跟踪中。但在跟踪过程中,由于光照、视角及摄像机参数等的变化,往往会造成目标颜色的改变,使得跟踪不稳定。该文提出了一种新的基于局部背景动态修正模糊颜色直方图的均值漂移跟踪方法,在颜色-空间域运用核密度估计建立目标的模糊颜色直方图模型,利用目标的局部背景动态修正目标模型,克服了基于传统颜色直方图建立目标模型时对于光照变化较为敏感的缺点。实验验证了该文算法可以平滑相似性表面,减小局部极值点对跟踪的影响,在光照剧烈变化的情况下能够实时鲁棒地跟踪目标。     

融合颜色信息与深度信息的运动目标检测方法

基于颜色信息的运动目标检测易受光照、阴影等影响,基于深度信息的运动目标检测存在目标边缘噪声大,无法检测距离背景较近的目标等问题。针对上述问题,该文利用CCD相机获取的颜色信息及TOF相机获取的深度信息分别为每个像素建立颜色与深度信息的分类器,根据像素点的深度特征及前一帧的检测结果,自适应地为每个分类器的输出分配不同的权值,实现运动目标的检测。该文采集多组视频序列进行实验,实验结果表明该方法能有效解决单独利用颜色或深度信息进行运动目标检测时出现的问题。     

基于HSV颜色空间的自适应性运动目标检测

格拉斯曼尼(Grassmannian)算法是一种可以由高度不完整信息追踪子空间的在线学习算法,它在视频运动目标跟踪时具有鲁棒性和低复杂度等优点,可以应用在视频前景与背景的实时分离的情况.针对格拉斯曼尼算法在前景分离中,面对室内全局光线突变会产生大量噪声的问题,提出了一种优化的预处理方法.通过HSV色彩空间变换对视频进行阴影检测,根据阈值判断光线变化情况并自适应调整前景内容,最终实现在光照变化情况下的运动目标检测,并有效去除了原格拉斯曼尼算法在光线突变会产生的大量噪声,提高了对光照变化的鲁棒性.     

使用M进制小波对尺度与旋转不变的图像特征点进行检测

基于小波变换和尺度空间理论,提出了一种尺度与旋转不变的图像特征点的检测方法。首先对图像进行多尺度的M进制小波变换,然后根据M进制小波变换系数的能量构造对应的二阶矩阵,最后通过考察该矩阵的特征值确定图像的特征点。实验表明,与目前最常用的方法相比,本文方法对图像的旋转变化与尺度变化均具有更好的不变性,在光照变化和噪声干扰等外部条件影响下也能保持较高的鲁棒性。     

Mean LBP and modified fuzzy C-means weighted hybrid feature for illumination invariant mean-shift tracking

Object tracking is a critical task in surveillance and activity analysis. Two main issues for tracking are appearance (illumination) and structural (size of a target) variations of the object. We propose a method which is robust and addresses these issues by incorporating features that are less variant to these changes. The proposed features are mean local binary pattern (mLBP), an illumination invariant texture feature, and modified fuzzy c-means (MFCM) weighted color histogram to handle both illumination and scale changes. These features are combined to form a hybrid mean-shift (MS) vector and used in the MS vector framework for target tracking. Experimental results using standard benchmark videos show that the proposed scheme can lead to better localization and robust tracking in challenging illumination scenarios, when compared to several existing tracking algorithms.