Detection and Tracking of Occluded People

We consider the problem of detection and tracking of multiple people in crowded street scenes. State-of-the-art methods perform well in scenes with relatively few people, but are severely challenged by scenes with many subjects that partially occlude each other. This limitation is due to the fact that current people detectors fail when persons are strongly occluded. We observe that typical occlusions are due to overlaps between people and propose a people detector tailored to various occlusion levels. Instead of treating partial occlusions as distractions, we leverage the fact that person/person occlusions result in very characteristic appearance patterns that can help to improve detection results. We demonstrate the performance of our occlusion-aware person detector on a new dataset of people with controlled but severe levels of occlusion and on two challenging publicly available benchmarks outperforming single person detectors in each case.     

基于多区域联合粒子滤波的人体运动跟踪

针对视频人体运动跟踪中的遮挡问题, 提出了一种基于多区域联合粒子滤波器的跟踪方法. 算法把人体划分为多个关键区域, 通过基于多区域无向图的联合运动模型, 构造联合粒子滤波器, 并运用区域关联的观测评估策略对目标状态进行联合预测, 从而完成遮挡情况下目标的跟踪. 实验结果表明, 与基于单区域粒子滤波的跟踪方法相比, 本文提出的算法在具有较长时间部分和全部遮挡的跟踪问题上, 取得了较好的实验结果.     

视频监控下的人脸跟踪与识别系统

针对智能视频监控系统的要求,设计了一个基于视频监控的自动多人脸跟踪识别系统,该系统的功能是实时跟踪视频监控范围内的人脸并鉴别人脸的身份。针对复杂背景及类似人脸区域的影响,提出了一种Adaboost人脸检测算法和主动形状模型相结合的人脸检测算法,实现人脸的准确检测;针对视频监控范围内人脸偏转、交错以及由于人员不断出入而导致人脸数目发生变化的问题,提出了CamShift和Kalman滤波器相结合的多人脸跟踪算法,同时对跟踪到的人脸进行实时身份识别。实验证明,该系统在视频监控范围内对人脸检测和身份识别准确,跟踪实时性好,是一种建立实时视频监控系统的实用方法。     

基于多人遮挡的定位跟踪算法

针对传统视频跟踪算法中存在的问题,提出一种基于多人遮挡问题的定位跟踪算法,该算法采用改进的投影分析方法对运动目标进行定位,并结合Kalman滤波进行匹配跟踪。仿真实验结果表明,该算法能够有效区分、定位、跟踪处于2种不同遮挡状态下的每个人的位置,具有一定应用价值。     

基于DSP的视频人脸监控系统设计与实现

针对目前人脸监控系统存在不能及时决策、盲目跟踪的问题,提出综合人脸检测、识别、跟踪与控制的智能监控系统,并在TMS320DM642芯片上实现;使用Adaboost级联多层分类器检测人脸,基于Gabor小波图像相似度匹配识别人脸,对识别出的感兴趣人脸用Camshift算法实现跟踪,再通过串口驱动云台带动摄像头旋转,使感兴趣人脸保持在视场内并且在模拟显示器上显示;实验结果表明,本系统满足实时视频监控要求,对人脸旋转、遮挡、光照鲁棒性高;本系统可以推广至视频会议、视频聊天、可视电话等领域,有良好的应用前景。     

A Bayesian plan-view map based approach for multiple-person detection and tracking

This work proposes a novel approach for people detection and tracking in colour-with-depth sequences using a particle filtering approach. Detection and tracking are performed in plan-view maps integrating occupancy and height information with a novel plan-view map representation for colour information. Using the three maps, we propose a multiple particle filtering algorithm for people detection and tracking. The observation model proposed integrates information from the three maps so that people with different coloured clothes are not confused even when they interact at close distances. To avoid the coalescence problem when people with similar coloured clothes approach each other, the weight of particles is modified by an interaction factor that combines colour and position information. The algorithm also avoids the coalescence problem in case of total occlusion by means of an occlusion detection and recovering mechanism. Finally, a solution is proposed to improve the exponential complexity of multiple particle filters so that the algorithm proposed has linear complexity.The approach proposed has been tested in several colour-with-depth sequences where people move and interact freely in the environment. In the sequences, people walk at different distances, cross their paths causing frequent occlusions, jump, run and have close interactions such as shaking hands or embracing each other. The experimental results show that our proposal is able to detect and keep track of every person with a low error and deals with partial and total occlusions. Besides, the detection and tracking techniques presented are appropriate for large tracking problems in real-time applications since their complexity is linear, are suitable for parallel processing and allow the integration of information provided by multiple stereo vision sensors.     

粒子群优化的压缩跟踪算法

目的 针对基于压缩感知理论的跟踪算法跟踪效率不高和难以抗遮挡的问题,提出一种结合压缩感知和粒子群优化的跟踪算法。方法 将粒子群优化算法结合到压缩跟踪算法中,提出了采用粒子群优化的搜索方法替代在确定候选目标时,采用每隔一个像素选取一个候选目标的搜索策略;在目标发生遮挡时,采用粒子群优化的方法进行整幅图全局搜索。结果 20个视频序列数据库的目标跟踪结果表明,本文算法极大地提高了跟踪效率,并有很强的抗目标遮挡和形变的能力从而提高了跟踪的成功率。20个视频数据库进行了定量的分析,平均成功率达到了65.2%,平均中心位置偏差为33.4,平均每秒运行155.5帧。结论 提出的跟踪算法优化了搜索目标的计算次数,提高了算法的运行效率,当在目标发生遮挡时,采用粒子群优化进行全局搜索直到目标重新出现,从而提高了跟踪算法的跟踪成功率,本文算法能适用于不同场景,能够提高智能视频监控系统的智能监控性能。     

以颜色和形状直方图为线索的粒子滤波人脸跟踪

跟踪器的设计和跟踪线索的选择与表达是人脸跟踪中的两大关键因素,针对一般人脸跟踪算法中常用简单椭圆来描述人脸形状线索时易受背景干扰的缺点,以及视频目标跟踪中动态模型和观测模型的非线性非高斯特点,提出了一种以颜色和形状直方图为线索的粒子滤波人脸跟踪算法,该算法在粒子滤波基本框架之下,引入了一种新的用直方图来描述人脸形状的方法,并对其进行了改进,用来作为人脸跟踪的形状线索。同时,为了减轻背景干扰,提出了一种经验有效边缘的检测方法。实验表明,该跟踪方法不仅能有效地处理人脸旋转、背景中的肤色干扰和部分遮掩问题,并且能够在由于大面积遮掩等原因而丢失目标的情况下,及时有效地重新捕获已丢失的目标。     

基于OpenCV的人脸检测与跟踪

随着社会公共安全体系的逐步完善,基于人脸的智能视频监控技术在安全监控、视频分析以及人机交互等场合发挥出越来越重要的作用。传统的Camshift算法虽然能快速地跟踪运动目标,但它不仅需要手动设定跟踪的对象,而且当跟踪对象遇到遮挡和相同颜色障碍物干扰时很容易丢失目标。针对上述问题,在OpenCV的基础上,采用Adaboost,Camshift和Kalman滤波相融合的方法,实现了快速、自动和准确的人脸检测与跟踪。     

A video database of moving faces and people

We describe a database of static images and video clips of human faces and people that is useful for testing algorithms for face and person recognition, head/eye tracking, and computer graphics modeling of natural human motions. For each person there are nine static "facial mug shots" and a series of video streams. The videos include a "moving facial mug shot," a facial speech clip, one or more dynamic facial expression clips, two gait videos, and a conversation video taken at a moderate distance from the camera. Complete data sets are available for 284 subjects and duplicate data sets, taken subsequent to the original set, are available for 229 subjects.     

3D head tracking under partial occlusion

A new algorithm for 3D head tracking under partial occlusion from 2D monocular image sequences is proposed. The extended superquadric (ESQ) is used to generate a geometric 3D face model in order to reduce the shape ambiguity during tracking. Optical flow is then regularized by this model to estimate the 3D rigid motion. To deal with occlusion, a new motion segmentation algorithm using motion residual error analysis is developed. The occluded areas are successfully detected and discarded as noise. Furthermore, accumulation error is heavily reduced by a new post-regularization process based on edge flow. This makes the algorithm more stable over long image sequences. The algorithm is applied to both synthetic occlusion sequence and real image sequences. Comparisons with the ground truth indicate that our method is effective and is not sensitive to occlusion during head tracking.     

基于人脸检测的人数统计系统

提出一种基于人脸检测的人数统计方法。运用AdaBoost算法进行人脸检测,根据人脸在图像中出现的位置及大小等几何信息统计进入教室的人数。在系统实现中,通过人眼及肤色特征检测提高人脸检测精度,同时利用跳帧检测方法,排除由人员的不同行走速度造成的误差统计。实验结果证明,该方法具有较快的检测及统计速度。     

Real-time multiple people tracking for automatic group-behavior evaluation in delivery simulation training

This paper aims at generating an automated way to evaluate the team-behavior of trainees in a delivery simulation course using video-processing techniques with emphasis on multiple people tracking. The paper is composed of two interacting, but clearly separated stages: moving people segmentation and multiple people tracking. At people segmentation stage, the combination of the Gaussian Mixture Model (GMM) and the Dynamic Markov Random Fields (DMRF) technique helps to extract the foreground pixels. For a better extraction of the human silhouettes, the energy function of DMRF is extended with texture information. At multiple people tracking stage, we concentrate on solving human-occlusion problem caused by interacting persons based on silhouette data and a non-linear regression model. Our model effectively transfers the person location problem during the occlusion into the finding of the local maximum points on a smooth curve, so that visual persons in the partial or complete occlusion can still be precisely captured. We have compared our algorithm with two other popular tracking algorithms: mean-shift and particle-filter. Experimental results reveal that the correctness of our method is much higher than the mean-shift algorithm and slightly lower than a particle-filter, however, with the major benefit of being a factor of 10–15 faster in computing.     

融合YOLO检测的多目标跟踪算法

针对目前视频多目标跟踪过程中的遮挡问题,提出了一种融合YOLO v3的多目标检测和跟踪算法,选定基于检测跟踪的框架作为跟踪的整体框架,使用YOLO v3来实现对目标信息的检测工作,在选定某一检测类别的基础上,使用本文提出的跟踪算法,通过数据关联完成对此类别的多目标跟踪,并针对跟踪过程中的目标遮挡问题以及因目标遮挡而引起的轨迹跟踪异常的问题,提出了修正算法。测试视频中被遮挡的大部分目标都能准确地跟踪,但在背景移动时也会发生一部分目标身份互换的情况。所提出的算法在解决多目标跟踪中的遮挡问题时具有一定的准确性和实时性。     

基于深度信息的压缩感知人脸检测跟踪

传统的压缩感知跟踪是基于彩色视频图像序列中的目标跟踪, 但在跟踪过程中可能会受到光照变化和旋转遮挡因素的影响, 从而导致复杂环境下跟踪结果的鲁棒性不足. 为了获得稳定的跟踪结果, 提出了一种基于深度信息的压缩感知人脸检测跟踪算法. 首先, 根据改进的质心分割算法确定首帧深度图中人脸的跟踪位置. 其次, 根据深度信息计算出深度图中每一点对应的平均曲率并形成平均曲率图. 然后, 基于平均曲率图随机提取压缩特征; 最后, 通过压缩降维, 目标邻域搜索, 迭代更新特征模板, 计算出平均曲率图中下一帧人脸的最优跟踪位置, 实现人脸跟踪. 实验结果表明, 将人脸的深度信息和压缩感知特征相结合在光照变化和旋转遮挡情况下具有很好的鲁棒性, 能更好的实现复杂背景下对多姿态人脸的跟踪.     

基于改进的核相关滤波器的目标跟踪算法

针对传统的KCF(核相关滤波器)目标跟踪算法在严重遮挡情况下出现目标跟踪漂移和丢失的问题,提出了一种改进的KCF目标跟踪算法.在传统的算法上增加了遮挡判断,如没有出现遮挡,则用KCF进行跟踪;若发生遮挡则用粒子滤波进行预测,然后把预测位置送给KCF算法.最后OTB-13的测试库选择David2、David3和Soccer视频遮挡序列进行跟踪测试,跟踪结果表明了改进方法的有效性;然后选择50组视频序列比较算法的有效性,相比传统的KCF算法,其跟踪精度和成功率分别提高了6.1％和2.9％.在目标发生严重遮挡时,该算法具有良好的鲁棒性.     

一类视频序列中的人脸检测与实时跟踪算法

提出一种新的人脸快速检测与实时跟踪算法,能够对视频序列中的人脸进行快速、准确地检测和跟踪。算法分为开始状态、目标丢失状态的人脸检测和连续状态的目标跟踪。首先预测人脸两眼之间的中心位置,得到人脸的预测位置并对预测位置处的图像进行模板匹配,快速检测出人脸准确位置。然后利用检测出的人脸修正人脸模板,并在检测出的位置、旋转度、缩放比例等条件下,对后面序列图像进行小位置、小角度的快速跟踪。实验采用了多种环境下的大量视频,结果显示该算法能够快速跟踪视频序列中的人脸并具有很高的准确性、鲁棒性。     

一种快速多人脸跟踪算法

提出一个基于Mean Shift的实时多人脸跟踪算法。通过引入自适应目标跟踪窗口,改进了Mean Shift算法的目标连续跟踪性能;提出序贯跟踪法解决多人脸跟踪过程中目标发生粘连重叠的问题;引入多辅助信息解决了相邻两帧中人脸的对应问题。为进一步提高整个算法的跟踪速度和鲁棒性,引入卡尔曼滤波器对目标进行预测。实验结果表明该算法具有很好的实时性和跟踪效果。     

一种结合肤色特征的人脸跟踪算法

将CAMSHIFT算法用于人脸跟踪时,当跟踪目标被其它人脸遮挡时会发生跟踪失败,针对这一不足,提出一种结合肤色区域特征的连续自适应均值移动算法(SCCAMSHIFT):提取目标的肤色区域作为已知特征,通过跟踪窗口的变化来判断遮挡的发生,并在遮挡发生后利用已知特征来寻找丢失的目标.实验结果表明,SCCAMSHIFT算法能够较好的解决跟踪过程中类肤色物体的遮挡问题.     

基于梯度方向直方图特征的多核跟踪

提出了基于梯度方向直方图特征的多核跟踪算法, 对跟踪过程中的光线变化和部分遮挡具有较强的鲁棒性. 该算法将目标分块, 分别提取出每块的核函数加权的梯度方向直方图特征. 目标模型和候选目标模型的相似度用所有块直方图间的Bhattacharyya系数之和进行度量, 目标的跟踪通过Mean shift算法最大化两者的相似度实现. 对车辆、人体等多个目标的跟踪验证了本文提出算法的有效性.