基于非重叠多摄像头的实时监控系统

针对室内外环境的动态特点,描述了一个可扩展的多摄像头实时监控系统,提出了新的基于非重叠多摄像头的运动目标跟踪方法.该方法利用亮度信息在单摄像头内检测和跟踪目标,结合运动目标的亮度特征和路径特征,在多摄像头内估计运动目标外形变化,并建立运动目标路径模型,使用融合算法实现基于非重叠多摄像头的目标跟踪.与其他监控系统相比,该系统不要求摄像头校准,在有亮度变化的非重叠多摄像头场景中能立即准确跟踪目标.实验证明,提出的方法有好的跟踪效果.     

监控系统中的多摄像头协同算法

给出了一个分布式多摄像头监控系统结构,描述了一种使用路径模型和目标外形变化估计的数据融合方案,提出了一种新的在分布式监控系统中的多摄像头协同算法(PDA,PriorityandDistanceAlgorithm)。提出的算法基于多摄像头数据融合结果,根据任务优先级、目标与摄像头之间的距离及目标的可见性情况,分配摄像头给目标,其特点是使系统中有高优先级并距离摄像头最近的可见目标优先分配摄像头。实验结果表明提出算法能协同多摄像头可靠地跟踪人。     

AVE监控系统中基于轨迹约束的目标检索方法

针对增强虚拟环境(AVE)视频监控系统,提出了一种基于目标二维图像特征和三维空时特征并进行轨迹约束的运动车辆检索方法.二维检索中采用SURF特征匹配进行目标精确定位;三维检索中通过提取运动目标空时特征,充分利用AVE系统中摄像头关联信息进行关联分析,缩小目标搜索范围.实验结果表明,该算法具有较高的检索效率与精度,特别适用于多摄像头AVE监控系统中目标快速定位,掌握其在监控区域中的全空间运动信息.     

多场景视频监控中的人物连续跟踪

针对多场景监控,提出一种能在非重叠的多摄像机之间,实时地检测与被跟踪行人（目标）的视频监控系统。该系统分别对每个摄像机视频进行背景建模、前景检测以及运动目标的特征提取,当目标离开摄像机视域的时候,根据已知的拓扑关系向相关摄像机发布监控任务,当有目标进入处于有效监控状态的摄像机视域时,进行目标匹配,从而实现在多摄像机系统中对行人目标的持续跟踪。实验表明,该系统在非重叠摄像机场景中能实现实时的、鲁棒的目标跟踪。     

一种重叠视域多摄像头协同运动目标跟踪方法

针对重叠视域范围内多摄像头目标跟踪匹配问题,提出一种基于视野分界线的运动目标检测跟踪方法,通过Sift算法与Harris算法相融合对存在重叠视域范围的图像自动获取特征匹配点,利用所获特征匹配点对生成视野分界线,当目标通过分界线时,依据颜色信息的投影不变量方法,通过目标中心位置与视野分界线之间的距离来判断运动目标,进而实现运动目标的交接,完成后续动态目标的追踪.通过设置相同的视频帧数和实验场景与已有文献进行对比实验,所提算法对运动目标跟踪准确率分别为76％、87％、88％,均高于文献算法跟踪精度.实验结果表明所提出的算法能够实现多摄像头间的目标连续跟踪既能解决对同一运动目标的实时跟踪,又可以解决多视角协同重叠视域范围内的运动目标跟踪距离较近而导致运动目标丢失的问题,通有效提高目标跟踪的准确性,为多视角运动目标跟踪提供了一种新的解决方法.     

基于TMS320DM642 DSP的实时视频监控系统实现

为了实现视频监控运动目标自动检测和跟踪的应用要求,设计了基于高性能DSP的运动目标跟踪嵌入式系统。该系统利用视频格式YUV420模型的Y分量进行运动目标检测,并以目标的形心为跟踪点,通过绝对误差和判决标准对运动目标进行跟踪;最终利用协同控制策略对摄像头进行控制,保证运动目标长时间保持在视野范围内。该系统通过基于DSP硬件结构的各软件模块优化,提高系统的处理能力,实现了系统的高效跟踪。     

视频分析技术在日志系统中的应用

近年来,以多传感器信息融合为特征的日志系统成为了一个新的热点问题。日志系统使用者携带便携式摄像头所获得的视频信息是一类主要信息,获取其关键帧序列对完善系统功能具有重要意义。与其他应用相比,日志系统视频更加复杂多变。基于以上条件,本文提出非参数模型的方法估计背景运动;针对前景运动物体检测和跟踪问题,本文在非监督模式识别方法的基础上,使用统计、时空、颜色特征等给出前景区域判断;最后,利用上述结果得到关键帧序列。     

基于区域CSIFT特征的目标识别算法

无重叠多摄像机监控系统在使用局部形状特征进行目标识别时,会忽略颜色信息,且对光学变换具有不稳定性.为此,提出一种基于区域彩色尺度不变特征变换的目标识别算法.通过修正的双色反射模型,提取对光照特性和物体几何特性具有不变性的颜色特征,得到尺度不变特征变换描述予,利用颜色特征和形状特征建立目标模型.实验结果表明,该算法对刚体和非刚体目标的识别都能取得较好的效果.     

鉴别性特征学习模型实现跨摄像头下行人即时对齐

为解决由于采用延后的关联算法而造成目标错误匹配和子序列漏匹配的问题,提出一种使用鉴别性特征学习模型实现跨摄像头下行人即时对齐的方法.首先基于孪生网络模型整合行人分类和行人身份鉴别模型,仅通过目标行人的单帧信息就可习得具有良好鉴别性的行人外观特征,完成行人相似性值计算;其次提出跨摄像头行人即时对齐模型,根据行人外观、时序和空间3个方面的关联适配度实时建立最小费用流图并求解.实验结果表明,在行人重识别数据集Market-1501和CUHK03上,行人分类和身份鉴别模型的融合能显著提升特征提取的有效性且泛化能力良好,性能全面优于Gate-SCNN与S-LSTM方法;进一步地,在非重叠区域的跨摄像头行人跟踪的基准数据集NLPR_MCT上,该方法的行人即时关联精度比2014年ECCV跨摄像头行人跟踪冠军的延后关联算法高出了3.3%,仅次于当前最高精度算法6.6%,应用于跨摄像头跟踪时,跟踪精度亦超过当前的大部分算法.     

基于发布订阅结构的计算机视觉跟踪研究

文中报道了使用发布订阅中间件搭建的一个跟踪系统,通过单摄像头采集图像,经过分析处理,计算出运动物体的相对位置,同时控制摄像头转动,对运动物体进行实时追踪.整个系统主要包括4个方面,以发布/订阅为中心结构连接3个子系统、目标获取、目标跟踪、采集摄像头控制.文中为卡尔曼滤波定义了新的向量,预测目标运动趋势;根据物体的运动信息自行设计了摄像头控制程序.算法有充分的理论依据和实验验证.     

Systems and algorithms for autonomous and scalable crowd surveillance using robotic PTZ cameras assisted by a wide-angle camera

We report an autonomous surveillance system with multiple pan-tilt-zoom (PTZ) cameras assisted by a fixed wide-angle camera. The wide-angle camera provides large but low resolution coverage and detects and tracks all moving objects in the scene. Based on the output of the wide-angle camera, the system generates spatiotemporal observation requests for each moving object, which are candidates for close-up views using PTZ cameras. Due to the fact that there are usually much more objects than the number of PTZ cameras, the system first assigns a subset of the requests/objects to each PTZ camera. The PTZ cameras then select the parameter settings that best satisfy the assigned competing requests to provide high resolution views of the moving objects. We propose an approximation algorithm to solve the request assignment and the camera parameter selection problems in real time. The effectiveness of the proposed system is validated in both simulation and physical experiment. In comparison with an existing work using simulation, it shows that in heavy traffic scenarios, our algorithm increases the number of observed objects by over 210%.     

无重叠视域的多摄像机之间的目标匹配

在无重叠视域的多摄像机监控中,由于不同摄像机的视域差别和视域分离,同一运动目标在不同的视域中的成像可能会非常不同,因此在这种情况下对运动目标进行匹配是一项具有挑战性的工作。提出了一种可以容忍光照的不同,在无重叠视域的多摄像机下进行目标匹配的方法。该方法经过初始聚类和K-means聚类对目标进行主颜色谱的提取,利用EMKM算法改善K-means对初始中心点的依赖性,把提取出来的主颜色谱直方图作为目标的特征,然后利用特征相似度测量来判定任意两个物体之间是否匹配;当无法对某些物体进行准确匹配时,再利用SIFT特征进行下一步匹配。该方法也可以用于有重叠视域的多摄像机目标匹配中,通过与其他匹配方法相结合,提高匹配的准确度。实验结果证实了该方法具有较高的准确度。     

Consistent labeling of tracked objects in multiple cameras with overlapping fields of view

We address the issue of tracking moving objects in an environment covered by multiple uncalibrated cameras with overlapping fields of view, typical of most surveillance setups. In such a scenario, it is essential to establish correspondence between tracks of the same object, seen in different cameras, to recover complete information about the object. We call this the problem of consistent labeling of objects when seen in multiple cameras. We employ a novel approach of finding the limits of field of view (FOV) of each camera as visible in the other cameras. We show that, if the FOV lines are known, it is possible to disambiguate between multiple possibilities for correspondence. We present a method to automatically recover these lines by observing motion in the environment, Furthermore, once these lines are initialized, the homography between the views can also be recovered. We present results on indoor and outdoor sequences containing persons and vehicles.     

基于全景视觉的监控系统设计

设计了一个基于全景视觉的多摄像机监控网络。全景相机视野广,可以实现大范围的目标检测与跟踪。云台摄像机视角具有一定的自由度,可以捕捉目标的高分辨率图像。将全景相机与云台相机相互配合,通过多传感器的数据融合,分层次的跟踪算法及多相机调度算法,实现了大范围的多个运动目标的检测与跟踪,并能捕获目标的清晰图像。实验验证了该系统的有效性和合理性。     

改进的基于高斯混合模型的运动目标检测算法

针对固定场景视频监控中,由于运动物体在运动目标检测算法初始化时的存在而导致传统的基于高斯混合模型的运动目标检测算法收敛速度慢的问题,提出了改进算法。该改进算法通过采用在线K-均值聚类方法对混合高斯模型进行初始化,提高了算法的收敛速度。同时在模型更新时,通过对匹配准则和新高斯分布生成准则的改进,节约了存储空间。实验结果表明,与传统算法相比,改进算法能够快速、有效地检测运动目标,具有更好的鲁棒性。     

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning

Matching objects across multiple cameras with non-overlapping views is a necessary but difficult task in the wide area video surveillance. Owing to the lack of spatio-temporal information, only the visual information can be used in some scenarios, especially when the cameras are widely separated. This paper proposes a novel framework based on multi-feature fusion and incremental learning to match the objects across disjoint views in the absence of space–time cues. We first develop a competitive major feature histogram fusion representation (CMFH¹) to formulate the appearance model for characterizing the potentially matching objects. The appearances of the objects can change over time and hence the models should be continuously updated. We then adopt an improved incremental general multicategory support vector machine algorithm (IGMSVM²) to update the appearance models online and match the objects based on a classification method. Only a small amount of samples are needed for building an accurate classification model in our method. Several tests are performed on CAVIAR, ISCAPS and VIPeR databases where the objects change significantly due to variations in the viewpoint, illumination and poses. Experimental results demonstrate the advantages of the proposed methodology in terms of computational efficiency, computation storage, and matching accuracy over that of other state-of-the-art classification-based matching approaches. The system developed in this research can be used in real-time video surveillance applications.     

Intelligent visual surveillance — A survey

Detection, tracking, and understanding of moving objects of interest in dynamic scenes have been active research areas in computer vision over the past decades. Intelligent visual surveillance (IVS) refers to an automated visual monitoring process that involves analysis and interpretation of object behaviors, as well as object detection and tracking, to understand the visual events of the scene. Main tasks of IVS include scene interpretation and wide area surveillance control. Scene interpretation aims at detecting and tracking moving objects in an image sequence and understanding their behaviors. In wide area surveillance control task, multiple cameras or agents are controlled in a cooperative manner to monitor tagged objects in motion. This paper reviews recent advances and future research directions of these tasks. This article consists of two parts: The first part surveys image enhancement, moving object detection and tracking, and motion behavior understanding. The second part reviews wide-area surveillance techniques based on the fusion of multiple visual sensors, camera calibration and cooperative camera systems.     

Tracking video objects with feature points based particle filtering

For intelligent video surveillance, the adaptive tracking of multiple moving objects is still an open issue. In this paper, a new multi-object tracking method based on video frames is proposed. A type of particle filtering combined with the SIFT (Scale Invariant Feature Transform) is proposed for motion tracking, where SIFT key points are treated as parts of particles to improve the sample distribution. Then, a queue chain method is adopted to record data associations among different objects, which could improve the detection accuracy and reduce the computational complexity. By actual road tests and comparisons, the system tracks multi-objects with better performance, e.g., real time implementation and robust against mutual occlusions, indicating that it is effective for intelligent video surveillance systems.     

监控系统中的多摄像机协同

描述了一个用于室内场合对多个目标进行跟踪的分布式监控系统.该系统由多个廉价的固定镜头的摄像机构成,具有多个摄像机处理模块和一个中央模块用于协调摄像机间的跟踪任务.由于每个运动目标有可能被多个摄像机同时跟踪,因此如何选择最合适的摄像机对某一目标跟踪,特别是在系统资源紧张时,成为一个问题.提出的新算法能根据目标与摄像机之间的距离并考虑到遮挡的情况,把目标分配给相应的摄像机,因此在遮挡出现时,系统能把遮挡的目标分配给能看见目标并距离最近的那个摄像机.实验表明该系统能协调好多个摄像机进行目标跟踪,并处理好遮挡问题.