A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection

The detection of moving objects from stationary cameras is usually approached by background subtraction, i.e. by constructing and maintaining an up-to-date model of the background and detecting moving objects as those that deviate from such a model. We adopt a previously proposed approach to background subtraction based on self-organization through artificial neural networks, that has been shown to well cope with several of the well known issues for background maintenance. Here, we propose a spatial coherence variant to such approach to enhance robustness against false detections and formulate a fuzzy model to deal with decision problems typically arising when crisp settings are involved. We show through experimental results and comparisons that higher accuracy values can be reached for color video sequences that represent typical situations critical for moving object detection.     

OPTICS聚类与目标区域概率模型的多运动目标跟踪

目的 针对多运动目标在移动背景情况下跟踪性能下降和准确度不高的问题,本文提出了一种基于OPTICS聚类与目标区域概率模型的方法。方法 首先引入了Harris-Sift特征点检测,完成相邻帧特征点匹配,提高了特征点跟踪精度和鲁棒性;再根据各运动目标与背景运动向量不同这一点,引入了改进后的OPTICS加注算法,在构建的光流图上聚类,从而准确的分离出背景,得到各运动目标的估计区域;对每个运动目标建立一个独立的目标区域概率模型(OPM),随着检测帧数的迭代更新,以得到运动目标的准确区域。结果 多运动目标在移动背景情况下跟踪性能下降和准确度不高的问题通过本文方法得到了很好地解决,Harris-Sift特征点提取、匹配时间仅为Sift特征的17%。在室外复杂环境下,本文方法的平均准确率比传统背景补偿方法高出14%,本文方法能从移动背景中准确分离出运动目标。结论 实验结果表明,该算法能满足实时要求,能够准确分离出运动目标区域和背景区域,且对相机运动、旋转,场景亮度变化等影响因素具有较强的鲁棒性。     

基于运动显著性的移动镜头下的运动目标检测

针对移动镜头下的运动目标检测中的背景建模复杂、计算量大等问题,提出一种基于运动显著性的移动镜头下的运动目标检测方法,在避免复杂的背景建模的同时实现准确的运动目标检测。该方法通过模拟人类视觉系统的注意机制,分析相机平动时场景中背景和前景的运动特点,计算视频场景的显著性,实现动态场景中运动目标检测。首先,采用光流法提取目标的运动特征,用二维高斯卷积方法抑制背景的运动纹理;然后采用直方图统计衡量运动特征的全局显著性,根据得到的运动显著图提取前景与背景的颜色信息;最后,结合贝叶斯方法对运动显著图进行处理,得到显著运动目标。通用数据库视频上的实验结果表明,所提方法能够在抑制背景运动噪声的同时,突出并准确地检测出场景中的运动目标。     

慢运动背景下运动目标提取算法*

提出一种慢运动背景视频序列下基于帧间背景图像匹配的运动目标检测和提取算法。该算法首先使用仿射变换模型来描述慢运动背景图像的运动变化,并使用基于光流约束方法求解该仿射变换模型参数,实现了相邻帧间图像的背景匹配;其次,采用背景匹配后的两帧图像差进行目标检测,使用自适应二值化区分变化与未变化区域;最后,使用形态学等图像算法进行后处理提取运动目标。算法经实验证明,在背景慢运动情况下可以有效地提取出运动目标。     

Robust moving object detection against fast illumination change

To solve the problem due to fast illumination change in a visual surveillance system, we propose a novel moving object detection algorithm for which we develop an illumination change model, a chromaticity difference model, and a brightness ratio model. When fast illumination change occurs, background pixels as well as moving object pixels are detected as foreground pixels. To separate detected foreground pixels into moving object pixels and false foreground pixels, we develop a chromaticity difference model and a brightness ratio model that estimates the intensity difference and intensity ratio of false foreground pixels, respectively. These models are based on the proposed illumination change model. Based on experimental results, the proposed method shows excellent performance under various illumination change conditions while operating in real-time.     

Change detection for moving object segmentation with robust background construction under Wronskian framework

Although background subtraction techniques have been used for several years in vision systems for moving object detection, many of them fail to provide good results in presence of noise, illumination variation, non-static background, etc. A basic requirement of background subtraction scheme is the construction of a stable background model and then comparing each incoming image frame with it so as to detect moving objects. The novelty of the proposed scheme is to construct a stable background model from a given video sequence dynamically. The constructed background model is compared with different image frames of the same sequence to detect moving objects. In the proposed scheme the background model is constructed by analyzing a sequence of linearly dependent past image frames in Wronskian framework. The Wronskian based change detection model is further used to detect the changes between the constructed background scene and the considered target frame. The proposed scheme is an integration of Gaussian averaging and Wronskian change detection model. Gaussian averaging uses different modes which arise over time to capture the underlying richness of background, and it is an approach for background building by considering temporal modes. Similarly, Wronskian change detection model uses a spatial region of support in this regard. The proposed scheme relies on spatio-temporal modes arising over time to build the appropriate background model by considering both spatial and temporal modes. The results obtained by the proposed model is found to provide accurate shape of moving objects. The effectiveness of the proposed scheme is verified by comparing the results with those of some of the existing state of the art background subtraction techniques on public benchmark databases. We found that the average F-measure is significantly improved by the proposed scheme from that of the state-of-the-art techniques.     

改进的基于高斯混合模型的运动目标检测算法

针对固定场景视频监控中,由于运动物体在运动目标检测算法初始化时的存在而导致传统的基于高斯混合模型的运动目标检测算法收敛速度慢的问题,提出了改进算法。该改进算法通过采用在线K-均值聚类方法对混合高斯模型进行初始化,提高了算法的收敛速度。同时在模型更新时,通过对匹配准则和新高斯分布生成准则的改进,节约了存储空间。实验结果表明,与传统算法相比,改进算法能够快速、有效地检测运动目标,具有更好的鲁棒性。     

Fast background subtraction using static and dynamic gates

Background subtraction is usually one of the first steps carried out in motion detection using static video cameras. This paper presents a new fast model for background subtraction that processes only some pixels of each image. This model achieves a significant reduction in computation time that can be used for subsequent image analysis. Some regions of interest (ROI) are located where movement can start. If no movement is present in the image, only pixels of these ROIs are processed. Once a moving object is detected, a new ROI that follows it is created. Thus, motion detection and parameter updates are executed only in the relevant areas instead of in the whole image. The proposed model has three main advantages: the computational time can be reduced drastically, motion detection performance is improved, and it can be combined with most of the existing background subtraction techniques. These features make it specially suitable for security applications.     

Improved background modeling for real-time spatio-temporal non-parametric moving object detection strategies

Answering to the growing demand of machine vision applications for the latest generation of electronic devices endowed with camera platforms, several moving object detection strategies have been proposed in recent years. Among them, spatio-temporal based non-parametric methods have recently drawn the attention of many researchers. These methods, by combining a background model and a foreground model, achieve high-quality detections in sequences recorded with non-completely static cameras and in scenarios containing complex backgrounds. However, since they have very high memory and computational associated costs, they apply some simplifications in the background modeling process, therefore decreasing the quality of the modeling.     

Continuous localization and mapping of a pan–tilt–zoom camera for wide area tracking

Pan–tilt–zoom (PTZ) cameras are well suited for object identification and recognition in far-field scenes. However, the effective use of PTZ cameras is complicated by the fact that a continuous online camera calibration is needed and the absolute pan, tilt and zoom values provided by the camera actuators cannot be used because they are not synchronized with the video stream. So, accurate calibration must be directly extracted from the visual content of the frames. Moreover, the large and abrupt scale changes, the scene background changes due to the camera operation and the need of camera motion compensation make target tracking with these cameras extremely challenging. In this paper, we present a solution that provides continuous online calibration of PTZ cameras which is robust to rapid camera motion, changes of the environment due to varying illumination or moving objects. The approach also scales beyond thousands of scene landmarks extracted with the SURF keypoint detector. The method directly derives the relationship between the position of a target in the ground plane and the corresponding scale and position in the image and allows real-time tracking of multiple targets with high and stable degree of accuracy even at far distances and any zoom level.     

运动目标检测的ViBe算法改进

目的 目标检测在智能交通、自动驾驶以及安防监控中均有重要的地位,ViBe算法是常用的运动目标检测算法,它主要由背景模型初始化、前景检测、背景模型更新3部分组成,其思想简单,易于实现,运算效率高,但当初始帧有运动目标时,检测结果会出现“鬼影”现象,且易受噪声和光照变化影响,不能适应动态场景。同时,其逐帧逐像素进行前景检测,在计算复杂度方面有较大提升空间。为解决这些问题,提出一种改进的ViBe算法,称为ViBeImp算法。方法 在背景模型初始化时,用多帧平均法给出初始背景,采用该初始背景构建初始背景样本模型。在前景检测过程中,采用背景差分法、帧差法与OTSU算法相结合给出半径阈值的自适应计算方法。同时,根据背景差分法找出运动区域,只对运动区域进行前景判断和模型更新,降低算法的计算复杂度。结果 对25个不同场景视频分别给出ViBeImp算法在初始化背景,自适应半径阈值和计算复杂度方面改进的结果及有效性指标,实验结果表明,与ViBe、ViBeDiff2、ViBeIniR,以及Surendra等算法和高斯混合模型相比,ViBeImp算法对噪声、光照和背景动态变化有较好的鲁棒性,检测结果更完整,且实时性较好。同时,ViBeImp算法将ViBe算法的查准率、查全率以及F1值分别提高了17.98%、11.40%和15.96%。结论 ViBeImp算法采用多帧平均法构建初始背景可有效地消除“鬼影”,并给出半径阈值的自适应计算方法,使ViBe算法更快适应视频环境变化,准确且完整地检测出运动目标,具有较低的误检率和漏检率。该方法克服了ViBe算法对初始背景以及视频环境的依赖,很大程度上提高了运算速度,具有很好的鲁棒性和适用性。     

基于低秩表示动态更新投影的在线运动目标检测

视频图像中运动目标检测是机器视觉领域的重要研究内容,旨在将序列图像中的背景和前景进行有效分离。在研究几种典型运动目标检测算法的基础上,提出了一种基于低秩表示动态更新投影的在线运动目标检测算法。采用低秩表示方法对若干连续视频帧进行低秩分解,并将分解所获得的低秩部分对应的左奇异值矩阵的正交补引为投影矩阵;再构建投影模型,拟合出数据的稀疏前景;最后采用视频分段分析法则对投影矩阵进行动态更新,从而保证所分离的背景以及前景的有效性。在Curtain等多个视频数据库上与其他算法进行了对比实验,实验结果表明所提算法具有很好的检测效果,对复杂的运动前景和动态背景的处理表现出很强的鲁棒性。     

Semantic Plane-Structure based motion detection with a nonstationary camera

This paper presents a novel method to accurately detect moving objects from a video sequence captured using a nonstationary camera. Although common methods provide effective motion detection for static backgrounds or through only planar-perspective transformation, many detection errors occur when the background contains complex dynamic interferences or the camera undergoes unknown motions. To solve this problem, this study proposed a motion detection method that incorporates temporal motion and spatial structure. In the proposed method, first, spatial semantic planes are segmented, and image registration based on stable background planes is applied to overcome the interferences of the foreground and dynamic background. Thus, the estimated dense temporal motion ensures that small moving objects are not missed. Second, motion pixels are mapped on semantic planes, and then, the spatial distribution constraints of motion pixels, regional shapes and plane semantics, which are integrated into a planar structure, are used to minimise false positives. Finally, based on the dense temporal motion and spatial structure, moving objects are accurately detected. The experimental results on CDnet dataset, Pbi dataset, Aeroscapes dataset, and other challenging self-captured videos under difficult conditions, such as fast camera movement, large zoom variation, video jitters, and dynamic background, revealed that the proposed method can remove background movements, dynamic interferences, and marginal noises and can effectively obtain complete moving objects.© 2017 ElsevierInc.Allrightsreserved.     

基于移动区域的快速粗模型阴影检测

阴影检测是运动车辆目标识别与追踪中非常重要的环节.结合基于颜色和模型的两种检测方法,提出一种基于移动区域的快速粗模型阴影检测方法.该方法首先通过改进的背景差分方法快速获取图像中的移动区域,然后在此基础上根据基于模型的方法建立阴影的粗模型,即快速确定阴影区域的粗略区域.阴影检测时只对该区域内的图像采用基于HSV颜色空间的方法进行分析处理.实验结果表明该方法可以有效地提高阴影检测的效率.     

基于混合高斯模型的运动目标检测方法

研究了序列图像中的运动目标检测问题。传统的目标检测方法无法克服背景图像变化、场景光线突变、目标物阴影干扰等问题。采用混合高斯分布对背景进行建模,引入亮度信息进行前序处理,并在此基础上使用颜色模型对残留阴影进行移除,因此能够快速准确地检测出运动目标。通过相关仿真实验,证明了该方法具有可靠性和实时性。     

利用时空背景模型的快速运动目标检测方法

为了弥补运动目标检测中传统混合高斯背景模型仅对单个像素建模、运算耗时的不足,通过提取背景时间统计特征和空间区域特征建立模型,针对模型中的高斯分量采用一种改进的分量个数自适应算法,并在此模型基础上,提出一种自适应迭代分块目标检测方法。通过包含区域信息的背景模型检测目标,减少在同一背景区域中目标的误判和漏判。将自适应迭代分块检测算法与背景的区域信息结合,可以在不降低检测精度的前提下大大提高算法执行速度。实验结果表明,相对于传统算法,本文检测法检测结果信噪比更高,目标更加完整,运行速度平均提高了22%。     

基于区域生长处理的视频运动车辆提取新方法

车辆提取在视频交通流量检测系统中是最重要、最关键的一环。提出一种基于区域生长算法的简单、快速的车辆提取方法。这种方法通过差分图像估计阴影灰度近似值,然后用该值作为参考值删除输入图像属于背景和阴影的像素,最后得到运动车辆图像。利用该方法进行了大量的实验,从实验结果来看,此方法具有较好的稳定性和有效性;从计算时间来看,该方法也能满足实时系统的需要。     

基于时空背景模型的自适应运动目标检测方法

现有的视觉背景提取方法(ViBe)在背景建模时只利用了像素的空间信息,而忽略时间信息,降低了检测的准确性,且检测半径和背景更新的随机子采样因子都为固定常数,在动态背景干扰、相机抖动等情况下,检测效果不理想。针对这些问题,提出一种时空背景模型的自适应运动目标检测方法。首先,在ViBe方法中加入时间信息建立时空背景模型;然后,在检测和更新过程中,提出背景模型中样本的标准差能反映背景的复杂度,通过计算样本的标准差来自适应地改变检测半径和背景更新的随机子采样因子适应背景的变化。实验结果表明,改进的方法不仅能够在静态背景和光照均匀的情况下有效地检测出前景像素,而且对存在光线变化较大、相机抖动、动态背景干扰等情况也有一定的抑制作用,提高了检测的准确性。     

动态背景下空时特性均显著的运动目标检测

从序列图像中提取变化区域是运动检测的主要作用,动态背景的干扰严重影响检测结果,使得有效性运动检测成为一项困难工作。受静态图像显著性检测启发,提出了一种新的运动目标检测方法,采用自底向上与自顶向下的视觉计算模型相结合的方式获取图像的空时显著性：先检测出视频序列中的空间显著性,在其基础上加入时间维度,利用改进的三帧差分算法获取具有运动目标的时间显著性,将显著性目标的检测视角由静态图像转换为空时性均显著的运动目标。实验和分析结果表明：新方法在摄像机晃动等动态背景中能较准确检测出空时均显著的运动目标,具有较高的鲁棒性。     

Detecting moving objects, ghosts, and shadows in video streams

Background subtraction methods are widely exploited for moving object detection in videos in many applications, such as traffic monitoring, human motion capture, and video surveillance. How to correctly and efficiently model and update the background model and how to deal with shadows are two of the most distinguishing and challenging aspects of such approaches. The article proposes a general-purpose method that combines statistical assumptions with the object-level knowledge of moving objects, apparent objects (ghosts), and shadows acquired in the processing of the previous frames. Pixels belonging to moving objects, ghosts, and shadows are processed differently in order to supply an object-based selective update. The proposed approach exploits color information for both background subtraction and shadow detection to improve object segmentation and background update. The approach proves fast, flexible, and precise in terms of both pixel accuracy and reactivity to background changes.