基于运动显著性的移动镜头下的运动目标检测

针对移动镜头下的运动目标检测中的背景建模复杂、计算量大等问题,提出一种基于运动显著性的移动镜头下的运动目标检测方法,在避免复杂的背景建模的同时实现准确的运动目标检测。该方法通过模拟人类视觉系统的注意机制,分析相机平动时场景中背景和前景的运动特点,计算视频场景的显著性,实现动态场景中运动目标检测。首先,采用光流法提取目标的运动特征,用二维高斯卷积方法抑制背景的运动纹理;然后采用直方图统计衡量运动特征的全局显著性,根据得到的运动显著图提取前景与背景的颜色信息;最后,结合贝叶斯方法对运动显著图进行处理,得到显著运动目标。通用数据库视频上的实验结果表明,所提方法能够在抑制背景运动噪声的同时,突出并准确地检测出场景中的运动目标。     

基于像素层背景模型的复杂场景运动目标检测

为了从复杂变化背景中鲁棒地检测、提取运动目标,提出一种基于像素层背景模型的运动目标检测算法。该算法采用快速均值漂移方法将背景帧上具有相同统计特性的像素划分为一个像素层,背景模型从而被表示为一组像素层,通过与邻域像素对应的层匹配来检测运动前景像素。实验结果表明,该方法可以实时、准确地检测运动目标,特别是在摄像机颤动等原因造成的背景时域不规则变化情况下,比经典的基于混合高斯背景模型的方法具有更好的检测效果。     

An efficient,chromatic clustering-based background model for embedded vision platforms

People naturally identify rapidly moving foreground and ignore persistent background. Identifying background pixels belonging to stable, chromatically clustered objects is important for efficient scene processing. This paper presents a technique that exploits this facet of human perception to improve performance and efficiency of background modeling on embedded vision platforms. Previous work on the Multimodal Mean (MMean) approach achieves high quality foreground extraction (comparable to Mixture of Gaussians (MoG)) using fast integer computation and a compact memory representation. This paper introduces a more efficient hybrid technique that combines MMean with palette-based background matching based on the chromatic distribution in the scene. This hybrid technique suppresses computationally expensive model update and adaptation, providing a 45% execution time speedup over MMean. It reduces model storage requirements by 58% over a MMean-only implementation. This background analysis enables higher frame rate, lower cost embedded vision systems.     

Robust foreground detection in video using pixel layers

A framework for robust foreground detection that works under difficult conditions such as dynamic background and moderately moving camera is presented in this paper. The proposed method includes two main components: coarse scene representation as the union of pixel layers, and foreground detection in video by propagating these layers using a maximum-likelihood assignment. We first cluster into "layers" those pixels that share similar statistics. The entire scene is then modeled as the union of such non-parametric layer-models. An in-coming pixel is detected as foreground if it does not adhere to these adaptive models of the background. A principled way of computing thresholds is used to achieve robust detection performance with a pre-specified number of false alarms. Correlation between pixels in the spatial vicinity is exploited to deal with camera motion without precise registration or optical flow. The proposed technique adapts to changes in the scene, and allows to automatically convert persistent foreground objects to background and re-convert them to foreground when they become interesting. This simple framework addresses the important problem of robust foreground and unusual region detection, at about 10 frames per second on a standard laptop computer. The presentation of the proposed approach is complemented by results on challenging real data and comparisons with other standard techniques.     

基于贝叶斯决策的运动目标检测方法

传统混合高斯背景建模存在难以解决背景复杂以及阴影等因素影响视频运动目标检测效果的问题,为此提出了一种基于贝叶斯决策的运动目标检测方法。该方法利用帧间差分进行像素变化检测,将像素粗分为变化像素和非变化像素;对于变化像素中的运动点和静止点,通过统计确立有效的数据结构,其中显著颜色分布统计量用来描述静止点,而显著颜色同现统计量描述运动点;从数据结构中提取颜色特征矢量,将特征矢量中的静止点和运动点按照贝叶斯决策规则进一步分类为背景点、前景点和颜色相似点。对颜色相似点进行局部加权处理以达到正确检测的目的;通过融合静止点集、运动点集和加权后的颜色相似点集结果提取出前景运动目标。仿真实验表明,该方法能够在不同复杂背景下较准确地检测出视频中的运动目标,相比传统算法具有较强的鲁棒性。     

Motion detection with nonstationary background

Abstract. This paper proposes a new background subtraction method for detecting moving foreground objects from a nonstationary background. While background subtraction has traditionally worked well for a stationary background, the same cannot be implied for a nonstationary viewing sensor. To a limited extent, motion compensation for the nonstationary background can be applied. However, in practice, it is difficult to realize the motion compensation to sufficient pixel accuracy, and the traditional background subtraction algorithm will fail for a moving scene. The problem is further complicated when the moving target to be detected/tracked is small, since the pixel error in motion that is compensating the background will subsume the small target. A spatial distribution of Gaussians (SDG) model is proposed to deal with moving object detection having motion compensation that is only approximately extracted. The distribution of each background pixel is temporally and spatially modeled. Based on this statistical model, a pixel in the current frame is then classified as belonging to the foreground or background. For this system to perform under lighting and environmental changes over an extended period of time, the background distribution must be updated with each incoming frame. A new background restoration and adaptation algorithm is developed for the nonstationary background. Test cases involving the detection of small moving objects within a highly textured background and with a pan-tilt tracking system are demonstrated successfully. Received: 30 July 2001 / Accepted: 20 April 2002 Correspondence to: Chin-Seng Chau     

交通场景中的实时多目标跟踪方法

针对多目标检测与跟踪技术的应用要求,提出一种用于交通场景的实时多目标跟踪方法。设计背景建模算法和基于角点动态特征的分层跟踪算法,利用背景建模算法提取视频帧前景,并在前景区域运用分层跟踪算法,包括Corner、Cluster和Object 3层架构,通过在不同层之间引入对应的聚类算法,以实现目标跟踪。实验结果表明,该方法适用于多数交通场景,对光照、阴影具有较强的鲁棒性。     

Robust artifact-free high dynamic range imaging of dynamic scenes

The irradiance range of the real-world scene is often beyond the capability of digital cameras. Therefore, High Dynamic Range (HDR) images can be generated by fusing images with different exposure of the same scene. However, moving objects pose the most severe problem in the HDR imaging, leading to the annoying ghost artifacts in the fused image. In this paper, we present a novel HDR technique to address the moving objects problem. Since the input low dynamic range (LDR) images captured by a camera act as static linear related backgrounds with moving objects during each individual exposures, we formulate the detection of foreground moving objects as a rank minimization problem. Meanwhile, in order to eliminate the image blurring caused by background slightly change of LDR images, we further rectify the background by employing the irradiances alignment. Experiments on image sequences show that the proposed algorithm performs significant gains in synthesized HDR image quality compare to state-of-the-art methods.

     

Range Segmentation Using Visibility Constraints

Visibility constraints can aid the segmentation of foreground objects in a scene observed with multiple range imagers. Points may be labeled as foreground if they can be determined to occlude some space in the scene that we expect to be empty. Visibility constraints from a second range view provide evidence of such occlusions. We present an efficient algorithm to estimate foreground points in each range view using explicit epipolar search. In cases where the background pattern is stationary, we show how visibility constraints from other views can generate virtual background values at points with no valid depth in the primary view. We demonstrate the performance of both algorithms for detecting people in indoor office environments with dynamic illumination variation.     

Real-time scene background initialization based on spatio-temporal neighborhood exploration

In this paper, we address the problem of scene background initialization to define a background model free from foreground objects. The complexity of this task resides in the continuous clutter of the scene by moving and stationary objects. To face this challenge, we propose a robust real-time iterative model completion method based on online block-level processing to initialize the background with low computational cost. First, temporal data analysis is conducted to cluster similar blocks. Meanwhile, a two-folded inter-block spatial neighborhood exploration is performed. It aims to capture relationships among neighboring clusters and reduce the number of candidate clusters employed in the next phase. Then, a smoothness analysis between neighboring locations is performed to iteratively reconstruct the background based on a newly proposed edge matching metric and an inter-block color discontinuity. Extensive evaluations of the proposed approach on the public Scene Background Initialization 2015 dataset and on the Scene Background Modeling Contest 2016 dataset revealed a performance superior or comparable to state-of-the-art methods.

     

Non-parametric statistical background modeling for efficient foreground region detection

Most methods for foreground region detection in videos are challenged by the presence of quasi-stationary backgrounds—flickering monitors, waving tree branches, moving water surfaces or rain. Additional difficulties are caused by camera shake or by the presence of moving objects in every image. The contribution of this paper is to propose a scene-independent and non-parametric modeling technique which covers most of the above scenarios. First, an adaptive statistical method, called adaptive kernel density estimation (AKDE), is proposed as a base-line system that addresses the scene dependence issue. After investigating its performance we introduce a novel general statistical technique, called recursive modeling (RM). The RM overcomes the weaknesses of the AKDE in modeling slow changes in the background. The performance of the RM is evaluated asymptotically and compared with the base-line system (AKDE). A wide range of quantitative and qualitative experiments is performed to compare the proposed RM with the base-line system and existing algorithms. Finally, a comparison of various background modeling systems is presented as well as a discussion on the suitability of each technique for different scenarios.     

Layered Representation of a Video Shot with Mosaicing

: This paper presents a motion segmentation method useful for representing efficiently a video shot as a static mosaic of the background plus sequences of the objects moving in the foreground. This generates an MPEG-4 compliant, layered representation useful for video coding, editing and indexing. First, a mosaic of the static background is computed by estimating the dominant motion of the scene. This is achieved by tracking features over the video sequence and using a robust technique that discards features attached to the moving objects. The moving objects get removed in the final mosaic by computing the median of the grey levels. Then, segmentation is obtained by taking the pixelwise difference between each frame of the original sequence and the mosaic of the background. To discriminate between the moving object and noise, temporal coherence is exploited by tracking the object in the binarised difference image sequence. The automatic computation of the mosaic and the segmentation procedure are illustrated with real sequences experiments. Examples of coding and content-based manipulation are also shown. Received: 31 August 2000, Received in revised form: 18 April 2001, Accepted: 20 July 2001     

基于邻域相关性和帧间连续性的前景目标分割

提出了一种新的运动目标分割算法。首先利用像素的颜色、空间的和帧间的特性信息结合贝叶斯判别定理对视频图像进行粗分割,得到一个前景目标的二值图,由于该类方法基于像素间彼此独立的假设,导致分割出的前景目标不完整存在很多空洞。其次,基于前景目标局部邻域空间的一致性假设,计算该邻域内像素间的互相关系数;同时,基于背景的帧间连续性和前景的不连续性,计算像素帧间的互相关系数。最后,依据像素的互相关系数在该邻域内进行二次判决,以填补粗分割中前景目标内部的空洞。实验表明,在复杂背景交通视频中该分割算法具有较强的鲁棒性,并能获得更完整准确的前景目标。     

一种简单有效的运动目标检测算法

针对固定场景中运动目标检测遇到的运动目标状态突变,非运动目标干扰以及阴影等问题,提出了一种背景差分和帧间差分相结合的运动目标检测算法;该算法首先通过平均法背景模型确立背景,使用背景差分得到一幅二值化前景图像,然后将通过连续的多帧图像进行相邻帧差分得到的多幅二值化前景图像进行逻辑或运算,最后将运算结果同背景差分所得到的二值化前景图像进行逻辑与运算,得到最终运动目标区域;实验表明,该算法运算速度快,准确率高,并能满足实时检测的需要;不足之处是在摄像机与运动物体夹角很小的情况下,检测效果较差,但可以通过多台摄像机协同操作来达到理想的效果.     

Moving cast shadow detection by exploiting multiple cues

Background subtraction or temporal differencing is commonly applied on an image sequence for foreground/background segmentation. However, cast shadows of moving foreground objects in a scene often result in detection errors for many vision-based applications. To address this problem, the authors propose an algorithm exploiting the information of colour, shading, texture, neighbourhood and temporal consistency to detect shadows efficiently and adaptively. The experimental results show that the proposed method can detect the penumbra as well as the umbra in different kinds of scenarios under various illumination conditions.     

Video background modeling: recent approaches,issues and our proposed techniques

Effective and efficient background subtraction is important to a number of computer vision tasks. We introduce several new techniques to address key challenges for background modeling using a Gaussian mixture model (GMM) for moving objects detection in a video acquired by a static camera. The novel features of our proposed model are that it automatically learns dynamics of a scene and adapts its parameters accordingly, suppresses ghosts in the foreground mask using a SURF features matching algorithm, and introduces a new spatio-temporal filter to further refine the foreground detection results. Detection of abrupt illumination changes in the scene is dealt with by a model shifting-based scheme to reuse already learned models and spatio-temporal history of foreground blobs is used to detect and handle paused objects. The proposed model is rigorously tested and compared with several previous models and has shown significant performance improvements.     

自适应混合高斯背景模型的改进

对自适应混合高斯背景模型进行了改进，将背景重构和前景消融时间控制机制整合到传统自适应混合高斯背景模型中，以提高运动分割的质量。背景重构算法从含有运动物体的动态场景视频序列中重构静态背景图像，然后用重构的静态背景图像初始化自适应混合高斯背景模型；而前景消融时间控制机制则使运动物体停止时的前景消融时间独立于背景模型的学习速率，从而可以根据需要调节前景消融的持续时间。实验结果表明了算法的有效性。     

Moving objects detection employing iterative update of the background

Detection of objects from a video is one of the basic issues in computer vision study. It is obvious that moving objects detection is particularly important, since they are those to which one should pay attention in walking, running, or driving a car. This paper proposes a method of detecting moving objects from a video as foreground objects by inferring backgrounds frame by frame. The proposed method can cope with various changes of a scene including large dynamical change of a scene in a video taken by a stationary/moving camera. Experimental results show satisfactory performance of the proposed method.     

Background subtraction using finite mixtures of asymmetric Gaussian distributions and shadow detection

Foreground segmentation of moving regions in image sequences is a fundamental step in many vision systems including automated video surveillance, human-machine interface, and optical motion capture. Many models have been introduced to deal with the problems of modeling the background and detecting the moving objects in the scene. One of the successful solutions to these problems is the use of the well-known adaptive Gaussian mixture model. However, this method suffers from some drawbacks. Modeling the background using the Gaussian mixture implies the assumption that the background and foreground distributions are Gaussians which is not always the case for most environments. In addition, it is unable to distinguish between moving shadows and moving objects. In this paper, we try to overcome these problem using a mixture of asymmetric Gaussians to enhance the robustness and flexibility of mixture modeling, and a shadow detection scheme to remove unwanted shadows from the scene. Furthermore, we apply this method to real image sequences of both indoor and outdoor scenes. The results of comparing our method to different state of the art background subtraction methods show the efficiency of our model for real-time segmentation.