基于纹理特征改进的GFL运动目标提取方法

基于广义融合套索（GFL）前景模型，融合视频的纹理特征，提出一种基于纹理特征的运动目标提取方法。方法通过GFL前景模型提取前景运动目标和背景，再利用LBP算法提取前景与背景在多个方向上的纹理特征，比较两者纹理特征的相似度，去除前景中的投射阴影，解决由于运动目标遮挡产生的阴影问题，同时还引入误判率去描述模型的准确度。通过对广场、办公室以及体育馆等实际场景进行测试，实验表明提出的算法能够有效去除运动目标产生的阴影。     

Physical models for moving shadow and object detection in video

Current moving object detection systems typically detect shadows cast by the moving object as part of the moving object. In this paper, the problem of separating moving cast shadows from the moving objects in an outdoor environment is addressed. Unlike previous work, we present an approach that does not rely on any geometrical assumptions such as camera location and ground surface/object geometry. The approach is based on a new spatio-temporal albedo test and dichromatic reflection model and accounts for both the sun and the sky illuminations. Results are presented for several video sequences representing a variety of ground materials when the shadows are cast on different surface types. These results show that our approach is robust to widely different background and foreground materials, and illuminations.     

Change detection by probabilistic segmentation from monocular view

We present a method for foreground/background video segmentation (change detection) in real-time that can be used, in applications such as background subtraction or analysis of surveillance cameras. Our approach implements a probabilistic segmentation based on the Quadratic Markov Measure Field models. This framework regularizes the likelihood of each pixel belonging to each one of the classes (background or foreground). We propose a new likelihood that takes into account two cases: the first one is when the background is static and the foreground might be static or moving (Static Background Subtraction), the second one is when the background is unstable and the foreground is moving (Unstable Background Subtraction). Moreover, our likelihood is robust to illumination changes, cast shadows and camouflage situations. We implement a parallel version of our algorithm in CUDA using a NVIDIA Graphics Processing Unit in order to fulfill real-time execution requirements.     

运动目标的阴影实时检测和消除

运动目标的实时检测与跟踪是智能监控和视频活动识别应用的基本步骤.运动目标检测把场景分割为前景目标和背景区域,但是在这个过程申运动目标投射的阴影很容易被误分类为前景目标,这种误分类会造成多个目标的合并或目标形状的改变.为了改善运动目标分割的效果,提出一个基于光强、色度和反射率的实时阴影检测和消除的算法,该算法不需要目标的...     

A dynamic conditional random field model for foreground and shadow segmentation

This paper proposes a dynamic conditional random field (DCRF) model for foreground object and moving shadow segmentation in indoor video scenes. Given an image sequence, temporal dependencies of consecutive segmentation fields and spatial dependencies within each segmentation field are unified by a dynamic probabilistic framework based on the conditional random field (CRF). An efficient approximate filtering algorithm is derived for the DCRF model to recursively estimate the segmentation field from the history of observed images. The foreground and shadow segmentation method integrates both intensity and gradient features. Moreover, models of background, shadow, and gradient information are updated adaptively for nonstationary background processes. Experimental results show that the proposed approach can accurately detect moving objects and their cast shadows even in monocular grayscale video sequences.     

Moving Shadow Detection and Removal for Traffic Sequences

Segmentation of moving objects in a video sequence is a basic task for application of computer vision. However, shadows extracted along with the objects can result in large errors in object localization and recognition. In this paper, we propose a method of moving shadow detection based on edge information, which can effectively detect the cast shadow of a moving vehicle in a traffic scene. Having confirmed shadows existing in a figure, we execute the shadow removal algorithm proposed in this paper to segment the shadow from the foreground. The shadow eliminating algorithm removes the boundary of the cast shadow and preserves object edges firstly; secondly, it reconstructs coarse object shapes based on the edge information of objects; and finally, it extracts the cast shadow by subtracting the moving object from the change detection mask and performs further processing. The proposed method has been further tested on images taken under different shadow orientations, vehicle colors and vehicle sizes, and the results have revealed that shadows can be successfully eliminated and thus good video segmentation can be obtained.     

基于局部纹理不变性的运动阴影去除算法

视频序列运动目标检测过程中,运动目标往往会连同其投射阴影一起被检测为前景,这不利于对运动目标的进一步分类、识别等高层次视觉处理。为了提高运动目标检测的准确性,提出利用局部纹理不变性去除运动目标阴影。首先根据阴影的亮度色度属性分割出疑似阴影区域,然后在疑似阴影区域采用增强的局部纹理描述算子(ILT)提取纹理特征,利用背景在阴影覆盖前后的纹理相似性来去除阴影,最后结合阴影的空间几何属性优化运动目标检测结果。实验结果表明该算法可以有效去除阴影,并且具有较好的实时性。     

基于区域与光照不变性的运动阴影检测算法

在户外的视频监控系统中，运动目标的阴影降低了系统对目标识别与跟踪的能力。传统的基于像素的阴影检测算法易受噪声的影响。为了提高阴影检测算法的准确性,提出了一种基于区域与光照不变性的运动阴影检测算法。该算法从阴影的物理特性出发,考虑了区域内像素的总体特征。将运动区域采用EM聚类算法进行分块,对其中的小块向邻近的大块进行合并。对其中的每一块，根据阴影区域和相对应的背景区域之间的光照不变性进行阴影检测。实验结果表明，该算法能够很好地抑制噪声，准确地检测出阴影，明显比基于像素的算法有效。     

Shadow removal for pedestrian detection and tracking in indoor environments

This paper presents a method of shadow removal to improve the accuracy of pedestrian detection and tracking in indoor environments. The proposed method can be divided into four steps: building a background model which can be automatically updated, extract moving objects region, eliminating moving objects shadows, classifying and track pedestrians. The background model is built with pixel value and the updating of Gussian. The approach for real time background-foreground extraction is used to extract pedestrian region that may contains multiple shadows. In the gray histogram space, based on the depth value of the gray images, a reasonable threshold is set to remove shadows from various pedestrians. In this work, we propose a methodology using the foreground frames without shadows to detect and track the pedestrians across training datasets. Comparative experimental results show that our method is capable of dealing with shadows and detecting moving pedestrians in cluttered environments.     

基于ICA特征的运动阴影检测算法

为防止运动阴影在视频图像序列中被错误地检测为目标,必须提高阴影检测算法的准确性和普适性。为此,从独立分量分析(ICA)的原理及其特性出发,提出一种基于空间变换技术的运动阴影检测算法。该算法通过对视频序列建立高斯混合背景模型产生自适应背景,利用ICA技术对其进行空间变换提取特征,再通过背景与当前帧图像对应像素点在特征空间的位置特征来分类运动阴影与前景目标。实验结果表明该方法能够较好地抑制噪声,减少光照变化的影响,准确地检测出阴影。     

A robust framework for joint background/foreground segmentation of complex video scenes filmed with freely moving camera

This paper explores a robust region-based general framework for discriminating between background and foreground objects within a complex video sequence. The proposed framework works under difficult conditions such as dynamic background and nominally moving camera. The originality of this work lies essentially in our use of the semantic information provided by the regions while simultaneously identifying novel objects (foreground) and non-novel ones (background). The information of background regions is exploited to make moving objects detection more efficient, and vice-versa. In fact, an initial panoramic background is modeled using region-based mosaicing in order to be sufficiently robust to noise from lighting effects and shadowing by foreground objects. After the elimination of the camera movement using motion compensation, the resulting panoramic image should essentially contain the background and the ghost-like traces of the moving objects. Then, while comparing the panoramic image of the background with the individual frames, a simple median-based background subtraction permits a rough identification of foreground objects. Joint background-foreground validation, based on region segmentation, is then used for a further examination of individual foreground pixels intended to eliminate false positives and to localize shadow effects. Thus, we first obtain a foreground mask from a slow-adapting algorithm, and then validate foreground pixels (moving visual objects + shadows) by a simple moving object model built by using both background and foreground regions. The tests realized on various well-known challenging real videos (across a variety of domains) show clearly the robustness of the suggested solution. This solution, which is relatively computationally inexpensive, can be used under difficult conditions such as dynamic background, nominally moving camera and shadows. In addition to the visual evaluation, spatial-based evaluation statistics, given hand-labeled ground truth, has been used as a performance measure of moving visual objects detection.     

Robust moving object detection against fast illumination change

To solve the problem due to fast illumination change in a visual surveillance system, we propose a novel moving object detection algorithm for which we develop an illumination change model, a chromaticity difference model, and a brightness ratio model. When fast illumination change occurs, background pixels as well as moving object pixels are detected as foreground pixels. To separate detected foreground pixels into moving object pixels and false foreground pixels, we develop a chromaticity difference model and a brightness ratio model that estimates the intensity difference and intensity ratio of false foreground pixels, respectively. These models are based on the proposed illumination change model. Based on experimental results, the proposed method shows excellent performance under various illumination change conditions while operating in real-time.     

Moving Cast Shadows Detection Using Ratio Edge

Moving objects segmentation plays a very important role in real-time image analysis. However, as one of the common parts in the natural scenes, shadows severely interfere with the accuracy of moving objects detection in video surveillance. In this paper, we present a novel method for moving cast shadows detection. Based on the analysis of the physical model of moving shadows, we prove that the ratio edge is illumination invariant. The distribution of the ratio edge is discussed and a significance test is performed to classify each moving pixel into foreground object or moving shadow. Intensity constraint and geometric heuristics are imposed to further improve the performance. Experiments on various typical scenes exhibit the robustness of the proposed method. Extensively quantitative evaluation and comparison demonstrate that the proposed method significantly outperforms state-of-the-art methods.     

Moving cast shadow detection by exploiting multiple cues

Background subtraction or temporal differencing is commonly applied on an image sequence for foreground/background segmentation. However, cast shadows of moving foreground objects in a scene often result in detection errors for many vision-based applications. To address this problem, the authors propose an algorithm exploiting the information of colour, shading, texture, neighbourhood and temporal consistency to detect shadows efficiently and adaptively. The experimental results show that the proposed method can detect the penumbra as well as the umbra in different kinds of scenarios under various illumination conditions.     

自适应邻域相关性的背景建模

目的 背景建模在计算机视觉领域中是检测、跟踪、行为学习和识别的基础,被广泛地应用于视频监控的运动目标检测。混合高斯（MOG）和Codebook是其中具有代表性的方法,但它们假设像素点间信息是独立的,只保留了时域信息而忽略了空域信息,使得模型对背景的描述局限于时间上的连续性。针对上述问题,提出了一种自适应邻域相关性的背景建模方法（ANC）。方法 ANC在保留原始方法时域信息建模特性的同时,增加对邻域模型的复用,同时利用计算结果反馈自适应调整邻域区域,提高对前景值判断的准确性。首先利用原始基于像素点的背景建模方法进行候选前景检测,然后将候选前景检测结果为前景点的像素与邻域像素点模型进行对比,若邻域范围存在匹配则为背景点,若不存在则为前景点;最后引入像素置信度概念,自适应调整邻域范围的大小。结果 与MOG和Codebook相比,在changedetection标准数据库上,ANC在ROC（受试者工作特征曲线）和度量值等方面的平均精度和F-measure都提高了7%以上。结论 自适应邻域相关性的背景建模方法适用于复杂多模态背景,克服了基于像素点背景建模方法假设的局限性。与普通基于像素点的背景建模方法相比,具有更好的鲁棒性和抗噪性,对复杂背景具有更强的适应性。     

混合高斯模型的自适应前景提取

复杂场景下的运动前景提取是计算机视觉研究领域的研究重点。为解决复杂场景中的前景目标提取问题,本文提出一种应用于复杂变化场景中的基于混合高斯模型的自适应前景提取方法。本方法可以对视频帧中每个像素的高斯分布数进行动态控制,并且通过在线EM算法对高斯分布的各参数进行学习,此外每个像素的权值更新速率可根据策略进行调整。实验结果表明本方法对复杂变化场景具有较好的适应性,可有效、快速地提取前景目标,提取结果具有较好的查准率和查全率。     

结合HSV与纹理特征的视频阴影消除算法

目的 在视频监控目标检测应用中,场景中的阴影会直接影响目标检测的准确度,因此阴影抑制算法研究显得尤为重要。目前广泛使用的是HSV（hue,saturation,value）阴影抑制方法,但是该方法存在由于亮度比值的阈值不稳定而造成将运动目标也检测为阴影的问题。针对该问题,本文提出了一种结合HSV与纹理特征的视频阴影消除方法。方法 首先将输入的图像使用传统的混合高斯模型建立背景并在灰度空间中提取前景,其次在HSV空间使用亮度比的阈值方法检测阴影,二者综合得到运动目标;针对由于亮度比值的阈值不稳定而导致的前景误检为阴影的问题,采用了LBP（local binary pattern）算子结合大津阈值（OTSU）提取部分运动目标。最后将LBP算子结合大津阈值提取的部分运动目标与HSV空间检测的目标两者相或,最终去除运动目标的阴影。结果 本文选用在CVPR-ATON和CAVIAR标准视频库中多个场景的阴影视频,将本文算法与SNP算法、SP算法、DNM1算法和DNM2算法进行对比仿真,实验结果表明本文算法在阴影检测率和阴影识别率的平均值上提升约10%。结论 本文提出的视频阴影消除算法结合了HSV与纹理特征,可以在不同的环境中有效地去除阴影,运动目标保留完整,可适用于智能视频监控、遥感图像和人机交互中。     

结合阴影抑制的混合高斯模型改进算法

混合高斯模型背景法作为运动目标检测的一种经典方法,已经广泛应用于智能视频监控系统中。但是,传统的混合高斯模型背景法容易将阴影误检测为运动目标的一部分。因此,针对该方法在区分阴影和运动目标方面的不足,提出了一种将混合高斯模型背景法和HSV空间阴影抑制相结合的运动目标检测算法。这种改进算法首先将颜色空间转换到HSV空间,初步提取运动目标,然后再利用阴影的灰度值比背景中的灰度值小,而前景的灰度值比背景中灰度值大的特性,检测出运动目标中的阴影。实验结果表明,这种改进的算法明显提高了检测效果,有效抑制了阴影对运动目标检测的干扰,算法实时性也较好。     

基于局部纹理特性的运动车辆阴影消除

为解决传统阴影检测算法可靠性和实时性难以兼顾的难题,从交通场景的实际应用出发,提出一种基于局部纹理特性的灰度域阴影消除方法。通过分析阴影的物理模型,得出局部纹理的光照不变性,利用基于比值判决的LBP纹理法来区分运动车辆和阴影,并应用亮度约束和几何启发式准则进一步改善阴影检测效果。实验结果表明,该方法的阴影检测有效率在90％以上,且能较好地满足实时要求,提高低亮度时车辆的阴影检测效果。