基于梯度统计和区域生长融合的运动车辆阴影检测方法

针对在视频对象分割时,运动阴影常被误分为视频对象的问题,提出了一种融合阴影模型和特征的阴影检测方法。用聚类识别的算法提取背景,获得包含阴影的前景,算出前景与背景梯度差。对梯度差投影,根据投影后得到的序列及其差分序列进行阴影区域初步检测,根据初步检测结果,运用区域生长算法搜索出全部阴影。实验结果证明,本方法检测效果好,速度快,能够应用于车辆阴影的实时检测。     

基于层次HMM的运动目标分割

提出对差分图像用三层统计模型表示的思想：前景运动汽车层、背景运动汽车层和运动阴影层,并分别建立了各层的统计模型,应用HMM对运动图像序列进行模型参数估计,通过模型进行运动汽车分割。HMM利用图像序列帧之间的图像像素空间相关性和时间相关性,从而完成模型参数的识别。通过MAP算法完成模型参数具体化,不但用模型完成图像前景目标的分割,同时在分割中自然区别了背景运动目标和阴影,实现了复杂背景图像的运动汽车分割。实验结果表明方法能够有效地完成分割目的。     

面向视频的人物前景分割研究*

针对目标分割中存在的背景噪声和阴影干扰问题,提出一种改进的分割方法:利用码书背景建模对视频进行分割后,结合梯度因子、Sobel算子对分割结果进一步约束。实验结果表明,该方法可以有效地分割出前景目标,抗干扰能力强。     

一种动态场景下运动对象分割新算法

视频运动对象分割是计算机视觉和视频处理的基本问题。在摄像机存在全局运动的动态场景下,准确分割运动对象依然是难点和热点问题。本文提出一种基于全局运动补偿和核密度检测的动态场景下视频运动对象分割算法。首先,提出匹配加权的全局运动估计补偿算法,消除动态场景下背景运动对运动对象分割的影响;其次,采用非参数核密度估计方法分别估计各像素属于前景与背景的概率密度,通过比较属于前景和属于背景的概率及形态学处理得到运动对象分割结果。实验结果证明,该方法实现简单,有效地提高了动态场景下运动对象分割的准确性。     

A robust framework for joint background/foreground segmentation of complex video scenes filmed with freely moving camera

This paper explores a robust region-based general framework for discriminating between background and foreground objects within a complex video sequence. The proposed framework works under difficult conditions such as dynamic background and nominally moving camera. The originality of this work lies essentially in our use of the semantic information provided by the regions while simultaneously identifying novel objects (foreground) and non-novel ones (background). The information of background regions is exploited to make moving objects detection more efficient, and vice-versa. In fact, an initial panoramic background is modeled using region-based mosaicing in order to be sufficiently robust to noise from lighting effects and shadowing by foreground objects. After the elimination of the camera movement using motion compensation, the resulting panoramic image should essentially contain the background and the ghost-like traces of the moving objects. Then, while comparing the panoramic image of the background with the individual frames, a simple median-based background subtraction permits a rough identification of foreground objects. Joint background-foreground validation, based on region segmentation, is then used for a further examination of individual foreground pixels intended to eliminate false positives and to localize shadow effects. Thus, we first obtain a foreground mask from a slow-adapting algorithm, and then validate foreground pixels (moving visual objects + shadows) by a simple moving object model built by using both background and foreground regions. The tests realized on various well-known challenging real videos (across a variety of domains) show clearly the robustness of the suggested solution. This solution, which is relatively computationally inexpensive, can be used under difficult conditions such as dynamic background, nominally moving camera and shadows. In addition to the visual evaluation, spatial-based evaluation statistics, given hand-labeled ground truth, has been used as a performance measure of moving visual objects detection.     

Real-time video object segmentation in H.264 compressed domain

In this study the authors proposed a real-time video object segmentation algorithm that works in the H.264 compressed domain. The algorithm utilises the motion information from the H.264 compressed bit stream to identify background motion model and moving objects. In order to preserve spatial and temporal continuity of objects, Markov random field (MRF) is used to model the foreground field. Quantised transform coefficients of the residual frame are also used to improve segmentation result. Experimental results show that the proposed algorithm can effectively extract moving objects from different kinds of sequences. The computation time of the segmentation process is merely about 16 ms per frame for CIF size frame, allowing the algorithm to be applied in real-time applications.     

一种用于视频对象分割的仿U形网络

在半监督的分割任务中,单镜头视频对象分割(OSVOS)方法根据第一帧的对象标记掩模进行引导,从视频画面中分离出后续帧中的前景对象。虽然取得了令人印象深刻的分割结果,但其不适用于前景对象外观变化显著或前景对象与背景外观相似的情形。针对这些问题,提出一种用于视频对象分割的仿U形网络结构。将注意力机制加入到此网络的编码器和解码器之间,以便在特征图之间建立关联来产生全局语义信息。同时,优化损失函数,进一步解决了类别间的不平衡问题,提高了模型的鲁棒性。此外,还将多尺度预测与全连接条件随机场(FC/Dense CRF)结合,提高了分割结果边缘的平滑度。在具有挑战性的DAVIS 2016数据集上进行了大量实验,此方法与其他最先进方法相比获得了具有竞争力的分割结果。     

一种最大后验概率条件下的运动目标检测方法

提出一种最大后验概率条件下的运动目标检测方法.首先根据条件随机场模型和马尔可夫随机场模型建立了一个最大后验概率框架.在该框架内融入了连续标记场的时域信息、颜色信息和每个标记场的空域信息.考虑到传统方法融入的特征信息不够,提取目标的准确度不高,在目标模型中充分融入了颜色信息和边缘特征,以便获得更好的检测效果.实验结果表明提出的方法能正确检测到运动目标.     

Non-interactive automatic video segmentation of moving targets

Extracting moving targets from video accurately is of great significance in the field of intelligent transport.To some extent,it is related to video segmentation or matting.In this paper,we propose a non-interactive automatic segmentation method for extracting moving targets.First,the motion knowledge in video is detected with orthogonal Gaussian-Hermite moments and the Otsu algorithm,and the knowledge is treated as foreground seeds.Second,the background seeds are generated with distance transformation based on foreground seeds.Third,the foreground and background seeds are treated as extra constraints,and then a mask is generated using graph cuts methods or closed-form solutions.Comparison showed that the closed-form solution based on soft segmentation has a better performance and that the extra constraint has a larger impact on the result than other parameters.Experiments demonstrated that the proposed method can effectively extract moving targets from video in real time.     

用于虚拟广告系统的视频对象分割算法

在虚拟广告系统中,视频对象分割是其中最为关键的技术之一。在兼顾分割精度和实时性的原则上,提出了一种基于置信传播的视频运动对象分割算法。算法先建立背景、阴影和前景的统计模型,再结合马尔可夫随机场对像素空间相关性建模,最后利用置信传播算法完成有效的视频对象分割。实验结果表明算法具有良好的性能,并在虚拟广告系统中得到成功应用。     

模糊马尔可夫随机场理论在阴影检测中的应用

阴影的检测是目标检测、目标跟踪、视频监控等领域的一个关键问题。提出了一种基于模糊马尔可夫随机场的阴影检测算法。该算法把阴影检测问题看做是一个求最优化的像素点分类问题。对于输入的视频,提取背景图像,找出阴影和前景目标物体区域。通过计算阴影概率分布,前景概率分布,隶属度函数,建立模糊马尔可夫随机场。应用贝叶斯准则,最大后验(MAP)估计和条件迭代模式(ICM)算法,寻找最优化的模糊马尔可夫随机场,并利用最大隶属度原则消除模糊性,得到阴影检测的结果。实验证明,文中算法具有较好的阴影检测率和目标检测率。     

基于多线索动态融合的交互式图像分割

为了使图像分割效果稳定和提高分割算法的普适性,提出了一种利用多线索动态融合进行图像分割的方法,该方法首先将图像中的颜色信息、纹理信息、空间信息、边界信息融合到一个条件随机场模型中,用于图像分割;然后在对特定图像进行分割时,由于该模型能够利用用户在分割前标定的前景和背景信息来建立一种衡量概率分布估计可靠性的标准,并可通过该标准来组合条件随机场中的相关能量项,使它们能够根据图像的内在属性进行动态融合,从而提高了条件随机场图像分割的自适应性。实验结果表明,该方法分割效果稳定、普适性强,对一般的自然图像均能得到较好的分割效果。     

A probabilistic approach for foreground and shadow segmentation in monocular image sequences

This paper presents a novel method of foreground and shadow segmentation in monocular indoor image sequences. The models of background, edge information, and shadow are set up and adaptively updated. A Bayesian network is proposed to describe the relationships among the segmentation label, background, intensity, and edge information. A maximum a posteriori—Markov random field estimation is used to boost the spatial connectivity of segmented regions.     

Bilayer segmentation of webcam videos using tree-based classifiers

This paper presents an automatic segmentation algorithm for video frames captured by a (monocular) webcam that closely approximates depth segmentation from a stereo camera. The frames are segmented into foreground and background layers that comprise a subject (participant) and other objects and individuals. The algorithm produces correct segmentations even in the presence of large background motion with a nearly stationary foreground. This research makes three key contributions: First, we introduce a novel motion representation, referred to as "motons," inspired by research in object recognition. Second, we propose estimating the segmentation likelihood from the spatial context of motion. The estimation is efficiently learned by random forests. Third, we introduce a general taxonomy of tree-based classifiers that facilitates both theoretical and experimental comparisons of several known classification algorithms and generates new ones. In our bilayer segmentation algorithm, diverse visual cues such as motion, motion context, color, contrast, and spatial priors are fused by means of a conditional random field (CRF) model. Segmentation is then achieved by binary min-cut. Experiments on many sequences of our videochat application demonstrate that our algorithm, which requires no initialization, is effective in a variety of scenes, and the segmentation results are comparable to those obtained by stereo systems.     

结合识别信息的多目标视频分割

针对实际应用中待分割目标类型已知的情况,提出一种结合识别信息的多目标视频分割算法,使用训练数据集构建目标以及背景的特征字典,计算视频帧的超像素,构造一个分层条件随机场模型,用于约束视频帧的局部邻域和全局邻域,通过求解分层条件随机场模型,获得最终分割结果。实验结果表明,该算法能够对视频中相互遮挡及残缺不全的多个目标进行有效分割。     

结合识别信息的多目标视频分割

针对实际应用中待分割目标类型已知的情况,提出一种结合识别信息的多目标视频分割算法,使用训练数据集构建目标以及背景的特征字典,计算视频帧的超像素,构造一个分层条件随机场模型,用于约束视频帧的局部邻域和全局邻域,通过求解分层条件随机场模型,获得最终分割结果。实验结果表明,该算法能够对视频中相互遮挡及残缺不全的多个目标进行有效分割。     

基于动态密集条件随机场增量推理计算的多类别视频分割

针对现有基于条件随机场（CRF）的多类别视频分割计算量随帧数不断增加的问题,提出了一种用于密集（全连接）CRF推断的快速、全动态推理（inference）算法,并有效地推断出了增量式多类别视频分割中动态密集CRF的最大后验概率（MAP）解决方案。与传统的密集CRF处理视频相比,该方法更适合于在线的机器人增量式视频分割的处理计算。实验结果表明,在多类别视频分割应用中,该动态算法明显快于广为人知的标准密集CRF算法,其计算精度与标准密集CRF算法保持不变。几个多类别视频分割测试证实了本算法的推理效率。该算法不仅限于视频分割,还可应用于诸多类似的增量式动态变化CRF模型中MAP推理计算的优化解决方案。     

基于视觉背景提取的自适应运动目标提取算法

在复杂场景下的视频运动目标提取是视频分析技术的首要工作。为了解决前景运动目标提取的精确度不高的问题,提出一种基于视觉背景提取(ViBE)的改进视频运动目标提取算法(ViBE⁺)。首先,在背景模型初始化阶段采用像素的菱形邻域来简化样本信息;其次,在前景运动目标提取阶段引入自适应分割阈值来适应场景的动态变化;最后,在更新阶段提出背景重建和调整更新因子方法来处理光照变化的情形。实验结果表明,对于复杂视频场景LightSwitch的运动目标提取结果在相似度指标上,改进后的算法与混合高斯模型(GMM)算法、码本模型算法以及原始ViBE算法相比,分别提高了1.3倍、1.9倍以及3.8倍。所提算法能够在有效时间内对复杂场景具有较好的自适应性,且性能明显优于对比算法。     

基于纹理特征改进的GFL运动目标提取方法

基于广义融合套索（GFL）前景模型，融合视频的纹理特征，提出一种基于纹理特征的运动目标提取方法。方法通过GFL前景模型提取前景运动目标和背景，再利用LBP算法提取前景与背景在多个方向上的纹理特征，比较两者纹理特征的相似度，去除前景中的投射阴影，解决由于运动目标遮挡产生的阴影问题，同时还引入误判率去描述模型的准确度。通过对广场、办公室以及体育馆等实际场景进行测试，实验表明提出的算法能够有效去除运动目标产生的阴影。     

融合时域信息的修正分水岭视频分割新方法

提出一种将时域信息融入分水岭的视频分割新方法,以帧间变化检测为基础,通过运动边缘信息得到对象的初始模型,利用时域信息得到前景和背景的标识,结合提出的彩色多尺度形态学梯度算子进行分水岭分割,得到具有精确边界的视频对象,对慢变和快变的目标均有良好的效果,能够检测新出现的运动对象和现有对象的消失,能够定位和跟踪运动目标.继承了变化检测和分水岭算法速度快的优点,克服了两者易受噪声影响的缺点.