基于改进动态阈值的运动车辆实时快速检测方法*

提出了复杂交通环境下一种新的运动车辆检测方法。基于背景差分获得运动图像,利用自适应阈值选取方法分别对差分图像的三个颜色通道进行二值化,从而实现运动目标的精确检测。根据检测结果,采用中值更新方法实现背景图像的实时更新。实验结果表明,这种基于改进动态阈值和自适应背景相结合的快速检测算法可以从复杂交通场景图像序列中快速有效地检测出运动目标,能够很好地满足智能交通监控系统中运动车辆实时检测的要求。     

基于多模式均值时空模型的目标融合检测方法

针对复杂环境下的目标检测问题,提出了一种基于背景模型的融合检测方法。首先在多模式均值模型的基础上,构造多模式均值时空模型,结合像素在时空域上的分布信息,改善了模型对非平稳场景较为敏感的缺点,给出了模型更新方法和前景检测方法;然后利用该模型对可见光和红外图像序列分别进行建模和前景检测,给出了一种基于置信度的目标融合检测方法,利用双传感器信息提高检测精度和可靠性。实验结果验证了本文方法的有效性。     

基于改进Sigma-Delta滤波的复杂场景背景估计

背景估计是运动目标检测一项重要的前期工作,在城市交通等复杂场景中,存在大量慢速或暂停运动目标,背景模型很快受到污染,需要进行较多的后续处理或者采用高复杂度算法来检测前景。针对该问题,提出基于Sigma-Delta滤波改进的背景估计算法,融合可选择性背景更新机制和多频Sigma-Delta滤波背景估计方法,处理复杂场景中不同运动目标的运动特征,以获取稳定的背景。通过对典型城市路段和交叉口复杂交通场景序列进行对比实验,结果表明,该算法在保持Sigma-Delta滤波低内存消耗和高计算效率的基础上可获得更好的检测效果。     

Temporally Coherent Adaptive Sampling for Imperfect Shadow Maps

We propose a new adaptive algorithm for determining virtual point lights (VPL) in the scope of real‐time instant radiosity methods, which use a limited number of VPLs. The proposed method is based on Metropolis‐Hastings sampling and exhibits better temporal coherence of VPLs, which is particularly important for real‐time applications dealing with dynamic scenes. We evaluate the properties of the proposed method in the context of the algorithm based on imperfect shadow maps and compare it with the commonly used inverse transform method. The results indicate that the proposed technique can significantly reduce the temporal flickering artifacts even for scenes with complex materials and textures. Further, we propose a novel splatting scheme for imperfect shadow maps using hardware tessellation. This scheme significantly improves the rendering performance particularly for complex and deformable scenes. We thoroughly analyze the performance of the proposed techniques on test scenes with detailed materials, moving camera, and deforming geometry.     

A temporal-spatial background modeling of dynamic scenes

Moving object detection in dynamic scenes is a basic task in a surveillance system for sensor data collection. In this paper, we present a powerful background subtraction algorithm called Gaussian-kernel density estimator (G-KDE) that improves the accuracy and reduces the computational load. The main innovation is that we divide the changes of background into continuous and stable changes to deal with dynamic scenes and moving objects that first merge into the background, and separately model background using both KDE model and Gaussian models. To get a temporal-spatial background model, the sample selection is based on the concept of region average at the update stage. In the detection stage, neighborhood information content (NIC) is implemented which suppresses the false detection due to small and un-modeled movements in the scene. The experimental results which are generated on three separate sequences indicate that this method is well suited for precise detection of moving objects in complex scenes and it can be efficiently used in various detection systems.     

灰关联分析在视频运动目标检测中的应用

由于运动图像和背景具有极大相似性,通过背景图像和运动图像之间关联程度的大小能够检测出运动目标,故提出一种基于灰关联分析的运动目标检测方法.在室内和室外不同光照场景下,通过固定摄像机捕获的视频图像序列中的运动车体和人体进行检测;选取适当的比较图像序列,对该序列和含有运动目标的视频图像作灰关联分析,以清楚、完整地提取出运动目标.该方法对背景的要求很低,对噪声的抑制能力强,可以在一定程度上抑制阴影的影响.     

基于Digiclops立体视觉系统的单指指尖跟踪

提出一种复杂背景下检测单指指尖位置的方法,该方法使用Digiclops立体视觉系统采集图像,并得到手指区域的子图像。对于手指正指的情况,可迅速计算出指尖的位置;对于手指侧指的情况,在手指图像基础上,设计一种鲁棒的指尖检测算法定位出指尖的位置。实验表明,该方法对指尖位置检测准确,用该方法处理每一帧图像,可实时跟踪指尖,从而实现了基于指尖跟踪的感知用户界面系统。     

一种改进的复杂场景运动目标检测算法

提出了一种复杂场景视频序列中运动目标精确检测及提取的改进算法,该算法首先采用混合高斯模型(简称GMM)对背景及前景建模快速地实现前景运动区域提取,然后结合目标帧间相关性和随机噪声帧间无关的特点采用时间滤波(Tem-poral Filter)法和数学形态学进行后处理.实验结果表明本文所采用的改进算法能准确的提取运动目标滤除动态噪声,提高了检测鲁棒性,对复杂干扰场景下的实时运动目标检测得到了较令人满意的效果.     

基于FCN-LSTM的工业烟尘图像分割

工业生产中常根据林格曼烟气黑度判断工业烟尘的污染等级,一种有效的方式是应用计算机视觉系统对工业烟尘进行监测, 其中对烟尘目标进行准确分割是该系统的关键技术。因为工业烟尘具有形状不固定、和云相似度高等特点,现有算法在复杂场景下对烟尘进行分割时容易受到干扰,分割准确度有待提高。针对这一问题,提出一种基于FCN-LSTM的工业烟尘图像分割方法,在全卷积网络对图像空间特征提取的基础上,使用长短时记忆网络提取图像序列的时间信息,通过烟尘的动态特征对运动的烟尘和背景进行区分,增强复杂场景下的抗干扰能力。实验表明,本文模型相比于全卷积网络,在复杂场景下的抗干扰能力有显著提升,能够有效克服来自云的干扰,对全卷积网络分割结果中易出现干扰点的问题也有改善,IoU指标最高有8.04%的提升。     

Moving vehicles detection based on adaptive motion histogram

As one of the important topics in computer vision, moving vehicle segmentation has attracted considerable attention of researchers. However, robust detection is hampered by the interferential moving objects in dynamic scenes. In this paper, we address the problem of the moving vehicles segmentation in the dynamic scenes. Based on the distinct motion property of the dynamic background and that of the moving vehicles, we present an adaptive motion histogram for moving vehicles segmentation. The presented algorithm consists of two procedures: adaptive background update and motion histogram-based vehicles segmentation. In the adaptive background update procedure, we make use of the lighting change of the scene and present a novel method for background evolving. In the motion histogram-based vehicles segmentation procedure, an adaptive motion histogram is maintained and updated according to the motion information in the scenes, and the moving vehicles are then detected according to the motion histogram maintained. Experimental results of typical scenes demonstrate robustness of the proposed method. Quantitative evaluation and comparison with the existing methods show that the proposed method provides much improved results.     

基于视觉背景提取的自适应运动目标提取算法

在复杂场景下的视频运动目标提取是视频分析技术的首要工作。为了解决前景运动目标提取的精确度不高的问题,提出一种基于视觉背景提取(ViBE)的改进视频运动目标提取算法(ViBE⁺)。首先,在背景模型初始化阶段采用像素的菱形邻域来简化样本信息;其次,在前景运动目标提取阶段引入自适应分割阈值来适应场景的动态变化;最后,在更新阶段提出背景重建和调整更新因子方法来处理光照变化的情形。实验结果表明,对于复杂视频场景LightSwitch的运动目标提取结果在相似度指标上,改进后的算法与混合高斯模型(GMM)算法、码本模型算法以及原始ViBE算法相比,分别提高了1.3倍、1.9倍以及3.8倍。所提算法能够在有效时间内对复杂场景具有较好的自适应性,且性能明显优于对比算法。     

Feature Point Tracking for Incomplete Trajectories

A new algorithm is presented for feature point based motion tracking in long image sequences. Dynamic scenes with multiple, independently moving objects are considered in which feature points may temporarily disappear, enter and leave the view field. This situation is typical for surveillance and scene monitoring applications. Most of the existing approaches to feature point tracking have limited capabilities in handling incomplete trajectories, especially when the number of points and their speeds are large, and trajectory ambiguities are frequent. The proposed algorithm was designed to efficiently resolve these ambiguities. Correspondences between moving points are established in a competitive linking process that develops as the trajectories grow. Appearing and disappearing points are treated in a natural way as the points that do not link. The proposed algorithm compares favorably to efficient alternative algorithms selected and tested in a performance evaluation study. Received: June 8, 1998; revised November 18, 1998     

一种基于改进码本的车辆检测与跟踪方法

为了解决固定摄像机下车辆跟踪过程中阴影对检测的影响,提出一种改进型码本模型的车辆检测方法。该方法直接对YUV空间的车辆序列进行处理,将采样到的背景值聚类成码本,对于新输入的像素值与其对应位置的码本作比较判断,提取出前景区域。车辆跟踪中采用Kalman预测的方法来处理车辆遮挡问题。实验结果表明,本算法可以从复杂交通场景图像序列中快速有效地检测出运动目标,能较好地处理阴影、高亮、遮挡和背景变化等问题,且计算复杂度小,能满足实时跟踪的需要。     

A consensus-based method for tracking: Modelling background scenario and foreground appearance

Modelling of the background (“uninteresting parts of the scene”), and of the foreground, play important roles in the tasks of visual detection and tracking of objects. This paper presents an effective and adaptive background modelling method for detecting foreground objects in both static and dynamic scenes. The proposed method computes SAmple CONsensus (SACON) of the background samples and estimates a statistical model of the background, per pixel. SACON exploits both color and motion information to detect foreground objects. SACON can deal with complex background scenarios including nonstationary scenes (such as moving trees, rain, and fountains), moved/inserted background objects, slowly moving foreground objects, illumination changes etc.However, it is one thing to detect objects that are not likely to be part of the background; it is another task to track those objects. Sample consensus is again utilized to model the appearance of foreground objects to facilitate tracking. This appearance model is employed to segment and track people through occlusions. Experimental results from several video sequences validate the effectiveness of the proposed method.     

基于全景摄像头的柱面展开及实时目标跟踪

传统摄像头在获取大范围复杂场景中的感兴趣目标时,容易出现目标物体丢失或遮挡等问题。为此,提出一种基于全景摄像头的柱面展开及运动目标实时跟踪算法。通过改进的柱面展开算法对360。摄像头获取的全景图像进行还原展开,解决全景图像中的成像扭曲问题。利用CamShift和Kalman预测相结合的算法跟踪运动目标。实验结果表明,在运动目标存在遮挡、短暂消失或同色物体干扰的情况下,该方法能实现对全景范围复杂环境中运动目标实时鲁棒的跟踪。     

特征点维度的静态场景三维重建运动目标剔除

基于语义分割的图像掩膜方法常用来解决静态场景三维重建任务中运动物体的干扰问题,然而利用掩膜成功剔除运动物体的同时会产生少量无效特征点.针对此问题,提出一种在特征点维度的运动目标剔除方法,利用卷积神经网络获取运动目标信息,并构建特征点过滤模块,使用运动目标信息过滤更新特征点列表,实现运动目标的完全剔除.通过采用地面图像和航拍图像两种数据集以及DeepLabV3、YOLOv4两种图像处理算法对所提方法进行验证,结果表明特征点维度的三维重建运动目标剔除方法可以完全剔除运动目标,不产生额外的无效特征点,且相较于图像掩膜方法平均缩短13.36%的点云生成时间,减小9.93%的重投影误差.     

面向智能视频监控中的运动目标检测方法研究

运动目标检测是实现智能视频监控的基础,针对当前运动目标检测方法在复杂场景中适应性差的问题,提出了一种结合时空马尔可夫随机场模型和高斯混合模型的运动目标检测方法。在训练时空马尔可夫随机场模型时,采用高斯混合模型的参数更新算法计算邻域图像分割区域的均值和方差,并通过时空邻域标记场设置势函数。通过与传统目标检测方法的仿真比较,验证了该方法的优越性。结果表明,与传统的目标检测方法相比,该方法在复杂场景下具有更高的检测精度,能够更清晰地分割前景中的运动目标。     

一种基于半直接视觉里程计的RGB-D SLAM算法

提出了一种新的基于半直接视觉里程计的RGB-D SLAM（同步定位与地图创建）算法,同时利用直接法和传统特征点法的优势,结合鲁棒的后端优化和闭环检测,有效提高了算法在复杂环境中的定位和建图精度．在定位阶段,采用直接法估计相机的初始位姿,然后通过特征点匹配和最小化重投影误差进一步优化位姿,通过筛选地图点并优化位姿输出策略,使算法能够处理稀疏纹理、光照变化、移动物体等难题．算法具有全局重定位的能力．在后端优化阶段,提出了一种新的关键帧选取策略,同时保留直接法选取的局部关键帧和特征点法选取的全局关键帧,并行地维护2种关键帧,分别在滑动窗口和特征地图中对它们进行优化．算法通过对全局关键帧进行闭环检测和优化,提高SLAM的全局一致性．基于标准数据集和真实场景的实验结果表明,算法的性能在许多实际场景中优于主流的RGB-D SLAM算法,对纹理稀疏和有移动物体干扰的环境的鲁棒性较强．     

Moving Cast Shadows Detection Using Ratio Edge

Moving objects segmentation plays a very important role in real-time image analysis. However, as one of the common parts in the natural scenes, shadows severely interfere with the accuracy of moving objects detection in video surveillance. In this paper, we present a novel method for moving cast shadows detection. Based on the analysis of the physical model of moving shadows, we prove that the ratio edge is illumination invariant. The distribution of the ratio edge is discussed and a significance test is performed to classify each moving pixel into foreground object or moving shadow. Intensity constraint and geometric heuristics are imposed to further improve the performance. Experiments on various typical scenes exhibit the robustness of the proposed method. Extensively quantitative evaluation and comparison demonstrate that the proposed method significantly outperforms state-of-the-art methods.     

智能视频监控中运动目标检测的研究

针对某武器试验中背景复杂,现有的背景差分法在背景模型的维持和更新不能用于长期和复杂的场景,以及对近地目标提取检测困难的问题,提出一种改进的背景差分法。该算法采用结合邻域信息的背景差分法和最大方差阈值法,能够在一定程度上减小背景滞后更新引起的运动目标检测误差,且使目标边缘提取更加明确,从而提高了系统的运行速度,实现复杂背景下的运动目标检测。在Visual C＋＋6.0中用OpenCV实现了相关算法的设计,并给出了完成系统任务所需的部分关键代码,实现了运动目标和试验场景的分离与提取。仿真实验验证了该算法的有效性以及实时性。