亮度特征自相关和GMM相结合的目标检测

基于混合高斯模型(GMM)的背景建模算法被广泛运用于运动目标检测,但在一些发生快速光照变化的视频序列中,不能正确地检测出运动目标。此外在对GMM参数进行初始化时,若初始化图像中存在运动目标,则目标检测的结果会出现初始化图像中的运动目标,从而导致误检测。针对上述问题,提出一种基于亮度特征自相关的GMM算法,该算法根据亮度特征自相关参数判断初始化图像中是否存在运动目标,利用亮度特征自相关参数的拟合值判断当前帧是否发生快速光照变化,运用GMM和亮度差值相结合进行目标检测。对实际摄取的视频进行仿真实验,结果证明,该算法在GMM初始化图像存在运动目标的干扰条件下,能够较好地从发生快速光照变化的视频序列中提取出运动目标,满足准确性和实时性的要求。     

基于概率假设密度的多目标视频跟踪算法

研究目标数变化的多目标视频跟踪问题.首先阐述了概率假设密度(PHD)滤波的基本原理;然后给出序列图像多目标跟踪系统的运动目标检测算法、状态方程、观测方程以及基于高斯混合概率假设密度(GM-PHD)的多目标视频跟踪算法的具体实现.该算法有效解决了新目标出现、目标合并、目标分裂及目标消失等多目标跟踪问题.实验结果表明,该算法在复杂场景下具有较强的鲁棒性,能有效实现目标数变化的多目标视频跟踪.     

基于骨架序列提取的异常行为识别

视频监控系统中的人员异常行为识别研究具有重要意义.针对传统算法检测实时性和准确性差,易受环境影响的问题,提出一种基于骨架序列提取的异常行为识别算法.首先,改进YOLOv3网络用以对目标进行检测、结合RT-MDNet算法进行跟踪,得到目标的运动轨迹;然后,利用OpenPose模型提取轨迹中目标的骨架序列;最后通过时空图卷积网络结合聚类对目标进行异常行为识别.实验结果表明,在存在光照变化的复杂环境下,算法识别准确率达94%,处理速度达18.25 fps,能够实时、准确地识别多种目标的异常行为.     

奇异值分解和改进PCA的视频人脸检索方法

针对视频中人脸检索问题,提出一种基于奇异值分解和改进PCA相结合的视频中单样本人脸检索方法,其中通过融合局部均值和标准差的图像增强处理来实现PCA算法的改进,从而克服光照对目标的影响。通过AdaBoost人脸检测算法对人脸图像和视频进行人脸检测;通过奇异值分解增加训练样本,在原样本和新样本的基础上采用改进的PCA人脸识别算法提取待检测人脸和视频中的人脸代数特征;采用最近邻分类器进行特征匹配,判断视频中检测出的人脸是否为要检索的目标人脸。实验结果表明,该方法在简单背景的视频环境下可以较准确地检索出目标人脸。     

基于ICA特征的运动阴影检测算法

为防止运动阴影在视频图像序列中被错误地检测为目标,必须提高阴影检测算法的准确性和普适性。为此,从独立分量分析(ICA)的原理及其特性出发,提出一种基于空间变换技术的运动阴影检测算法。该算法通过对视频序列建立高斯混合背景模型产生自适应背景,利用ICA技术对其进行空间变换提取特征,再通过背景与当前帧图像对应像素点在特征空间的位置特征来分类运动阴影与前景目标。实验结果表明该方法能够较好地抑制噪声,减少光照变化的影响,准确地检测出阴影。     

复杂光照环境下视频人脸序列的自动检测方法

基于视频序列人脸自动检测是人脸跟踪、识别等研究的基础。提出了一种结合图像增强技术、gabor特征变 换和adaboost算法的视频序列人脸检测方法,其主要思想是使用图像增强技术对图像进行光照补偿,减轻不同的光 照条件(如局部的阴影和高亮等)对检测结果的影响。该方法首先通过高频增强滤波强化图像的边缘和细节信息,用 基于直方图的技术来调节图像的亮度,然后应用gabor小波变换进行特征抽取,最后采用adaboost方法训练样本,完 成人脸的检测。实验表明,该方法能够在不同的光照条件下准确检测出人脸,显示出较强的鲁棒性。     

基于改进运动历史图像的多运动目标实时跟踪

提出了一种利用视频图像对运动目标进行实时检测与跟踪的新方法.该方法利用基于改进的时间片的运动历史图像(tMHI)的灰度阶梯轮廓方法对多个运动目标进行检测,通过卡尔曼滤波器对多目标进行跟踪,并得到了各个运动目标的轨迹曲线,进而实现了对视频图像中多目标的跟踪.同时,该方法对多个目标的遮挡问题获得了明显的改善效果.实验结果表明,该方法能够对复杂场景下的多个目标进行有效的识别和准确的跟踪,系统的实时性强,识别率高,而且该方法对于复杂视频监视系统场景中的光照变化、雨雾等干扰具有较强的稳健性.     

基于改进CAMShift的运动目标跟踪算法

针对视频序列图像目标跟踪中Mean Shift算法提取目标颜色特征易受背景影响的问题,首先选取非线性核密度估计方法用来进行运动目标的检测,然后采用CAMShift方法对检测到的目标进行跟踪,并结合非线性核密度估计的检测结果对目标直方图进行自适应更新。还针对目标的遮挡问题给出解决方法。实验结果表明,引入背景减法与CAMShift相结合的策略,能够实现运动目标的自动跟踪,并实现目标直方图的自适应更新。该算法的可靠性能满足实时检测的要求,较好地解决了光照变化、阴影及遮挡等造成的影响。     

复杂光照环境下视频人脸序列的自动检测方法

基于视频序列人脸自动检测是人脸跟踪、识别等研究的基础.提出了一种结合图像增强技术、gabor特征变换和adaboost算法的视频序列人脸检测方法,其主要思想是使用图像增强技术对图像进行光照补偿,减轻不同的光照条件(如局部的阴影和高亮等)对检测结果的影响.该方法首先通过高频增强滤波强化图像的边缘和细节信息,用基于直方图的技术采调节图像的亮度,然后应用gabor小波变换进行特征抽取,最后采用adaboost方法训练样本,完成人脸的检测.实验表明,该方法能够在不同的光照条件下准确检测出人脸,显示出较强的鲁棒性.     

基于同态滤波抑制光照变化的视频分割算法

针对光照变化较大时基于颜色差分直方图的视频分割算法不能有效更新背景,导致后续输入图像前景目标分割失效的问题,提出一种基于同态滤波抑制光照变化的视频分割算法。首先利用同态滤波算法对输入和背景图像(RGB)在HSV空间中亮度分量进行同参矫正,然后将矫正后图像转换到RGB空间,最后利用颜色差分直方图算法进行视频分割。文中算法有效解决颜色差分直方图算法无法将受光照变化影响较大区域更新到背景中的问题,实现背景的实时有效更新,保证稳健地从后续输入图像分割前景目标。3组视频仿真结果表明该算法与高斯混合和Codebook算法相比具有运算速度快,对光照变化鲁棒的优点。     

Abnormal visual event detection based on multi-instance learning and autoregressive integrated moving average model in edge-based Smart City surveillance

The abnormal visual event detection is an important subject in Smart City surveillance where a lot of data can be processed locally in edge computing environment. Real-time and detection effectiveness are critical in such an edge environment. In this paper, we propose an abnormal event detection approach based on multi-instance learning and autoregressive integrated moving average model for video surveillance of crowded scenes in urban public places, focusing on real-time and detection effectiveness. We propose an unsupervised method for abnormal event detection by combining multi-instance visual feature selection and the autoregressive integrated moving average model. In the proposed method, each video clip is modeled as a visual feature bag containing several subvideo clips, each of which is regarded as an instance. The time-transform characteristics of the optical flow characteristics within each subvideo clip are considered as a visual feature instance, and time-series modeling is carried out for multiple visual feature instances related to all subvideo clips in a surveillance video clip. The abnormal events in each surveillance video clip are detected using the multi-instance fusion method. This approach is verified on publically available urban surveillance video datasets and compared with state-of-the-art alternatives. Experimental results demonstrate that the proposed method has better abnormal event detection performance for crowded scene of urban public places with an edge environment.     

Hierarchical database for a multi-camera surveillance system

This paper presents a framework for event detection and video content analysis for visual surveillance applications. The system is able to coordinate the tracking of objects between multiple camera views, which may be overlapping or non-overlapping. The key novelty of our approach is that we can automatically learn a semantic scene model for a surveillance region, and have defined data models to support the storage of tracking data with different layers of abstraction into a surveillance database. The surveillance database provides a mechanism to generate video content summaries of objects detected by the system across the entire surveillance region in terms of the semantic scene model. In addition, the surveillance database supports spatio-temporal queries, which can be applied for event detection and notification applications.     

SOINN-Based Abnormal Trajectory Detection for Efficient Video Condensation

With the evolution of video surveillance systems, the requirement of video storage grows rapidly; in addition, safe guards and forensic officers spend a great deal of time observing surveillance videos to find abnormal events. As most of the scene in the surveillance video are redundant and contains no information needs attention, we propose a video condensation method to summarize the abnormal events in the video by rearranging the moving trajectory and sort them by the degree of anomaly. Our goal is to improve the condensation rate to reduce more storage size, and increase the accuracy in abnormal detection. As the trajectory feature is the key to both goals, in this paper, a new method for feature extraction of moving object trajectory is proposed, and we use the SOINN (Self-Organizing Incremental Neural Network) method to accomplish a high accuracy abnormal detection. In the results, our method is able to shirk the video size to 10% storage size of the original video, and achieves 95% accuracy of abnormal event detection, which shows our method is useful and applicable to the surveillance industry.     

一种基于事件检测的视频取证方法*

目前计算机视频取证的一个重要目标是如何快速准确地在海量视频中定位犯罪事件发生的时刻和地点,最终形成视频证据。针对复杂背景条件下丢弃或拾起等事件的监控视频,提出一种基于光流特征和形状特征结合的事件检测方法。通过实验证明了该方法在视频事件分析取证中的有效性。     

基于OpenCV的通用人脸检测模块设计

人脸检测是智能视频监控系统中的重要组成部分,OpenCV实现的Adaboost人脸检测算法达到了实时检测人脸的处理速度.但在实际应用中,由于平台移植等障碍,现有系统升级兼容此模块困难.本文提出了一种支持多编程语言平台的通用人脸检测模块,详细阐述了.NET平台调用技术和改进的JNI方法调用OpenCV人脸检测模块的具体步...     

融合自编码器和one-class SVM的异常事件检测

目的 在自动化和智能化的现代生产制造过程中,视频异常事件检测技术扮演着越来越重要的角色,但由于实际生产制造中异常事件的复杂性及无关生产背景的干扰,使其成为一项非常具有挑战性的任务。很多传统方法采用手工设计的低级特征对视频的局部区域进行特征提取,然而此特征很难同时表示运动与外观特征。此外,一些基于深度学习的视频异常事件检测方法直接通过自编码器的重构误差大小来判定测试样本是否为正常或异常事件,然而实际情况往往会出现一些原本为异常的测试样本经过自编码得到的重构误差也小于设定阈值,从而将其错误地判定为正常事件,出现异常事件漏检的情形。针对此不足,本文提出一种融合自编码器和one-class支持向量机（support vector machine,SVM）的异常事件检测模型。方法 通过高斯混合模型（Gaussian mixture model,GMM）提取固定大小的时空兴趣块（region of interest,ROI）;通过预训练的3维卷积神经网络（3D convolutional neural network,C3D）对ROI进行高层次的特征提取;利用提取的高维特征训练一个堆叠的降噪自编码器,通过比较重构误差与设定阈值的大小,将测试样本判定为正常、异常和可疑3种情况之一;对自编码器降维后的特征训练一个one-class SVM模型,用于对可疑测试样本进行二次检测,进一步排除异常事件。结果 本文对实际生产制造环境下的机器人工作场景进行实验,采用AUC （area under ROC）和等错误率（equal error rate,EER）两个常用指标进行评估。在设定合适的误差阈值时,结果显示受试者工作特征（receiver operating characteristic,ROC）曲线下AUC达到91.7%,EER为13.8%。同时,在公共数据特征集USCD （University of California,San Diego） Ped1和USCD Ped2上进行了模型评估,并与一些常用方法进行了比较,在USCD Ped1数据集中,相比于性能第2的方法,AUC在帧级别和像素级别分别提高了2.6%和22.3%;在USCD Ped2数据集中,相比于性能第2的方法,AUC在帧级别提高了6.7%,从而验证了所提检测方法的有效性与准确性。结论 本文提出的视频异常事件检测模型,结合了传统模型与深度学习模型,使视频异常事件检测结果更加准确。     

Activity classification and anomaly detection using m-mediods based modelling of motion patterns

Techniques for video object motion analysis, behaviour recognition and event detection are becoming increasingly important with the rapid increase in demand for and deployment of video surveillance systems. Motion trajectories provide rich spatiotemporal information about an object's activity. This paper presents a novel technique for classification of motion activity and anomaly detection using object motion trajectory. In the proposed motion learning system, trajectories are treated as time series and modelled using modified DFT-based coefficient feature space representation. A modelling technique, referred to as m-mediods, is proposed that models the class containing n members with m mediods. Once the m-mediods based model for all the classes have been learnt, the classification of new trajectories and anomaly detection can be performed by checking the closeness of said trajectory to the models of known classes. A mechanism based on agglomerative approach is proposed for anomaly detection. Four anomaly detection algorithms using m-mediods based representation of classes are proposed. These includes: (i)global merged anomaly detection (GMAD), (ii) localized merged anomaly detection (LMAD), (iii) global un-merged anomaly detection (GUAD), and (iv) localized un-merged anomaly detection (LUAD). Our proposed techniques are validated using variety of simulated and complex real life trajectory datasets.     

Hierarchical abnormal event detection by real time and semi-real time multi-tasking video surveillance system

In this paper, we describe how to detect abnormal human activities taking place in an outdoor surveillance environment. Human tracks are provided in real time by the baseline video surveillance system. Given trajectory information, the event analysis module will attempt to determine whether or not a suspicious activity is currently being observed. However, due to real-time processing constrains, there might be false alarms generated by video image noise or non-human objects. It requires further intensive examination to filter out false event detections which can be processed in an off-line fashion. We propose a hierarchical abnormal event detection system that takes care of real time and semi-real time as multi-tasking. In low level task, a trajectory-based method processes trajectory data and detects abnormal events in real time. In high level task, an intensive video analysis algorithm checks whether the detected abnormal event is triggered by actual humans or not.