融合行人时空信息的视频异常检测

针对目前视频异常检测不能充分利用时序信息且忽视正常行为多样性的问题，提出了一种融合行 人时空信息的异常检测方法。以卷积自编码器为基础，通过其中的编码器和解码器对输入帧进行压缩和还原，并 根据输出帧与真实值的差异实现异常检测。为了加强视频连续帧之间的特征信息联系，引入残差时间移位模块和 残差通道注意力模块，分别提升网络对时间信息和通道信息的建模能力。考虑到卷积神经网络(CNN)过度的泛化 性，在编解码器各层的跳跃连接之间加入记忆增强模块，限制自编码器对异常帧过于强大的表示能力，提高网络 的异常检测精度。此外，通过一种特征离散性损失来修正目标函数，有效区分不同的正常行为模式。在 CUHK Avenue 和 ShanghaiTech 数据集上的实验结果表明，该方法在满足实时性要求的同时，优于当前主流的视频异常 检测方法。

Video anomaly detection combining pedestrian spatiotemporal information

To address the current problem that video anomaly detection cannot make full use of temporal information and ignores the diversity of normal behaviors, an anomaly detection method incorporating pedestrian spatiotemporal information was proposed. Based on the convolutional auto-encoder, the input frames were compressed and reduced by the encoder and decoder in it, and the anomaly detection was realized according to the difference between the output frames and the real value. In order to strengthen the feature information connection between consecutive frames of the video, the residual time shift module and the residual channel attention module were introduced to enhance the network?s ability to model temporal and channel information, respectively. Considering the overgeneralization of the convolutional neural networks (CNN), a memory-augmented module was added between the skip connections of each layer of the encoder and decoder to limit the overpowering representation of anomalous frames by the auto-encoder and improve the anomaly detection accuracy of the network. In addition, the objective function was modified by a kind of feature separateness loss to effectively distinguish different normal behavior patterns. Experimental results on the CUHK Avenue and ShanghaiTech datasets show that the proposed method outperforms the current mainstream video anomaly detection methods while meeting the real-time requirements.