数据采集与处理2024,Vol.39Issue(1) :204-214.DOI:10.16337/j.1004-9037.2024.01.018

基于时空依赖关系和特征融合的弱监督视频异常检测

Weakly Supervised Video Anomaly Detection Based on Spatio-Temporal Dependence and Feature Fusion

柳德云 李莹 周震 吉根林
数据采集与处理2024,Vol.39Issue(1) :204-214.DOI:10.16337/j.1004-9037.2024.01.018

基于时空依赖关系和特征融合的弱监督视频异常检测

Weakly Supervised Video Anomaly Detection Based on Spatio-Temporal Dependence and Feature Fusion

柳德云 1李莹 1周震 1吉根林1
扫码查看

作者信息

  • 1. 南京师范大学计算机与电子信息学院/人工智能学院,南京 210023
  • 折叠

摘要

弱监督视频异常检测由于抗干扰性强、数据标注要求低,成为视频异常事件检测研究的热点.在现有的工作中,大多数弱监督视频异常检测方法认为各个视频段独立同分布,单独判断每个视频段是否异常,忽略了视频段间的时空依赖关系.为此,提出了一种基于时空依赖关系和特征融合的弱监督视频异常检测方法,在保留视频段原始特征的同时,使用视频段之间的索引距离和特征相似程度拟合视频段的时间和空间依赖关系,构建视频段的关系特征.通过融合原始特征和关系特征,更好地表达视频的动态特性和时序关系.在UCF-Crime和ShanghaiTech 两个基准数据集上进行了大量实验,实验结果表明所提方法的AUC指标优于其他方法,AUC值分别达到了80.1%和94.6%.

Abstract

Weakly supervised video anomaly detection has become a hot spot in video anomaly detection research due to its strong anti-interference and low data labeling requirements.In the existing methods,most of the weakly supervised video anomaly detection methods assume that the clips in each video distribute independently,and determine whether it is abnormal for each video clip independently,ignoring the temporal and spatial information between video clips.To alleviate these problems,this paper proposes a weakly supervised anomaly detection method based on spatio-temporal dependence and feature fusion.Retaining the original characteristics of video clips,this method uses the distance of index and the similarity of features between video clips to fit the time dependence and the spatial dependencies of video,which builds the relationship characteristics of video clips.By fusing the original features and relationship features,the dynamic characteristics and temporal relationship of videos can be better expressed.Extensive experiments on two benchmark datasets,UCF-Crime and ShanghaiTech,demonstrate that the proposed method outperforms other methods with the AUC values reaching 80.1%and 94.6%,respectively.

关键词

视频异常事件检测/时空依赖关系/特征融合/图卷积神经网络/注意力机制

Key words

video anomaly event detection/spatio-temporal dependence/feature fusion/graph convolutional neural network/attention mechanism

引用本文复制引用

基金项目

国家自然科学基金(41971343)

国家自然科学基金(62102186)

出版年

2024
数据采集与处理
中国电子学会 中国仪器仪表学会信号处理学会 中国仪器仪表学会中国物理学会微弱信号检测学会 南京航空航天大学

数据采集与处理

CSTPCDCSCD北大核心
影响因子:0.679
ISSN:1004-9037
参考文献量5
段落导航相关论文