首页|基于注意力特征融合的视频异常行为检测

基于注意力特征融合的视频异常行为检测

扫码查看
当前以多头自注意力为代表的基于注意力机制的特征融合方法在很大程度上取决于特征间的相关性,其跨域融合能力有限,且特征融合后由于不同特征的域间差异,导致时空感知能力不足,有效融合2种跨域特征仍面临挑战.针对 RGB 特征和光流特征跨域表达能力不足、融合后特征的时空感知能力弱等问题,提出了一种基于注意力特征融合的视频异常行为检测方法.首先采用一种轻量级注意力特征融合模块(LAFF)构筑融合机制,进行 RGB 和光流特征的融合,进而在增强融合后特征表达能力的同时减少网络参数量,提高异常检测算法性能.在全局时空感知阶段,通过多分支卷积模块(DBB)增强特征时空感知能力,同时需兼顾计算复杂度和检测效果.在UCSD Ped2数据集上取得了99.85%的识别效果,在CUHK Avenue和LAD 2000数据集上表现同样良好,验证了该方法的有效性.
Video anomaly detection based on attention feature fusion
Currently,feature fusion methods based on attention mechanisms,such as multi-head self-attention,largely rely on the correlation between features,with limited cross-domain fusion capabilities.Additionally,due to existing domain differences among various features,the spatiotemporal perception capability of the fused features is insufficient.To address the insufficient cross-domain expression capability of RGB and optical flow features and the weak spatiotemporal perception capability of the fused features,a video anomaly detection method based on attentional feature fusion was proposed.Firstly,a lightweight attentional feature fusion module(LAFF)was employed to construct the fusion mechanism,combining RGB and optical flow features,enhancing the feature expression capabilities while reducing the network's parameter count and improving anomaly detection algorithm performance.Then,in the global spatiotemporal perception stage,a diverse branch block(DBB)was utilized to enhance the spatiotemporal perception capabilities of the features,while considering computational complexity and detection effectiveness.Finally,the proposed method achieved a recognition rate of 99.85%on the UCSD Ped2 dataset and demonstrated similarly strong performance on the CUHK Avenue and LAD 2000 datasets,validating the effectiveness of the approach.

computer visionvideo anomaly detectionfeature fusionattention mechanismdiverse branch block

吴沛宸、袁立宁、胡皓、刘钊、郭放

展开 >

中国人民公安大学信息网络安全学院,北京 100038

中国人民公安大学国家安全学院,北京 100038

广西警察学院信息技术学院,广西 南宁 530028

中国人民公安大学网络空间安全与法治协同创新中心,北京 100038

展开 >

计算机视觉 异常行为检测 特征融合 注意力机制 多分支卷积

中国人民公安大学安全防范工程双一流创新研究专项广西哲学社会科学研究课题项目广西壮族自治区公安厅专项课题

2023SYL0823FTQ0052023GAQN092

2024

图学学报
中国图学学会

图学学报

CSTPCD北大核心
影响因子:0.73
ISSN:2095-302X
年,卷(期):2024.45(5)