自动化与仪器仪表2024,Issue(2) :1-5,10.DOI:10.14016/j.cnki.1001-9227.2024.02.001

基于人体关节点多特征融合的暴力行为识别

Violent behavior recognition based on multi-feature fusion of human jointpoints

赵祥涛 刘银华 李志晗 顾春睿 牛鹤群
自动化与仪器仪表2024,Issue(2) :1-5,10.DOI:10.14016/j.cnki.1001-9227.2024.02.001

基于人体关节点多特征融合的暴力行为识别

Violent behavior recognition based on multi-feature fusion of human jointpoints

赵祥涛 1刘银华 1李志晗 1顾春睿 1牛鹤群1
扫码查看

作者信息

  • 1. 青岛大学自动化学院,山东青岛 266071
  • 折叠

摘要

针对目前视频中暴力行为识别算法识别准确率不高的问题,提出一种基于人体关节点多特征融合的暴力行为识别方法.使用YOLO-Pose算法实现人体检测与姿态估计,获取人体关节点位置信息,基于人体结构提取关节点的距离特征和形状特征,基于运动特性提取关节点的动态特征和姿态特征,将所有特征信息进行融合,构建Bi-LSTM行为识别模型实现暴力行为识别分类,并设计行为识别结果稳定器,解决识别过程中因随机干扰导致的行为误判问题.在公开暴力行为数据集Violent-Flows与自制暴力行为数据集Vio-B上验证提出方法的有效性,实验表明,在Violent-Flows数据集与Vio-B数据集上本方法准确率分别达到97.9%与98.5%,高于现有方法.

Abstract

Addressing the issue of low recognition accuracy in violent behavior recognition algorithms for video data,this study proposes a method for violent behavior recognition based on multi-feature fusion of human nodes.The proposed method employs the YOLO-Pose algorithm to detect human bodies and estimate their poses,acquiring position information of human body nodes.It fur-ther extracts distance and shape features based on the human body structure and dynamic features as well as pose features based on motion characteristics from the nodes.All extracted feature information is subsequently fused.The behavior recognition model using Bi-LSTM is constructed to achieve the recognition and classification of violent behavior,while a behavior recognition result stabilizer is designed to address random interference-related misjudgments during recognition.To validate the effectiveness of the proposed ap-proach,experiments are conducted on the publicly available Violent-Flows dataset and a self-created dataset Vio-B for violent be-havior recognition.The results demonstrate that the proposed method achieves an accuracy rate of 97.9%and 98.5%on the Violent-Flows dataset and the Vio-B dataset,respectively,surpassing the performance of existing methods.

关键词

动作识别/暴力行为/特征融合/双向长短期记忆网络

Key words

action recognition/violent behavior/feature fusion/long and short term memory network

引用本文复制引用

基金项目

国家重点研发计划重点专项(2020YFB1313600)

出版年

2024
自动化与仪器仪表
重庆工业自动化仪表研究所,重庆市自动化与仪器仪表学会

自动化与仪器仪表

CSTPCD
影响因子:0.327
ISSN:1001-9227
参考文献量3
段落导航相关论文