首页|基于人-物交互关系检测的带电作业人员行为识别方法研究

基于人-物交互关系检测的带电作业人员行为识别方法研究

扫码查看
为解决现有视频行为识别方法难以区分带电作业过程中某些相似行为、可识别行为种类少、未高效利用人员与物品间交互关系等问题,提出1种基于人-物交互关系检测的配网带电作业人员行为识别方法.利用轻量化姿态估计算法识别人员骨架序列,然后通过时空图卷积网络(spatial temporal graph convolutional networks,ST-GCN)提取人体运动的时空间特征并进行初步分类.对于由骨骼姿态无法有效区分的相似行为,采用目标检测算法识别人员所用工器具及使用状态,并通过融合人体动作与作业工器具所含行为信息,实现视频行为的精确识别.研究结果表明:该方法能有效识别带电作业行为,对相似行为的识别准确率约为88.9%,相较于现有基于骨架序列的带电作业人员行为方法提升约53个百分点.研究结果可为提高现场安全管控水平提供参考思路.
Research on behavior recognition method of live working personnel based on human-object interaction detection
In order to solve the problems that the existing video behavior recognition methods cannot distinguish some similar behavior in the process of live working,the number of identifiable types is small,and the interaction between personnel and objects is not utilized,a behavior recognition method of live working personnel in distribution network based on human-object interaction detection was proposed.Firstly,the lightweight pose estimation algorithm was used to identify the human skeleton sequence.Secondly,the spatio-temporal features of human motion were extracted and initially classified by the spatial tempo-ral graph convolutional networks(ST-GCN).Finally,for the similar behavior that cannot be effectively distinguished by skeletal posture,the target detection algorithm was used to identify the tools used by the personnel and the state of use,and the accurate recognition of video behavior was realized by fusing the behavior information contained in human action and oper-ation tools.The results show that the proposed method can effectively identify the live working behavior,and the recognition accuracy of similar behavior is about 88.9%,which is about 53%higher than that of the existing method based on skeleton sequence.The research results can provide reference ideas for improving the level of on-site safety management and control.

live workinghuman-object interactionbehavior recognitionST-GCNskeleton sequence

冯兴龙、吴田、万亚旭、肖宾、方春华、黎鹏、赵慧敏

展开 >

三峡大学电气与新能源学院,湖北宜昌 443002

中国电力科学研究院有限公司,湖北武汉 430074

带电作业 人-物交互关系 行为识别 ST-GCN 骨架序列

国家自然科学基金项目

51807110

2024

中国安全生产科学技术
中国安全生产科学研究院

中国安全生产科学技术

CSTPCD北大核心
影响因子:1.119
ISSN:1673-193X
年,卷(期):2024.20(9)
  • 14