首页|融合人体骨架和姿势信息特征的轻量级人体动作识别方法

融合人体骨架和姿势信息特征的轻量级人体动作识别方法

扫码查看
原文链接
  • 国家科技期刊平台
  • NETL
  • NSTL
  • 万方数据
  • 维普
针对人体动作识别任务中特征值选取不当导致识别率低、使用多模态数据导致训练成本高等问题,提出一种轻量级人体动作识别方法.首先使用OpenPose、PoseNet提取出人体骨架信息,使用BWT69CL传感器提取姿势信息;其次对数据进行预处理、特征融合,对人体动作进行深度学习分类识别;最后,为验证此方法的有效性,在公开数据集WISDM、UCI-HAR、HASC和自建的人体动作数据集上进行实验验证,并使用改进的目标引导注意力机制(target-guided attention,TGA)-长短期记忆(long short term memory,LSTM)网络输出最终的分类结果.实验结果表明,在自建数据集下融合姿势和骨架特征达到 99.87%准确率,相比于只使用姿势信息特征,识别准确率提高了约 5.31 个百分点;相比于只使用人体骨架特征,识别准确率提高了约 1.87 个百分点;在识别时间上相比于只使用姿势信息,识别时间降低了约 29.73 s;相比于只使用人体骨架数据,识别时间降低了约 9s.使用该方法能及时有效地反映人体的运动意图,有助于提高人体动作和行为的识别准确率和训练效率.
A lightweight human motion recognition method incorporating both skeletal and postural information features
A lightweight human action recognition method is proposed to solve the problems of low recognition rate due to improper selection of feature values and high training cost due to the use of multimodal data in the human action recognition task.Firstly,the human skeleton information was extracted using OpenPose and PoseNet,and the pose information was extracted using the BWT69CL sensor;And next,the data was preprocessed,the features were fused,and the human actions were recognized by deep learning and classification.Finally,in order to verify effectiveness of this method,experimental validation was performed on the public datasets WISDM,UCI-HAR,HASC,and self-constructed human action dataset,and the improved target-guided attention(TGA)-long short-term memory(LSTM)network was used to output the final classification results.The experimental results show that the fusion of pose and skeleton features under the self-constructed dataset achieves 99.87%accuracy,which improves the recognition accuracy by about 5.31 percentage points compared with that using only pose information features,and improves the recognition accuracy by about 1.87 percentage points compared with that using only human skeleton features,and reduces the recognition time by about 29.73 s compared with that using only pose information in the recognition time.Compared with that using only human skeleton data,the recognition time is reduced by about 9 s.Using this method can reflect the human body's movement intention in a timely and effective manner,which helps to improve the recognition accuracy and training efficiency of human movements and behaviors.

human skeletonpose informationlightweighthuman action recognitiontarget-directed attention mechanismdatasetmultimodalfeature extraction

王振宇、向泽锐、支锦亦、叶浩航、丁铁成

展开 >

西南交通大学设计艺术学院,四川成都 611730

西南交通大学人机环境系统设计研究所,四川成都 611730

人体骨架 姿势信息 轻量级 人体动作识别 目标引导注意力机制 数据集 多模态 特征提取

国家重点研发计划教育部产学合作协同育人项目(第二批)(2022)津发科技-功效学会"人因与功效学"项目

2022YFB4301203220705329291641

2024

10.11991/yykj.202309021

应用科技
哈尔滨工程大学

应用科技

CSTPCD
影响因子：0.693
ISSN：1009-671X
年,卷(期)：2024.51(2)
  • 33