首页|基于骨骼关键点的室外群体情绪识别

基于骨骼关键点的室外群体情绪识别

扫码查看
本文提出了一种基于骨骼关键点的室外群体情绪识别方法.首先,通过YOLOPose算法对群体中每个人进行跟踪检测和姿态估计;其次,通过姿态估计得到骨架信息,并通过骨架信息计算每个人的情绪特征;最后,将骨架信息和情绪特征输入到建立的双分支姿态情绪识别模型(D-ConvLSTM)中,提取并融合2个分支的多层次时空特征,从而根据融合后的双分支特征进行情绪分类,得到群体中每个人的情绪识别结果.实验结果表明,所提方法具有较高的室外群体情绪识别精度.
Outdoor group emotion recognition based on skeleton keypoints
A method for outdoor group emotion recognition based on skeleton keypoints is proposed.Firstly,the YOLOPose algorithm is employed for tracking,detecting,and pose estimation on each individual in the group.Secondly,the skeleton information is obtained through pose estimation,and the emotion features of each person are computed based on the skeleton information.Finally,the skeleton information and emotion features are input into the established dual-branch pose-emotion recognition model(D-ConvLSTM),extracts and fuses multi-level spatiotemporal features from both branches,so as to perform emotion classification according to fused dual-branch features,obtain the emotion recognition results for each person in the group.Experimental results show that the method has high recognition precision in outdoor group emotion recognition.

outdoor group emotion recognitionskeleton keypointsfeature fusionD-ConvLSTM model

顾春睿、刘银华、赵祥涛

展开 >

青岛大学自动化学院,山东青岛 266071

青岛大学未来研究院,山东青岛 266071

室外群体情绪识别 骨骼关键点 特征融合 D-ConvLSTM模型

国家重点研发计划重点专项

2020YFB1313600

2024

传感器与微系统
中国电子科技集团公司第四十九研究所

传感器与微系统

CSTPCD北大核心
影响因子:0.61
ISSN:1000-9787
年,卷(期):2024.43(4)
  • 13